黄怀波

黄怀波  /  

  • 职  称: 副研究员
  • 邮  编: 100191
  • 电子邮件: huaibo.huang@cripac.ia.ac.cn
  • 部门/实验室: 多模态人工智能系统全国重点实验室、智能感知与计算研究中心
  • 通讯地址: 北京市海淀区中关村东路95号

个人简历

黄怀波,中国科学院自动化研究所多模态人工智能系统全国重点实验室副研究员,北京图象图形学学会理事,中国图象图形学学会视觉大数据专委会委员。2012年和2016年分别于西安交通大学和北京航空航天大学获得学士学位和硕士学位,2019年于中国科学院大学获得计算机应用技术专业博士学位。从事模式识别和计算机视觉基础理论研究,并应用到视觉内容合成与鉴别、图像和视频处理、生物特征识别等领域。在TPAMI、IJCV、NeurIPS、CVPR、ICCV等国际权威期刊和会议发表论文合计50余篇,其中包括CCF-A类论文30篇,出版Springer专著一部。入选北京市科技新星计划、北京市科协青年人才托举工程和中国科学院青年创新促进会,曾获得吴文俊人工智能科学技术奖技术发明奖一等奖、北京市优秀毕业生和中国科学院院长优秀奖,获得国际多媒体大会(ICME)研讨会最佳学生论文奖。

研究方向

计算机视觉、生成式人工智能、深度学习网络架构、图像恢复和增强

承担科研项目情况

( 1 ) 基于解耦表达的高保真人脸图像合成理论和方法研究, 负责人, 国家任务, 2021-01--2023-12
( 2 ) 多媒体混合伪造生成模型的稳定性研究, 负责人, 国家任务, 2020-07--2023-06
( 3 ) 中国科学院青年创新促进会, 负责人, 中国科学院计划, 2022-03--2025-12
( 4 ) 人脸增强、旋转与Sketch转换技术, 负责人, 境内委托项目, 2018-12--2024-06
( 5 ) 面向复杂场景的小样本视频自动生成研究, 负责人, 境内委托项目, 2021-09--2022-08
( 6 ) 基于MindSpore的视觉内容智能合成与鉴别技术研究, 负责人, 境内委托项目, 2022-11--2023-11
( 7 ) 北京市科技新星创新新星计划, 负责人, 地方任务, 2023-10--2026-10

代表论著

期刊论文
1. Huaibo Huang, Mandi Luo, Ran He. Memory Uncertainty Learning for Real-World Single Image Deraining. Trans. Pattern Analysis and Machine Intelligence (TPAMI), 2022. (IF: 23.6,CCF-A,人工智能领域顶级期刊)
2. Huaibo Huang, Aijing Yu, Zhenhua Chai, Ran He, Tieniu Tan. Selective Wavelet Attention Learning for Single Image Deraining. International Journal of Computer Vision (IJCV), 2021. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)
3. Huaibo Huang, Ran He, Zhenan Sun, Tieniu Tan. Wavelet Domain Generative Adversarial Network for Multi-scale Face Hallucination. International Journal of Computer Vision (IJCV), 127(6-7): 763-784, 2019. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)
4. Yi Li#, Huaibo Huang#, Jie Cao, Ran He, Tieniu Tan. Disentangled Representation Learning of Makeup Portraits in the Wild. International Journal of Computer Vision (IJCV), 2020, 128: 2166–2184. (Co-first author)(IF: 19.5,CCF-A,计算机视觉领域顶级期刊)
5. Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He. DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition. Trans. Pattern Analysis and Machine Intelligence (TPAMI), 2021. (IF: 23.6,CCF-A,人工智能领域顶级期刊)
6. Aijing Yu, Haoxue Wu, Huaibo Huang, Zhen Lei, Ran He. LAMP-HQ: A Large-Scale Multi-Pose High-Quality Database for NIR-VIS Face Recognition. International Journal of Computer Vision (IJCV), 2021. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)
7. Xin Zheng, Yanqing Guo, Huaibo Huang, Yi Li, Ran He. A Survey to Deep Facial Attribute Analysis. International Journal of Computer Vision (IJCV), 2020. (IF: 19.5,CCF-A,计算机视觉领域顶级期刊)
8. Jianze Wei, Huaibo Huang, Yunlong Wang, Ran He, Zhenan Sun. Towards More Discriminative and Robust Iris Recognition by Learning Uncertain Factors. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)
9. Jianze Wei, Yunlong Wang, Huaibo Huang, Ran He, Zhenan Sun, Xingyu Gao. Contextual Measures for Iris Recognition. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)
10. Mandi Luo, Haoxue Wu, Huaibo Huang, Weizan He, Ran He. Memory-Modulated Transformer Network for Heterogeneous Face Recognition. IEEE Transactions on Information Forensics & Security (TIFS), 2022. (IF: 6.8,CCF-A,信息安全领域顶级期刊)
11. Xiaoqiang Zhou, Huaibo Huang, Zilei Wang, Ran He. RISTRA: Recursive Image Super-resolution Transformer with Relativistic Assessment. IEEE Transactions on Multimedia (TMM), 2024. (IF: 7.3, CCF-B, 多媒体领域权威期刊)
12. Xin Zheng, Huaibo Huang, Yanqing Guo, Ran He.  BLAN: Bi-directional Ladder Attentive Network for Facial Attribute Prediction. Pattern Recognition (PR), 2020. (IF: 8,CCF-B,模式识别领域权威期刊)
13. Xin Ma, Xiaoqiang Zhou, Huaibo Huang, Gengyun Jia, Zhenhua Chai, Xiaolin Wei.  Contrastive Attention Network with the Dense Field Estimation for Face Completion. Pattern Recognition (PR), 2021.  (IF: 8,CCF-B,模式识别领域权威期刊)
会议论文
1. Huaibo Huang, Xiaoqiang Zhou, Jie Cao, Ran He, Tieniu Tan. Vision Transformer with Super Token Sampling. Computer Vision and Pattern Recognition (CVPR), 2023. (CCF-A,计算机视觉领域顶级会议)
2. Huaibo Huang, Xiaoqiang Zhou, Ran He. Orthogonal Transformer: An Efficient Vision Transformer Backbone with Token Orthogonalization. Neural Information Processing Systems (NeurIPS), 2022. (CCF-A,机器学习领域顶级会议)
3. Huaibo Huang, Aijing Yu, Ran He. Memory Oriented Transfer Learning for Semi-Supervised Image Deraining. Computer Vision and Pattern Recognition (CVPR), 2021. (CCF-A,计算机视觉领域顶级会议)
4. Huaibo Huang, Zhihang Li, Ran He, Zhenan Sun, Tieniu Tan. IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis. Neural Information Processing Systems (NeurIPS), 2018: 52-63. (CCF-A,机器学习领域顶级会议)
5. Huaibo Huang, Ran He, Zhenan Sun, Tieniu Tan. Wavelet-SRNet: A Wavelet-based CNN for Multi-scale Face Super Resolution. International Conference on Computer Vision (ICCV), 2017: 1698-1706. (CCF-A,计算机视觉领域顶级会议)
6. Peipei Li#, Huaibo Huang#, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun. Hierarchical Face Aging through Disentangled Latent Characteristics. European Conference on Computer Vision (ECCV), 2020. (Co-first author)(CCF-B, 计算机视觉领域顶级会议)
7. Yuang Ai, Huaibo Huang*, Xiaoqiang Zhou, Jiexiang Wang, Ran He. Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration. Computer Vision and Pattern Recognition (CVPR), 2024. (Corresponding author) (CCF-A,计算机视觉领域顶级会议)
8. Yuang Ai, Xiaoqiang Zhou, Huaibo Huang*, Lei Zhang, Ran He. Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformer. Computer Vision and Pattern Recognition (CVPR), 2024.(Corresponding author) (CCF-A,计算机视觉领域顶级会议)
9. Qihang Fan, Huaibo Huang, Mingrui Chen, Hongmin Liu, Ran He. RMT: Retentive Networks Meet Vision Transformers. Computer Vision and Pattern Recognition (CVPR), 2024. (CCF-A,计算机视觉领域顶级会议)
10. Qihang Fan, Huaibo Huang, Xiaoqiang Zhou, Ran He. Lightweight Vision Transformer with Bidirectional Interaction. Neural Information Processing Systems (NeurIPS), 2023.(CCF-A,机器学习领域顶级会议)
11. Rui Wang, Pei Pei Li, Huaibo Huang, Chunshui Cao, Ran He, Zhaofeng He. Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification. Neural Information Processing Systems (NeurIPS), 2023.(CCF-A,机器学习领域顶级会议)
12. Xiaoqiang Zhou, Huaibo Huang, Zilei Wang, Jie Hu, Ran He, Tieniu Tan. MSRA-SR: Image Super-resolution Transformer with Multi-scale Shared Representation Acquisition. International Conference on Computer Vision (ICCV), 2023. (CCF-A,计算机视觉领域顶级会议)
13. Peipei Li, Rui Wang, Huaibo Huang, Ran He, Zhaofeng He. Pluralistic Aging Diffusion Autoencoder. International Conference on Computer Vision (ICCV), 2023. (CCF-A,计算机视觉领域顶级会议)
14. Gengyun Jia, Huaibo Huang, Chaoyou Fu, Ran He. Rethinking Image Cropping: Exploring Diverse Compositions from Global Views. Computer Vision and Pattern Recognition (CVPR), 2022. (CCF-A,计算机视觉领域顶级会议)
15. Xin Xie, Yi Li, Huaibo Huang, Haiyan Fu, Wanwan Wang, Yanqing Guo. Artistic Style Discovery With Independent Components. Computer Vision and Pattern Recognition (CVPR), 2022. (CCF-A,计算机视觉领域顶级会议)
16. Gege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li, Ran He. Information Bottleneck Disentanglement for Identity Swapping. Computer Vision and Pattern Recognition (CVPR), 2021. (CCF-A,计算机视觉领域顶级会议)
17. Zi Wang, Huaibo Huang, Aihua Zheng, Ran He. Heterogeneous Test-time Training for Multi-modal Person Re-identification. AAAI Conference on Artificial Intelligence (AAAI), 2024.(CCF-A,人工智能领域顶级会议)
18. Xiang Wu, Huaibo Huang, Vishal Patel, Ran He, Zhenan Sun. Disentangled Variational Representation for Heterogeneous Face Recognition. AAAI Conference on Artificial Intelligence (AAAI), 2019.(CCF-A,人工智能领域顶级会议)
19. Weikuo Guo, Huaibo Huang, Xiangwei Kong, Ran He. Learning Disentangled Representation for Cross-Modal Retrieval with Deep Mutual Information Estimation. ACM International Conference on Multimedia (ACMMM), 2019.(CCF-A,人工智能领域顶级会议)
20. Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He. Dual Variational Generation for Low-Shot Heterogeneous Face Recognition. Neural Information Processing Systems (NeurIPS), 2019.(CCF-A,机器学习领域顶级会议)
21. Jie Cao, Huaibo Huang, Yi Li, Jingtuo Liu, Ran He, Zhenan Sun. Informative Sample Mining Network for Multi-Domain Image-to-Image Translation. European Conference on Computer Vision (ECCV), 2020. (CCF-B, 计算机视觉领域顶级会议)
22. Hao Zhu, Huaibo Huang, Yi Li, Aihua Zheng, Ran He. Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning. International Joint Conference on Artificial Intelligence (IJCAI), 2020. (CCF-A,人工智能领域顶级会议)
23. Rui Wang, Huaibo Huang, Xufeng Zhang, Jixin Ma, Aihua Zheng. A Novel Distance Learning for Elastic Cross Modal Audio-Visual Matching. Workshops: 2019 IEEE International Conference on Multimedia and Expo (ICMEW), 2019. (Best Student Paper) (CCF-B, 计算机图形学与多媒体领域权威会议)
著作
Yi Li, Huaibo Huang, Ran He, Tieniu Tan. Heterogeneous Facial Analysis and Synthesis. Springer, 2020.

获奖及荣誉

(1) 北京市科技新星, 省级, 2023
(2) 吴文俊人工智能科学技术奖技术发明奖, 一等奖, 其他, 2023
(3) 中国科学院青年创新促进会, , 院级, 2022
(4) 北京市科协青年人才托举工程, , 其他, 2020
(5) 北京市优秀毕业生, , 省级, 2019
(6) 中国科学院院长优秀奖, 院级, 2019
(7) ICME研讨会最佳学生论文奖, 其他, 2019

专利成果

[1] 赫然, 黄怀波, 周晓强, 王迎雪. 基于随机小波注意力的图像处理方法、装置、设备及介质. CN202310215782.X, 2023-03-08.
[2] 赫然, 黄怀波, 樊齐航, 周晓强. 基于几何先验的鸟瞰图语义分割方法、装置、设备及介质. CN202310041741.3, 2023-01-11.
[3] 赫然, 黄怀波, 艾雨昂, 周晓强. 基于无源领域自适应的图像超分辨率方法及装置. CN202211690099.3, 2022-12-27.
[4] 赫然, 谭铁牛, 黄怀波, 周晓强. 基于递归Transformer的动态图像复原方法. CN202211569108.3, 2022-12-08.
[5] 赫然, 黄怀波, 周晓强. 图像处理方法、装置、电子设备及存储介质. CN202210895580.X, 2022-07-28.
[6] 赫然, 黄怀波, 刘晨雨, 李佳, 段俊贤. 一种视听伪造检测方法及装置. CN114596609A, 2022-06-07.
[7] 赫然, 黄怀波, 刘晨雨, 李佳, 段俊贤. 一种基于多线索的双流视频人脸伪造检测方法及系统. CN114596608A, 2022-06-07.
[8] 赫然, 黄怀波, 李佳. 人脸图像盲修复方法及系统. CN113763268A, 2021-12-07.
[9] 赫然, 黄怀波, 高格格. 基于因果推断的高泛化人脸替换方法、装置和电子设备. CN113627404A, 2021-11-09.
[10] 赫然, 黄怀波, 徐雨婷, 贾耕云, 段俊贤. 基于视觉语义信息的人脸伪造检测方法和装置. CN113627233A, 2021-11-09.
[11] 赫然, 黄怀波, 于艾靖, 柴振华. 基于选择性机制注意力机制的雨图去雨方法、系统及设备. CN: CN112862875A, 2021-05-28.
[12] 赫然, 丁雨禾, 马鑫, 骆曼迪, 郑爱华, 黄怀波, 单彩峰. 漫画风格图像转换模型的训练方法、图像生成方法及装置. CN: CN112232485A, 2021-01-15.
[13] 赫然, 马鑫, 侯峦轩, 黄怀波, 王海滨. 一种基于注意力机制的图像补全方法及装置. CN: CN112184582A, 2021-01-05.
[14] 赫然, 黄怀波, 侯峦轩, 马鑫, 单彩峰. 一种注意力机制人体图像关键点姿态估计方法及系统. CN: CN112149563A, 2020-12-29.
[15] 赫然, 郑欣, 黄怀波. 基于双向Ladder结构的人脸属性分类系统. CN: CN109886072A, 2019-06-14.

社会任职

2021-06-06-今,北京图象图形学学会, 理事 2019-11-10-今,中国图象图形学学会视觉大数据专委会, 委员