中国科学院自动化研究所系列学术讲座邀请到阿德莱德大学沈春华教授为各位带来以“Learning to Recover 3D Scene Shape from Single monocular Images(学习从单目图像恢复3D场景形状)”为题的学术报告,具体报告信息与参与方式如下,敬请关注!
报告题目:Learning to Recover 3D Scene Shape from Single monocular Images
报告人:沈春华教授 阿德莱德大学(The University of Adelaide)
主持人:张兆翔研究员
时间:2021年4月2日(周五) 15:00
参与方式:在bilibili搜索“中科院自动化所”或扫描下方二维码进入直播间
报告摘要:
Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in mixed-data depth prediction training, and possible unknown camera focal length. We investigate this problem in detail, and propose a two-stage framework that first predicts depth up to an unknown scale and shift from a single monocular image, and then use 3D point cloud encoders to predict the missing depth shift and focal length that allow us to recover a realistic 3D scene shape. In addition, we propose an image-level normalized regression loss and a normal-based geometry loss to enhance depth prediction models trained on mixed datasets. We test our depth model on nine unseen datasets and achieve state-of-the-art performance on zero-shot dataset generalization.
报告人简介:
Professor Shen has been a Full Professor of Computer Science at The University of Adelaide since 2014, and Founding Director of the Machine Learning Theory theme at the Australian Institute for Machine Learning. His research mainly focuses on Machine Learning and Computer Vision. He was recognised as a top 5 researcher for Engineering and Computer Sciences as part of The Australian’s Life time Achievement Leaderboard (Sept. 2020, https://specialreports.theaustralian.com.au/1540291/9/), which is an exceptional achievement. He has supervised over 20 PhD students to completion. His student alumni include two Australian Research Council DECRA fellows and additional graduates who are now in tenured or tenure track roles in Universities including the University of Adelaide, Sydney University, Monash University, Wollongong University, Nanyang Technological University Singapore, and quite a few other universities in China.