Research seminar "Multi-sensor 3D visual scene capture"

Abstract:

We propose a joint de-noising and data fusion approach where the fused modalities come from conventional high-resolution photo or video camera and low-resolution range sensor of time-of-flight type, operating in restricted conditions of low-emitting power and low number of sensor elements. Our approach includes identifying the various noise sources and suggesting suitable remedies at particular stages of data sensing and fusion. More specifically, fixed pattern noise and system noise are treated at a preliminary denoising stage working on range data only. In contrast to other 2D video/depth fusion approaches, which suggest working in planar coordinates, our approach includes additional denoising refinement in the space of 3D world coordinate system (i.e. point cloud space). Furthermore, the high-resolution grid resampling is performed as an iterative non-uniform to uniform resampling based on the Richardson method. This improves the performance compared to approaches based on low-to-high grid upsampling and subsequent refinement. We report experimental results where the achieved quality of fused data is the same as if the ToF sensor was operating in normal (low-noise) sensing mode.

CV:

AtanasGotchev (Ph.D., Technical University of Sofia, Bulgaria; Dr. Tech., Tampere University of Technology, Finland) is an Associate Professor with the Department of Signal Processing, Tampere University of Technology where he leads the 3D Media Group. His research interests are in sampling and interpolation theory; spline and spectral methods with applications to multi-dimensional signal analysis; and 3D and HDR imaging. He was Chair of the Research Exchange Committee of FP6-funded 3DTV Network of Excellence (2004-2008) and the Scientific Coordinator of FP7-funded MOBILE3DTV project (2007-2011). More recently, he has been Vice Chair of the EU COST Action 3D-ConTourNet (2012-2016), and manager of the PROLIGH Marie Curie IAPP Action (2013-2016), supporting the development of advanced signal processing methods for light-field displays. AtanasGotchev is member of EURASIP, SPE, and IEEE and was Chair of IEEE CAS & SP Chapter of Finland (2003-2005).