CCIS Talk: RGB-D Video Acquisition and Synthesis by Hsueh-Ming Hang

You are cordially invited to attend the following CCIS event:

Title: RGB-D Video Acquisition and Synthesis
Date: 11 December 2017 (Monday)
Time: 2:00 pm
Venue: N108, UTAR Kampar Campus, Perak
Speaker: Prof. Dr. Hsueh-Ming Hang, NCTU
Admission: Free
Contact: Dr Lau Phooi Yee (laupy@utar.edu.my)

Abstract:
The focus of next-generation 3D research is on the so-called virtual-viewpoint (or free-viewpoint) video system. It is also an on-going standardization item in the international ITU/MPEG Standards. Typically, a densely arranged camera array is used to acquire input images and a number of virtual view pictures are synthesized at the receiver using the depth-image based rendering (DIBR) technique.
In this talk, we will focus on two essential components in a virtual-view system: RGB-D video acquisition and view synthesis. Recent devices such as Microsoft Kinect offer an inexpensive hardware solution to the RGB-D video acquisition. However, its depth map quality needs to be improved.
We use four (2 by 2) Kinects to capture video and synthesize a virtual-view video in-between. In addition to depth map improvement, we develop a multiple view blending algorithm, which decides the best view(s) used to generate the synthesized image pixel by pixel. Another challenge is the complexity of view-synthesis procedure. In the second part of this talk, we describe a few techniques to reduce computational complexity and use a parallel processing structure, NVIDIA CUDA, to implement the view synthesis task. With the aid of GPU, we can speed up in the view synthesis process significantly.

Biography:

Hsueh-Ming Hang received the B.S. and M.S. degrees from National Chiao Tung University, Hsinchu, Taiwan, in 1978 and 1980, respectively, and Ph.D. in Electrical Engineering from Rensselaer Polytechnic Institute, Troy, NY, in 1984.
From 1984 to 1991, he was with AT&T Bell Laboratories, Holmdel, NJ, and then he joined the Electronics Engineering Department of National Chiao Tung University (NCTU), Hsinchu, Taiwan, in December 1991.
From 2006 to 2009, he was appointed as Dean of the EECS College at National Taipei University of Technology (NTUT). From 2014 to 2017, he served as the Dean of the ECE College at NCTU.
He has been actively involved in the international MPEG standards since 1984 and his current research interests include multimedia compression, multiview image/video processing, and deep-learning based image/video processing.
Dr. Hang holds 13 patents (Taiwan, US and Japan) and has published over 190 technical papers related to image compression, signal processing, and video codec architecture. He was an associate editor (AE) of the IEEE Transactions on Image Processing (1992-1994, 2008-2012) and the IEEE Transactions on Circuits and Systems for Video Technology (1997-1999). He is a co-editor and contributor of the Handbook of Visual Communications published by Academic Press in 1995. He was an IEEE Circuits and Systems Society Distinguished Lecturer (2014-2015) and is a Board Member of the Asia-Pacific Signal and Information Processing Association (APSIPA) (2013-2018). He is a recipient of the IEEE Third Millennium Medal and is a Fellow of IEEE and IET and a member of Sigma Xi.