APSIPA Transactions on Signal and Information Processing > Vol 8 > Issue 1

Video coding of dynamic 3D point cloud data

Sebastian Schwarz, Nokia Technologies, Finland, sebastian.schwarz@nokia.com , Nahid Sheikhipour, Nokia Technologies, Finland, Vida Fakour Sevom, Tampere University of Technology, Finland, Miska M. Hannuksela, Nokia Technologies, Finland
 
Suggested Citation
Sebastian Schwarz, Nahid Sheikhipour, Vida Fakour Sevom and Miska M. Hannuksela (2019), "Video coding of dynamic 3D point cloud data", APSIPA Transactions on Signal and Information Processing: Vol. 8: No. 1, e31. http://dx.doi.org/10.1017/ATSIP.2019.24

Publication Date: 20 Dec 2019
© 2019 Sebastian Schwarz, Nahid Sheikhipour, Vida Fakour Sevom and Miska M. Hannuksela
 
Subjects
 
Keywords
Point cloud codingVolumetric videoImmersive mediaAR
 

Share

Open Access

This is published under the terms of the Creative Commons Attribution licence.

Downloaded: 1497 times

In this article:
1. INTRODUCTION 
2. RELATED WORK 
3. PROJECTION-BASED COMPRESSION OF 3D DATA 
4. EVALUATION 
5. CONCLUSION 

Abstract

Due to the increased popularity of augmented (AR) and virtual (VR) reality experiences, the interest in representing the real world in an immersive fashion has never been higher. Distributing such representations enables users all over the world to freely navigate in never seen before media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today's networks. Thus, efficient compression technologies are in high demand. This paper proposes an approach to compress 3D video data utilizing 2D video coding technology. The proposed solution was developed to address the needs of “tele-immersive” applications, such as VR, AR, or mixed reality with “Six Degrees of Freedom” capabilities. Volumetric video data is projected on 2D image planes and compressed using standard 2D video coding solutions. A key benefit of this approach is its compatibility with readily available 2D video coding infrastructure. Furthermore, objective and subjective evaluation shows significant improvement in coding efficiency over reference technology. The proposed solution was contributed and evaluated in international standardization. Although it is was not selected as the winning proposal, as very similar solution has been selected developed since then.

DOI:10.1017/ATSIP.2019.24