3D Visual Communications

Guan-Ming Su, Dolby Labs, USADr. Guan-Ming Su received the PhD degree in Electrical Engineering from the University of Maryland, College Park, in 2006. He is currently with Dolby Labs, Santa Clara. Prior to this he was with the R&D Department, Qualcomm, Inc., San Diego; ESS Technology, Fremont; and Marvell Semiconductor, Inc., Santa Clara. Dr Su is an associate editor of Journal of Communications and director of review board and R-Letter in IEEE Multimedia Communications Technical Committee.

Provides coverage of the major theories and technologies involved in the lifecycle of 3D video content delivery
 
Presenting the technologies used in end-to-end 3D video communication systems, this reference covers 3D graphics and video coding, content creation and display, and communications and networking. It covers the full range of key areas from the fundamentals of 3D visual representation to the latest 3D video coding techniques, relevant communication infrastructure and networks to the 3D quality of experience.
 
The book is structured to logically lead readers through the topic, starting with generic and fundamental information, continuing with a detailed section of different visualisation techniques before concluding with an extensive view of 3D mobile communication systems and trends. The authors give most focus to four important areas: 3D video coding and communications; 3D graphics/gaming and mobile communications; end-to-end 3D ecosystem (including 3D display, 3D player, networking facility and 3D quality issues), and future communications and networks advances for emerging 3D experience.
* Presents the theory and key concepts behind the latest 3D visual coding framework, standards, and corresponding quality assessment
* Provides fundamental material which forms the basis for future research on enhancing the performance of 3D visual communications over current and future wireless networks
* Covers important topics including: 3D video coding and communications; 3D graphics/gaming and mobile communications; end-to-end 3D ecosystem; and future communications and networks advances for emerging 3D experience
 
Essential reading for engineers involved in the research, design and development of 3D visual coding and 3D visual transmission systems and technologies, as well as academic and industrial researchers.

Provides coverage of the major theories and technologies involved in the lifecycle of 3D video content delivery

Presenting the technologies used in end-to-end 3D video communication systems, this reference covers 3D graphics and video coding, content creation and display, and communications and networking.

Preface ix
 
About the Authors xiii
 
1 Introduction 1
 
1.1 Why 3D Communications? 1
 
1.2 End-to-End 3D Visual Ecosystem 3
 
1.2.1 3D Modeling and Representation 5
 
1.2.2 3D Content Creation 6
 
1.2.3 3D Video Compression 7
 
1.2.4 3D Content Delivery 8
 
1.2.5 3D Display 9
 
1.2.6 3D QoE 9
 
1.3 3D Visual Communications 10
 
1.4 Challenges and Opportunities 11
 
References 15
 
2 3D Graphics and Rendering 17
 
2.1 3DTV Content Processing Procedure 19
 
2.2 3D Scene Representation with Explicit Geometry - Geometry Based Representation 22
 
2.2.1 Surface Based Representation 23
 
2.2.2 Point Based Representation 37
 
2.2.3 Point Based Construction 38
 
2.2.4 Point Based Compression and Encoding for Transmission 38
 
2.2.5 Point Based Rendering: Splatting 39
 
2.2.6 Volumetric Representation 40
 
2.2.7 Volumetric Construction 40
 
2.2.8 Volumetric Compression and Encoding for Transmission 41
 
2.2.9 Volumetric Rendering 42
 
2.3 3D Scene Representation without Geometry - Image-Based Representation 43
 
2.3.1 Plenoptic Function 43
 
2.3.2 Single Texture Representation 46
 
2.3.3 Multiple Texture Representation 48
 
2.3.4 Image Based Animation 51
 
2.4 3D Scene Representation with Implicit Geometry - Depth-Image-Based Representation 51
 
2.4.1 History of Depth-Image-Based Representation 52
 
2.4.2 Fundamental Concept Depth-Image-Based Representation 53
 
2.4.3 Depth Construction 56
 
2.4.4 Depth-Image-Based Animation 57
 
References 57
 
3 3D Display Systems 63
 
3.1 Depth Cues and Applications to 3D Display 63
 
3.1.1 Monocular Depth Cues 63
 
3.1.2 Binocular Depth Cues 64
 
3.2 Stereoscopic Display 65
 
3.2.1 Wavelength Division (Color) Multiplexing 65
 
3.2.2 Polarization Multiplexing 69
 
3.2.3 Time Multiplexing 69
 
3.3 Autostereoscopic Display 71
 
3.3.1 Occlusion-Based Approach 71
 
3.3.2 Refraction-Based Approach 75
 
3.4 Multi-View System 78
 
3.4.1 Head Tracking Enabled Multi-View Display 79
 
3.4.2 Automultiscopic 79
 
3.5 Recent Advances in Hologram System Study 83
 
References 84
 
4 3D Content Creation 85
 
4.1 3D Scene Modeling and Creation 85
 
4.1.1 Geometry-Based Modeling 86
 
4.1.2 Image-Based Modeling 86
 
4.1.3 Hybrid Approaches 87
 
4.2 3D Content Capturing 87
 
4.2.1 Stereo Camera 87
 
4.2.2 Depth Camera 88
 
4.2.3 Multi-View Camera 88
 
4.2.4 3D Capturing with Monoscopic Camera 89
 
4.3 2D-to-3D Video Conversion 101
 
4.3.1 Automatic 2D-to-3D Conversion 103
 
4.3.2 Interactive 2D-to-3D Conversion 111
 
4.3.3 Showcase of 3D Conversion System Design 112
 
4.4 3D Multi-View Generation 125
 
References 126
 
5 3D Video Coding and Standards 129
 
5.1 Fundamentals of Video Coding 129
 
5.2 Two-View Stereo Video Coding 142
 
5.2.1 Individual View Coding 142
 
5.2.2 Inter-View Prediction Stereo Video Coding 143
 
5.3 Frame-Compatible Stereo Coding 144
 
5.3.1 Half-Resolution Frame-Compatible Stereo Coding 144
 
5.3.2 Full-Resolution Frame-Compatible Layer Approach 146
 
5.4 Video Plus Depth Coding 148
 
5.5 Multiple View Coding 156
 
5.6 Multi-View Video Plus Depth (MVD) Video 160
 
5.7 Layered Depth Video (LDV) 163
 
5.8 MPEG-4 BIFS and

Lieferung vom Verlag mit leichten Qualitätsmängeln möglich