3D VIDEO SYSTEMS 3D VIDEO SYSTEMS Fernando Pereira Instituto Superior Técnico Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
It’s a 3D World It’s a 3D World, Stupid It’s a 3D World It’s a 3D World, Stupid , Stupid ! , Stupid ! Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Context and Motivation Context and Motivation Context and Motivation Context and Motivation • Strong interest in 3D services • Production of premium content increasing • Numerous devices supporting stereoscopic display available to the consumer • Substantial investments being made to upgrade digital cinema theaters with 3D capabilities • Many new standards being developed, e.g. production, distribution, digital interfaces Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Stereoscopic Displays Sales Forecast Stereoscopic Displays Sales Forecast Stereoscopic Displays Sales Forecast Stereoscopic Displays Sales Forecast Source: DisplaySearch 3D Display Technology and Market Forecast Report Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Critical Success Factors Critical Success Factors Critical Success Factors Critical Success Factors • High quality experience not burdened with high transition costs or turned off by viewing discomfort or fatigue • Usability and consumer acceptance of 3D viewing technology, e.g., glasses vs no glasses, Transition costs • Availability of premium 3D content in the home • Determination of an appropriate data format providing interoperability through the delivery chain and taking into consideration the constraints imposed by each delivery channel Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Basics Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Experiences … and 3D Video … 3D Experiences … and 3D Video … 3D Experiences … and 3D Video … 3D Experiences … and 3D Video … • 3D experiences may be provided with 3D video in two main ways: - Depth perception/illusion – Provided through stereo video pairs which create an illusion of depth for the scene - Navigation – Provided through free viewpoint video (FVV) with n video views which allow navigating the 3D scene by changing the viewpoint and view direction within certain ranges (each view may be stereo) • 3D video is considered to refer to both the general n views multi-view video representation AND its important stereo-view special case. Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Human Human Visual Human Human Visual Visual System Visual System System System Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Screen Parallax … Screen Parallax … Screen Parallax … Screen Parallax … Screen Parallax = distance between P left and P right ���� � ���� ��� � ����� ����� ������������ ��� �������� � ����� ��������� � ���� ������������ ��������� ��������� �������������� Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Stereoscopic Vision Stereoscopic Vision Stereoscopic Vision Stereoscopic Vision • Accommodation/convergence - The viewer eyes accommodate Negative (focus) to the depth of the Disparity display - and converge (point) to the depth of the image ������������ ������������ ���� ������� • Negative and positive disparities ����� are not a natural situation as Positive - Normally, both accommodation Disparity and convergence occur at the same depth - Too large a disparity causes eyestrain (especially in older viewers) Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Stereoscopy Stereoscopy Stereoscopy Stereoscopy Stereoscopy (also called stereoscopic or 3D imaging) regards the capability of recreating 3D visual information or creating the illusion of depth in an image based on two appropriate views. The basic requirement is to recreate offset images (with parallax) that are presented separately to the left and right eye. Both of these 2D offset images are then combined in the brain to give the perception of 3D depth. Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Stereoscopy: Better 3D Illusions … Stereoscopy: Better 3D Illusions … Stereoscopy: Better 3D Illusions … Stereoscopy: Better 3D Illusions … Most of the perceptual cues that humans use to visualize the world’s 3D structure are • available in 2D projections; this is why images on a television screen and at the cinema make sense. Perceptual cues for 3D perception include: Occlusion - one object partially covering another - Perspective - point of view - Familiar size - we know the real-world sizes of many objects - Atmospheric haze - objects further away look more washed out - Selective focus – the object of interest is in focus - Some main cues are missing from 2D media: • Stereo parallax - seeing a different image with each eye - Movement parallax - seeing different images when we move our heads - Accommodation of the eyeball (eyeball focus) - process by which the eye changes optical power to - maintain a clear image (focus) on an object as its distance changes. Stereoscopy is the enhancement of the illusion of depth in an image or movie by • presenting a slightly different image to each eye. The movement parallax cue is still not satisfied with stereoscopy and, therefore, the illusion of depth is incomplete. Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Free Viewpoint Systems Free Viewpoint Systems Free Viewpoint Systems Free Viewpoint Systems Free viewpoint systems require the acquisition of multiple scene views taken from different angles, allowing the user to navigate around the scene. Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Video Applications … 3D Video Applications … 3D Video Applications … 3D Video Applications … The complete 3D video system is relevant for multiple applications such as broadcast TV, teleconference, surveillance, interactive video, cinema, gaming and other immersive video applications. 3D Encoding & 3D Video Distribution Video Compression Left Eye 3D Home Channels Master Blu-ray Disc DVD Cable TV Satellite TV Right Eye Terrestrial TV IPTV 3D Format Video Internet Encode Compress 3D Home Package Video 3D Format Decompress Decode Media Players 3D TV & Set Top Boxes Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Video Content Chain … 3D Video Content Chain … 3D Video Content Chain … 3D Video Content Chain … Content acquisition Content Content Content and creation Representation Distribution Consumption The 3D content chain includes a sequence of modules which closely mirror a • conventional 2D system but are quite different; they have all to evolve towards 3D regarding the 2D available solutions. 3D content creation involves special production “rules”, e.g. avoid fast pans and manage • depth transitions. Content representation, distribution and display may be performed with many different • formats; the best choice depends on distribution constraints, display capabilities, available equipment, target quality, etc. New 3D display technology is an important driving force: no glasses, multi-persons • displays, higher display resolutions, avoid uneasy feelings (headaches, nausea, eye strain, etc.). Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Video Content Acquisition and Creation Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
History of 3D Video … History of 3D Video … History of 3D Video … History of 3D Video … Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Content is Exploding … Again … 3D Content is Exploding … Again … 3D Content is Exploding … Again … 3D Content is Exploding … Again … • 165 3D movies released since 1953 • Almost 30 3D movies only in 1953 • Much more to come … Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Momentum … 3D Momentum … 3D Momentum … 3D Momentum … • Hollywood is now able to offer unique, high-quality immersive 3D experiences in theaters • Revenue per 3D screen is typically three times higher than traditional 2D screens • Increased momentum in 3D production and growing consumer appetite for 3D content Avatar cost was around $500 million !!! Box office in Jan 2011 was $2,781,835,502 … Naturally, the sequel is coming .! Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Cameras … 3D Cameras … 3D Cameras … 3D Cameras … A stereo camera is a type of camera with two lenses with a separate image • sensor or film frame for each lens. This allows simulating human binocular vision, and gives it the ability to capture 3D images, a process known as stereo photography. Stereo cameras may be used for making stereoviews and 3D pictures for movies. The distance between the lenses in a typical stereo camera (the intra-axial • distance) is about the distance between one's eyes (known as the intra-ocular distance); this is about 6.35 cm, although a longer base line (greater inter- camera distance) produces more extreme 3-dimensionality. Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
3D Video Content Representation Comunicação de Áudio e Vídeo, Fernando Pereira, 2012
Recommend
More recommend
