patents.google.com

Attal et al., 2020 - Google Patents

  • ️Wed Jan 01 2020
Matryodshka: Real-time 6dof video view synthesis using multi-sphere images

Attal et al., 2020

View PDF
Document ID
10989159617796509767
Author
Ling S
Gokaslan A
Richardt C
Tompkin J
Publication year
2020
Publication venue
European Conference on Computer Vision

External Links

Snippet

We introduce a method to convert stereo 360^ ∘ (omnidirectional stereo) imagery into a layered, multi-sphere image representation for six degree-of-freedom (6DoF) rendering. Stereo 360^ ∘ imagery can be captured from multi-camera systems for virtual reality (VR) …

Continue reading at arxiv.org (PDF) (other versions)
  • 238000003786 synthesis reaction 0 title description 20

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/0203Picture signal generators using a stereoscopic image camera
    • H04N13/0207Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/0203Picture signal generators using a stereoscopic image camera
    • H04N13/0239Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • H04N13/0007Processing stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/04Picture reproducers

Similar Documents

Publication Publication Date Title
Attal et al. 2020 Matryodshka: Real-time 6dof video view synthesis using multi-sphere images
Serrano et al. 2019 Motion parallax for 360 RGBD video
Zhou et al. 2018 Stereo magnification: Learning view synthesis using multiplane images
Lin et al. 2020 Deep multi depth panoramas for view synthesis
US20130321396A1 (en) 2013-12-05 Multi-input free viewpoint video processing pipeline
Richardt et al. 2020 Capture, reconstruction, and representation of the visual real world for virtual reality
US20080246759A1 (en) 2008-10-09 Automatic Scene Modeling for the 3D Camera and 3D Video
JP7519390B2 (en) 2024-07-19 Neural Blending for Novel View Synthesis
Bonatto et al. 2021 Real-time depth video-based rendering for 6-DoF HMD navigation and light field displays
Cheng et al. 2022 Quad‐fisheye Image Stitching for Monoscopic Panorama Reconstruction
da Silveira et al. 2023 Omnidirectional visual computing: Foundations, challenges, and applications
Fachada et al. 2022 Chapter View Synthesis Tool for VR Immersive Video
Tenze et al. 2024 altiro3d: scene representation from single image and novel view synthesis
Pintore et al. 2024 Deep synthesis and exploration of omnidirectional stereoscopic environments from a single surround-view panoramic image
Farbiz et al. 2005 Live three-dimensional content for augmented reality
Huang et al. 2023 360$^\circ $∘ Stereo Image Composition With Depth Adaption
Cooke et al. 2006 Multi-view synthesis: A novel view creation approach for free viewpoint video
Li et al. 2021 Extending 6-dof vr experience via multi-sphere images interpolation
Mühlhausen et al. 2020 Temporal consistent motion parallax for omnidirectional stereo panorama video
Yan et al. 2019 Stereoscopic image generation from light field with disparity scaling and super-resolution
Mühlhausen et al. 2023 Immersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo Video
Feng et al. 2023 Enhancing perception and immersion in pre-captured environments through learning-based eye height adaptation
Thatte et al. 2021 Real-World Virtual Reality With Head-Motion Parallax
Tompkin 0 MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
Balázs et al. 2014 Towards mixed reality applications on light-field displays