patents.google.com

Li et al., 2022 - Google Patents

  • ️Sat Jan 01 2022
Neural 3d video synthesis from multi-view video

Li et al., 2022

View PDF
Document ID
5276989799202751831
Author
Slavcheva M
Zollhoefer M
Green S
Lassner C
Kim C
Schmidt T
Lovegrove S
Goesele M
Newcombe R
Lv Z
Publication year
2022
Publication venue
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

External Links

Snippet

We propose a novel approach for 3D video synthesis that is able to represent multi-view video recordings of a dynamic real-world scene in a compact, yet expressive representation that enables high-quality view synthesis and motion interpolation. Our approach takes the …

Continue reading at openaccess.thecvf.com (PDF) (other versions)
  • 230000001537 neural 0 title abstract description 44

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding, e.g. from bit-mapped to non bit-mapped
    • G06T9/001Model-based coding, e.g. wire frame
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/0203Picture signal generators using a stereoscopic image camera
    • H04N13/0207Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46Extraction of features or characteristics of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/02Picture signal generators
    • H04N13/026Picture signal generators with monoscopic to stereoscopic image conversion
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/08Bandwidth reduction
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding

Similar Documents

Publication Publication Date Title
Li et al. 2022 Neural 3d video synthesis from multi-view video
Xian et al. 2021 Space-time neural irradiance fields for free-viewpoint video
Wu et al. 2020 Multi-view neural human rendering
Li et al. 2024 Spacetime gaussian feature splatting for real-time dynamic view synthesis
Li et al. 2021 Neural scene flow fields for space-time view synthesis of dynamic scenes
Bergman et al. 2022 Generative neural articulated radiance fields
Attal et al. 2023 HyperReel: High-fidelity 6-DoF video with ray-conditioned sampling
Liu et al. 2023 Robust dynamic radiance fields
Zhang et al. 2022 Nerfusion: Fusing radiance fields for large-scale scene reconstruction
Bozic et al. 2021 Transformerfusion: Monocular rgb scene reconstruction using transformers
Yu et al. 2021 Plenoctrees for real-time rendering of neural radiance fields
Song et al. 2023 Nerfplayer: A streamable dynamic scene representation with decomposed neural radiance fields
Tewari et al. 2020 State of the art on neural rendering
Wang et al. 2021 Learning compositional radiance fields of dynamic human heads
Hu et al. 2024 Gauhuman: Articulated gaussian splatting from monocular human videos
Kopanas et al. 2022 Neural point catacaustics for novel-view synthesis of reflections
Li et al. 2022 Streaming radiance fields for 3d video synthesis
Zhao et al. 2022 Human performance modeling and rendering via neural animated mesh
Stier et al. 2021 Vortx: Volumetric 3d reconstruction with transformers for voxelwise view selection and fusion
Ost et al. 2022 Neural point light fields
Tian et al. 2023 Mononerf: Learning a generalizable dynamic radiance field from monocular videos
Lin et al. 2021 Deep 3d mask volume for view synthesis of dynamic scenes
Lin et al. 2023 High-fidelity and real-time novel view synthesis for dynamic scenes
CN115298708A (en) 2022-11-04 Multi-view Neural Human Rendering
Tan et al. 2018 360-degree virtual-reality cameras for the masses