patents.google.com

Flynn et al., 2019 - Google Patents

  • ️Tue Jan 01 2019
Deepview: View synthesis with learned gradient descent

Flynn et al., 2019

View PDF
Document ID
10352413346341787231
Author
Broxton M
Debevec P
DuVall M
Fyffe G
Overbeck R
Snavely N
Tucker R
Publication year
2019
Publication venue
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

External Links

Snippet

We present a novel approach to view synthesis using multiplane images (MPIs). Building on recent advances in learned gradient descent, our algorithm generates an MPI from a set of sparse camera viewpoints. The resulting method incorporates occlusion reasoning …

Continue reading at openaccess.thecvf.com (PDF) (other versions)
  • 230000015572 biosynthetic process 0 title abstract description 23

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/503—Blending, e.g. for anti-aliasing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/003—Reconstruction from projections, e.g. tomography
    • G06T11/006—Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • G06T5/001—Image restoration
    • G06T5/002—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Similar Documents

Publication Publication Date Title
Flynn et al. 2019 Deepview: View synthesis with learned gradient descent
Kopanas et al. 2021 Point‐Based Neural Rendering with Per‐View Optimization
Riegler et al. 2020 Free view synthesis
Gu et al. 2023 Nerfdiff: Single-image view synthesis with nerf-guided distillation from 3d-aware diffusion
Flynn et al. 2016 Deepstereo: Learning to predict new views from the world's imagery
Sitzmann et al. 2019 Deepvoxels: Learning persistent 3d feature embeddings
Srinivasan et al. 2019 Pushing the boundaries of view extrapolation with multiplane images
Chen et al. 2019 Learning to predict 3d objects with an interpolation-based differentiable renderer
Srinivasan et al. 2018 Aperture supervision for monocular depth estimation
Weng et al. 2020 Vid2actor: Free-viewpoint animatable person synthesis from video in the wild
Knyaz et al. 2018 Image-to-voxel model translation with conditional adversarial networks
US11257276B2 (en) 2022-02-22 Appearance synthesis of digital faces
CN116071278A (en) 2023-05-05 UAV aerial image synthesis method, system, computer equipment and storage medium
US8040352B2 (en) 2011-10-18 Adaptive image interpolation for volume rendering
Huang et al. 2023 Local implicit ray function for generalizable radiance field representation
Liu et al. 2019 High-quality textured 3D shape reconstruction with cascaded fully convolutional networks
Xu et al. 2021 Scalable image-based indoor scene rendering with reflections
Zhou et al. 2023 Dynpoint: Dynamic neural point for view synthesis
Kolos et al. 2020 TRANSPR: Transparency ray-accumulating neural 3D scene point renderer
Nguyen et al. 2021 Rgbd-net: Predicting color and depth images for novel views synthesis
Lu et al. 2020 Single image shape-from-silhouettes
Wiles et al. 2019 Learning to predict 3d surfaces of sculptures from single and multiple views
Guo et al. 2023 Content-aware warping for view synthesis
Phongthawee et al. 2022 Nex360: Real-time all-around view synthesis with neural basis expansion
Zhang et al. 2021 Pseudo-LiDAR point cloud magnification