patents.google.com

Weng et al., 2020 - Google Patents

  • ️Wed Jan 01 2020
Vid2actor: Free-viewpoint animatable person synthesis from video in the wild

Weng et al., 2020

View PDF
Document ID
9163286144401064475
Author
Curless B
Kemelmacher-Shlizerman I
Publication year
2020
Publication venue
arXiv preprint arXiv:2012.12884

External Links

Snippet

Given an" in-the-wild" video of a person, we reconstruct an animatable model of the person in the video. The output model can be rendered in any body pose to any camera view, via the learned controls, without explicit 3D mesh reconstruction. At the core of our method is a …

Continue reading at arxiv.org (PDF) (other versions)
  • 230000002194 synthesizing 0 title abstract description 15

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • G06T15/60Shadow generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/06Ray-tracing
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00Image generation
    • G06T2211/40Computed tomography
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/001Texturing; Colouring; Generation of texture or colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20112Image segmentation details
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding, e.g. from bit-mapped to non bit-mapped
    • G06T9/001Model-based coding, e.g. wire frame
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46Extraction of features or characteristics of the image

Similar Documents

Publication Publication Date Title
Weng et al. 2020 Vid2actor: Free-viewpoint animatable person synthesis from video in the wild
Weng et al. 2022 Humannerf: Free-viewpoint rendering of moving people from monocular video
Kopanas et al. 2021 Point‐Based Neural Rendering with Per‐View Optimization
He et al. 2021 Arch++: Animation-ready clothed human reconstruction revisited
Yuan et al. 2021 Star: Self-supervised tracking and reconstruction of rigid objects in motion with neural rendering
CN109255831B (en) 2020-06-12 A method for single-view face 3D reconstruction and texture generation based on multi-task learning
Lee et al. 2023 Dp-nerf: Deblurred neural radiance field with physical scene priors
Raj et al. 2021 Pva: Pixel-aligned volumetric avatars
Raj et al. 2021 Pixel-aligned volumetric avatars
CN110223370B (en) 2023-03-07 Method for generating complete human texture map from single-view picture
Corona et al. 2023 Structured 3d features for reconstructing controllable avatars
Kim et al. 2023 Chupa: Carving 3d clothed humans from skinned shape priors using 2d diffusion probabilistic models
CN115298708A (en) 2022-11-04 Multi-view Neural Human Rendering
Peng et al. 2023 Implicit neural representations with structured latent codes for human body modeling
Weng et al. 2023 PersonNeRF: Personalized reconstruction from photo collections
Hu et al. 2023 Humanliff: Layer-wise 3d human generation with diffusion model
Liu et al. 2024 Mvsgaussian: Fast generalizable gaussian splatting reconstruction from multi-view stereo
Xu et al. 2021 Scalable image-based indoor scene rendering with reflections
Ren et al. 2023 Facial geometric detail recovery via implicit representation
Xu et al. 2023 Renerf: Relightable neural radiance fields with nearfield lighting
Tiwary et al. 2022 Towards learning neural representations from shadows
Saroha et al. 2024 Gaussian splatting in style
Hu et al. 2023 Cloth texture preserving image-based 3D virtual try-on
Shaw et al. 2023 SWinGS: Sliding Windows for Dynamic 3D Gaussian Splatting
Brahimi et al. 2024 SupeRVol: Super-Resolution Shape and Reflectance Estimation in Inverse Volume Rendering