Skip to content

Latest commit

 

History

History
395 lines (314 loc) · 43.1 KB

README.md

File metadata and controls

395 lines (314 loc) · 43.1 KB
Raw

A Curated List of Awesome Virtual Try-on (VTON) Research!

A curated list of awesome research papers, projects, code, datasets, workshops, etc. related to virtual try-on (VTON).

Prompt-based Virtual Try-on

ControlNet

  • ControlNet - Hint: Use the clothing image as the image input and provide the human description in the text prompt or vice versa.
  • EditAnything - Hint: Use a reference fashion image as input and provide your desired changes in the text prompt.

Stable-Diffusion

  • Stable-DreamFusion - Hint: Use the Image-conditioned 3D Generation option to edit your fashion images.
  • ThreeStudio - Hint: Use different models for generating output from the image-conditioned text prompts for fashion image editing.

Image-based (2D) Virtual Try-on

CVPR 2024

  • StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On - Project, Code/Data/Model
  • CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Model - Paper, Project
  • Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On - Project/Code
  • PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns - Project/Code
  • M&M VTO: Multi-Garment Virtual Try-On and Editing - Project

AAAI 2024

  • Towards Squeezing-Averse Virtual Try-On via Sequential Deformation - Paper, Code

WACV 2024

  • Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method - Paper
  • GC-VTON: Predicting Globally Consistent and Occlusion Aware Local Flows with Neighborhood Integrity Preservation for Virtual Try-on - Paper

ICCV 2023

  • Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing - Paper, Code
  • Size Does Matter: Size-aware Virtual Try-on via Clothing-oriented Transformation Try-on Network - Paper, Code
  • Virtual Try-On with Pose-Garment Keypoints Guided Inpainting - Paper, Code

CVPR 2023

  • GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning - Paper, Code, Project
  • Linking Garment with Person via Semantically Associated Landmarks for Virtual Try-On - Paper
  • TryOnDiffusion: A Tale of Two UNets - Paper, Project

NeurIPS 2022

  • Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learning - Paper, Project

WACV 2022

ECCV 2022

  • Dress Code: High-Resolution Multi-Category Virtual Try-On - Paper, Code/Data
  • High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions - Paper, Code/Model
  • Single Stage Virtual Try-on via Deformable Attention Flows - Paper, Code/Model

CVPR 2022

  • Full-Range Virtual Try-On with Recurrent Tri-Level Transform - Paper, Project
  • Style-Based Global Appearance Flow for Virtual Try-On - Paper, Code/Model
  • Weakly Supervised High-Fidelity Clothing Model Generation - Paper, Code/Model
  • Dressing in the Wild by Watching Dance Videos - Paper, Project

CVPRW 2022

  • Dual-Branch Collaborative Transformer for Virtual Try-On - Paper
  • Dress Code: High-Resolution Multi-Category Virtual Try-On - Paper, Code/Data

ICCV 2021

  • Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing - Paper, Code, Colab
  • ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors - Paper
  • FashionMirror: Co-attention Feature-remapping Virtual Try-on with Sequential Template Poses - Paper

CVPR 2021

  • Parser-Free Virtual Try-on via Distilling Appearance Flows - Paper, Code/Data/Model
  • VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization - Paper, Code/Model
  • Disentangled Cycle Consistency for Highly-realistic Virtual Try-On - Paper, Code/Data/Model
  • Toward Accurate and Realistic Outfits Visualization with Attention to Details - Paper, Demo

ACCV 2020

  • CloTH-VTON: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON - Paper, Project

ECCV 2020

  • Do Not Mask What You Do Not Need to Mask: a Parser Free Virtual Try-On - Paper

CVPR 2020

  • Towards Photo-Realistic Virtual Try-On by Adaptively Generating↔Preserving Image Content - Paper/Code/Data
  • Image Based Virtual Try-On Network From Unpaired Data - Paper
  • Semantically Multi-modal Image Synthesis - Paper/Code/Model

CVPRW 2020

  • CP-VTON+: Clothing Shape and Texture Preserving Image-Based Virtual Try-On - Paper/Code/Data/Model
  • 3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On - Paper/Project

ICCV 2019

  • VTNFP: An Image-Based Virtual Try-On Network With Body and Clothing Feature Preservation - Paper
  • ClothFlow: A Flow-Based Model for Clothed Person Generation - Paper

ICCVW 2019

  • UVTON: UV Mapping to Consider the 3D Structure of a Human in Image-Based Virtual Try-On Network, Paper
  • LA-VITON: A Network for Looking-Attractive Virtual Try-On - Paper
  • Robust Cloth Warping via Multi-Scale Patch Adversarial Loss for Virtual Try-On Framework - Paper
  • Powering Virtual Try-On via Auxiliary Human Segmentation Learning - Paper
  • Generating High-Resolution Fashion Model Images Wearing Custom Outfits - Paper

ECCV 2018

CVPR 2018

Others

  • CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models - Paper, Code
  • IMAGDressing-v1: Customizable Virtual Dressing - Demo, code, Project
  • Magic Clothing: Controllable Garment-Driven Image Synthesis - Paper, Code
  • IDM-VTON: Improving Diffusion Models for Authentic Virtual Try-on in the Wild - Demo, Paper, Project
  • OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on - Code
  • Outfit Anyone: Ultra-high quality virtual try-on for Any Clothing and Any Person - Project
  • Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images -Paper, Data
  • FICE: Text-Conditioned Fashion Image Editing With Guided GAN Inversion - Paper, Code
  • OccluMix: Towards De-Occlusion Virtual Try-on by Semantically-Guided Mixup, TMM 2023 - Paper, Code
  • Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow, ACM Multimedia 2023 - Paper, Code
  • LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On, ACM Multimedia 2023 - Paper, Code
  • Limb-Aware Virtual Try-On Network with Progressive Clothing Warping, IEEE Multimedia 2023 - Paper
  • FashionTex: Controllable Virtual Try-on with Text and Texture, SIGGRAPH 2023 - Paper
  • DreamPaint: Few-Shot Inpainting of E-Commerce Items for Virtual Try-On without 3D Modeling - Paper
  • PG-VTON: A Novel Image-Based Virtual Try-On Method via Progressive Inference Paradigm - Paper, Code
  • Fill in Fabrics: Body-Aware Self-Supervised Inpainting for Image-Based Virtual Try-On, BMVC 2022 - Paper, Code/Model/Data
  • Probing TryOnGAN, CODS-COMAD 2022 - Paper
  • FitGAN: Fit- and Shape-Realistic Generative Adversarial Networks for Fashion - Paper
  • Spatial Transformation for Image Composition via Correspondence Learning - Paper
  • PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on - Paper
  • Significance of Skeleton-based Features in Virtual Try-On - Paper
  • You can try without visiting: a comprehensive survey on virtually try-on outfits, Multimedia Tools and Applications - Paper
  • High fidelity virtual try-on network via semantic adaptation and distributed componentization, Computational Visual Media 2022 - Paper
  • St-Vton: Self-Supervised Vision Transformer for Image-Based Virtual Try-On - Paper
  • Photo-Realistic Virtual Try-On with Enhanced Warping Module, Advances in Intelligent Systems and Computing 2022 - Paper
  • Virtual Try-On Using Augmented Reality - Paper
  • WG-VITON: Wearing-Guide Virtual Try-On for Top and Bottom Clothes - Paper
  • VTNCT: an image-based virtual try-on network by combining feature with pixel transformation, The Visual Computer 2022 - Paper
  • RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-on, IJCAI-ECAI 2022 - Paper, Code/Model/Data
  • A Flow-Based Generative Network for Photo-Realistic Virtual Try-On, IEEE Access 2022 - Paper, Code/Model/Data
  • An Efficient Style Virtual Try on Network for Clothing Business Industry - Paper
  • Cross-category Virtual Try-on Technology Research Based on PF-AFN, ICVIP 2021 - Paper
  • Virtual Try-on Network With Attribute Transformation and Local Rendering, IEEE TRANSACTIONS ON MULTIMEDIA, 2021 - Paper
  • Transform, Warp, and Dress: A New Transformation-guided Model for Virtual Try-on, ACM Trans. Multimedia Comput. Commun. Appl. 2022 - Paper
  • Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN, NeurIPS 2021. - Paper
  • Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing - Paper
  • PT-VTON: an Image-Based Virtual Try-On Network with Progressive Pose Attention Transfer - Paper
  • Data Augmentation using Random Image Cropping for High-resolution Virtual Try-On (VITON-CROP) - Paper
  • Per Garment Capture and Synthesis for Real-time Virtual Try-on, UIST 2021 - Paper, Project
  • WAS-VTON: Warping Architecture Search for Virtual Try-on Network - Paper, Code/Model
  • Shape Controllable Virtual Try-on for Underwear Models - Paper
  • Cloth Interactive Transformer for Virtual Try-On - Paper, Code/Model
  • CloTH-VTON+: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, IEEE Access 2021 - Paper, Project
  • VITON-GT: An Image-based Virtual Try-On Model with Geometric Transformations, ICPR 2020 - Paper
  • TryOnGAN: Body-Aware Try-On via Layered Interpolation, SIGGRAPH 2021 - Paper/Project
  • VOGUE: Try-On by StyleGAN Interpolation Optimization - Paper/Project
  • Deep Virtual Try-on with Clothes Transform, ICS 2018 - Paper, Code
  • NDNet: Natural Deformation Of Apparel For Better Virtual Try-On Experience, ACM SAC 2021
  • Keypoints-Based 2D Virtual Try-on Network System, JAKO 2020 - Paper
  • Virtual Try-On With Generative Adversarial Networks: A Taxonomical Survey - Book chapter
  • LGVTON: A Landmark Guided Approach to Virtual Try-On - Paper, Code
  • SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On, WACV 2020 - Paper, Code/Model (community contribution)
  • GarmentGAN: Photo-realistic Adversarial Fashion Transfer - Paper
  • Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps - Paper
  • FashionFit Analysis of Mapping 3D Pose and neural body fit for custom virtual try-on, IEEE Access 2020 - Paper
  • Inpainting-Based Virtual Try-on Network for Selective Garment Transfer, IEEE Access 2019 - Paper
  • SP-VITON: shape-preserving image-based virtual try-on network, Multimedia Tools and Applications 2019 - Paper
  • VITON-GAN: Virtual Try-on Image Generator Trained with Adversarial Loss, Eurographics 2019 Posters - Paper, Code/Model
  • Image-Based Virtual Try-on Network with Structural Coherence, ICIP 2019 - Paper
  • End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On - Paper
  • M2E-Try On Net: Fashion from Model to Everyone - Paper

3D Virtual Try-on

CVPR 2024

  • DiffAvatar Simulation-Ready Garment Optimization with Differentiable Simulation - Project, Code
  • Garment Recovery with Shape and Deformation Priors - Project/Code
  • SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction - Project, Code

CVPR 2023

  • DrapeNet: Garment Generation and Self-Supervised Draping - Code

ECCV 2022

  • 3D Clothed Human Reconstruction in the Wild - Code

NeurIPS 2022

  • ULNeF: Untangled Layered Neural Fields for Mix-and-Match Virtual Try-On - Paper, Project

WACV 2022

  • Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems - Paper

ICCV 2021

  • M3D-VTON: A Monocular-to-3D Virtual Try-On Network - Paper, Code

CVPR 2021

  • Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On - Paper, Project, Code

ECCV 2020

  • BCNet: Learning Body and Cloth Shape from A Single Image - Paper, Code/Data
  • GAN-based Garment Generation Using Sewing Pattern Images - Paper/Code/Model/Data
  • Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images - Paper/Data
  • SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothing - Paper/Code/Data
  • CLOTH3D: Clothed 3D Humans - Paper

CVPR 2020

  • Learning to Transfer Texture from Clothing Images to 3D Humans - Paper/Code
  • TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style - Paper/Code/Data
  • Learning to Dress 3D People in Generative Clothing - Paper/Code/Data

ICCV 2019

  • Multi-Garment Net: Learning to Dress 3D People from Images - Paper/Code/Data
  • 3DPeople: Modeling the Geometry of Dressed Humans - Paper
  • GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Draping - Paper/Data

ECCV 2018

  • DeepWrinkles: Accurate and Realistic Clothing Modeling - Paper

CVPR 2018

Others

  • DM-VTON: Distilled Mobile Real-time Virtual Try-On, ISMAR 2023 - Paper, Code
  • Three stages of 3D virtual try-on network with appearance flow and shape field, The Visual Computer 2023 - Paper
  • Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems, 2021 - Paper
  • REALISTIC MONOCULAR-TO-3D VIRTUAL TRY-ON VIA MULTI-SCALE CHARACTERISTICS CAPTURE, ICASSP 2022 - Paper
  • Point-Based Modeling of Human Clothing - Paper
  • CloTH-VTON+: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, IEEE Access 2021 - Paper, Project
  • Physically Based Neural Simulator for Garment Animation - Paper
  • GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss, IEEE T-PAMI, 2020 - Paper
  • DeepCloth: Neural Garment Representation for Shape and Style Editing - Paper
  • CloTH-VTON: Clothing Three-dimensional reconstruction for Hybrid image-based Virtual Try-ON, ACCV 2020 - Paper, Project
  • Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On, ACM SCA 2020 - Paper/Project
  • DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation - Paper
  • 3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On, CVPRW 2020 - Paper/Project
  • Learning-Based Animation of Clothing for Virtual Try-On, Eurographics 2019 - Paper/Project, Code
  • Learning an Intrinsic Garment Space for Interactive Authoring of Garment Animation, SIGGRAPH Asia 2019 - Paper/Code
  • 3D Virtual Garment Modeling from RGB Images, ISMAR 2019 - Paper
  • Deep Garment Image Matting for a Virtual Try-on System, ICCVW 2019 - Paper
  • Learning a Shared Shape Space for Multimodal Garment Design, SIGGRAPH Asia 2018 - Paper/Code/Data
  • Detailed Garment Recovery from a Single-View Image, ACM TOG 2018 - Paper
  • ClothCap: Seamless 4D Clothing Capture and Retargeting, SIGGRAPH 2017 - Paper
  • Virtual Try-On through Image-Based Rendering, IEEE T-VCG 2013 - Paper
  • Markerless Garment Capture, ACM TOG 2008 - Paper/Data

Mix-and-match Virtual Try-on

  • Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method, WACV 2024 -Paper
  • Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing, ICCV 2021 -Paper, Code, Colab
  • Toward Accurate and Realistic Outfits Visualization with Attention to Details, CVPR 2021 -Paper
  • Image Based Virtual Try-on Network from Unpaired Data, CVPR 2020 - Paper, Code

In-the-wild Virtual Try-on

  • Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images -Paper, Data
  • Dressing in the Wild by Watching Dance Videos, CVPR 2022 - Paper, Project

Multi-Pose Guided Virtual Try-on

  • CF-VTON: Multi-Pose Virtual Try-on with Cross-Domain Fusion, ICASSP 2023 - Paper
  • Multiple Pose Virtual Try-On Based on 3D Clothing Reconstruction, IEEE Access 2021 - Paper
  • SPG-VTON: Semantic Prediction Guidance for Multi-pose Virtual Try-on - Paper
  • Down to the Last Detail: Virtual Try-on with Fine-grained Details, ACM MM 2020 - Paper, Code/Model, ArXiv
  • Towards Multi-pose Guided Virtual Try-on Network, ICCV 2019 - Paper, Code
  • FIT-ME: IMAGE-BASED VIRTUAL TRY-ON WITH ARBITRARY POSES, ICIP 2019 - Paper
  • Virtually Trying on New Clothing with Arbitrary Poses, ACM MM 2019 - Paper
  • FashionOn: Semantic-guided Image-based Virtual Try-on with Detailed Human and Clothing Information, ACM MM 2019 - Paper

Video Virtual Try-on

  • ClothFormer: Taming Video Virtual Try-on in All Module, CVPR 2022 - Paper, Code, Project
  • MV-TON: Memory-based Video Virtual Try-on network, ACM MM 2021 - Paper
  • ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on, WACV 2021 Workshop - Project/Paper/Code
  • FW-GAN: Flow-Navigated Warping GAN for Video Virtual Try-On, ICCV 2019 - Paper
  • Unsupervised Image-to-Video Clothing Transfer, ICCVW 2019 - Paper
  • Garment Replacement in Monocular Video Sequences, ACM TOG 2014 - Paper

Video-to-Image Virtual Try-on

  • DPV-VTON : Detail-Preserving Video-based Virtual Try-On, ICMIP 2023 - Paper

Non-clothing Virtual Try-on

  • Real-time Virtual-Try-On from a Single Example Image through Deep Inverse Graphics and Learned Differentiable Renderers, EUROGRAPHICS 2022 - Paper
  • ARShoe: Real-Time Augmented Reality Shoe Try-on System on Smartphones, ACM Multimedia 2021 - Paper
  • Deep Graphics Encoder for Real-Time Video Makeup Synthesis from Example, CVPRW 2021 - Paper
  • FITTINTM - Online 3D Shoe Try-on, 3DBODY.TECH 2020 - Paper
  • CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer - Paper
  • Regularized Adversarial Training for Single-Shot Virtual Try-On, ICCVW 2019 - Paper
  • Disentangled Makeup Transfer with Generative Adversarial Network - Paper
  • PIVTONS: Pose Invariant Virtual Try-On Shoe with Conditional Image Completion, ACCV 2018 - Paper
  • Virtual Try-on of Eyeglasses using 3D Model of the Head - Paper
  • A MIXED REALITY SYSTEM FOR VIRTUAL GLASSES TRY-ON - Paper
  • A virtual try-on system in augmented reality using RGB-D cameras for footwear personalization - Paper

Pose-Guided Human Synthesis

  • Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis, CVPR 2024 - Code
  • IMAGPose: A Unified Conditional Framework for Pose-Guided Person Generation, NeurIPS 2024 - Paper, Project
  • Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models, ICLR 2024 - Paper, Project
  • Cross Attention Based Style Distribution for Controllable Person Image Synthesis, ECCV 2022 - Paper
  • InsetGAN for Full-Body Image Generation, CVPR 2022. - Paper, Project
  • Dressing in the Wild by Watching Dance Videos, CVPR 2022 - Paper, Project
  • Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN, SIGGRAPH Asia 2021 - Paper, Project
  • PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer, IEEE T-IP 2020 - Paper
  • Pose-Guided High-Resolution Appearance Transfer via Progressive Training - Paper
  • Recapture as You Want - Paper
  • Generating Person Images with Appearance-aware Pose Stylizer, IJCAI 2020 - Paper, Code
  • Controllable Person Image Synthesis with Attribute-Decomposed GAN, CVPR 2020 - Paper, Code
  • Deep Image Spatial Transformation for Person Image Generation, CVPR 2020 - Paper, Code
  • Neural Pose Transfer by Spatially Adaptive Instance Normalization, CVPR 2020 - Paper, Code
  • Guided Image-to-Image Translation with Bi-Directional Feature Transformation, ICCV 2019 - Paper, Code
  • Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis, ICCV 2019 - Paper, Code
  • ClothFlow: A Flow-Based Model for Clothed Person Generation, ICCV 2019 - Paper
  • Progressive Pose Attention for Person Image Generation, CVPR 2019 - Paper, Code
  • Dense Intrinsic Appearance Flow for Human Pose Transfer, CVPR 2019 - Paper, Code
  • Unsupervised Person Image Generation with Semantic Parsing Transformation, CVPR 2019, TPAMI 2020 - Paper, Code
  • Pose Guided Fashion Image Synthesis Using Deep Generative Model - Paper
  • Synthesizing Images of Humans in Unseen Poses, CVPR 2018 - Paper, Code
  • Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis, NeurIPS 2018 - Paper
  • Deformable GANs for Pose-based Human Image Generation, CVPR 2018 - Paper
  • Pose-Normalized Image Generation for Person Re-identification, ECCV 2018 - Paper
  • Disentangled Person Image Generation, CVPR 2018 - Paper/Code/Data
  • A Variational U-Net for Conditional Appearance and Shape Generation, CVPR 2018 - Paper, Code
  • Human Appearance Transfer, CVPR 2018 - Paper
  • Pose guided person image generation, NeurIPS 2017 - Paper, Code

Datasets for Virtual Try-on

Related Conference Workshops

Demos

  • Outfit Anyone-in-the-Wild - Demo, Docs
  • Outfit Anyone - Demo, Docs
  • Looklet Dressing Room Business, Demo
  • TINT platform for virtual try-on of everything face-related (makeup, glasses, earrings, jewelry, etc.) Business, Demo.

Related Repositories

Pull requests are welcome!