Accepted by ACM CSUR.
If you find this project useful, please cite:
@article{zhong2023guided,
title={Guided Depth Map Super-resolution: A Survey}, author={Zhong, Zhiwei and Liu, Xianming and Jiang, Junjun and Zhao, Debin and Ji, Xiangyang}, journal={ACM Computing Surveys}, year={2023}, publisher={ACM New York, NY} }
-
Clone repo
git https://github.com/zhwzhong/Awesome-Guided-Depth-Map-Super-resolution.git cd Awesome-Guided-Depth-Map-Super-resolution/code -
Install dependent packages
pip install -r requirements.txt
python main.py --scale=SCALE --dataset_name='NYU' --model_name=MODEL NAME
python main.py --scale=SCALE --dataset_name='NYU' --model_name=MODEL NAME --test_only
| Type | F | P | L |
|---|---|---|---|
| Explanation | Filtering-based | Prior-based | Learning-based |
| Title | Venue | Type | Code |
|---|---|---|---|
| SGNet: Structure Guided Network via Gradient-Frequency Awareness for Depth Map Super-Resolution pdf | AAAI | L | Github |
| Title | Venue | Type | Code |
|---|---|---|---|
| Guided Depth Super-Resolution by Deep Anisotropic Diffusion pdf | CVPR | L | Github |
| Joint depth map super-resolution method via deep hybrid-cross guidance filter PDF | PR | P | -- |
| Recurrent Structure Attention Guidance for Depth Super-Resolution PDF | AAAI | L | -- |
| Structure Flow-Guided Network for Real Depth Super-Resolution PDF | AAAI | L | -- |
| Deep Attentional Guided Filtering PDF | TNNLS | L&F | Github |
| Fully Cross-Attention Transformer for Guided Depth Super-Resolution PDF | Sensors | L | -- |
| Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution PDF | ICCV | L&P | -- |
| Depth Super-Resolution from Explicit and Implicit High-Frequency Features PDF | arxiv | L | -- |
| Self-Supervised Learning for RGB-Guided Depth Enhancement by Exploiting the Dependency Between RGB and Depth PDF | TIP | L | Github |
| RGB-Guided Depth Map Recovery by Two-Stage Coarse-to-Fine Dense CRF Models pdf | TIP | P | -- |
| Learning Continuous Depth Representation via Geometric Spatial Aggregator pdf | AAAI | L | Github |
| Coarse-to-Fine Depth Super-Resolution with Adaptive RGB-D Feature Attention pdf | TMM | L | -- |
| A^2GSTran: Depth Map Super-resolution via Asymmetric Attention with Guidance Selection pdf | TCSVT | L | Github |
| Title | Venue | Type | Code |
|---|---|---|---|
| Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution pdf | ECCV | L | Github |
| PDR-Net: Progressive depth reconstruction network for color guided depth map super-resolution PDF | NC | L | -- |
| Multi-Modal Convolutional Dictionary Learning PDF | TIP | L | -- |
| Toward Unaligned Guided Thermal Super-Resolution PDF | TIP | L | GitHub |
| Joint image denoising with gradient direction and edge-preserving regularization PDF | PR | P | -- |
| Learning Graph Regularisation for Guided Super-Resolution PDF | CVPR | P | GitHub |
| Discrete Cosine Transform Network for Guided Depth Map Super-Resolution pdf | CVPR | L | Github |
| Learning Complementary Correlations for Depth Super-Resolution With Incomplete Data in Real World pdf | TNNLS | L | -- |
| Memory-augmented Deep Unfolding Network for Guided Image Super-resolution pdf | IJCV | L&P | Github |
| CODON: On orchestrating cross-domain attentions for depth super-resolution pdf | IJCV | L | Github |
| Local Attention Guided Joint Depth Upsampling pdf | VMV | L | -- |
| Depth Map Super-Resolution via Cascaded Transformers Guidance pdf | FRSIP | L | -- |
| Symmetric Uncertainty-Aware Feature Transmission for Depth Super-Resolution pdf | ACM MM | L | -- |
| Depth Map Super-Resolution via Joint Local Gradient and Nonlocal Structural Regularizations pdf | TCSVT | P | -- |
| Depth Map Recovery Based on a Unified Depth Boundary Distortion Model pdf | TIP | P | -- |
| Title | Venue | Type | Code |
|---|---|---|---|
| Deformable Kernel Network for Joint Image Filtering pdf | IJCV | L&F | Github |
| Towards Fast and Accurate Real-World Depth Super-Resolution: Benchmark Dataset and Baseline pdf | CVPR | L | Github |
| Joint Implicit Image Function for Guided Depth Super-Resolution pdf | ACMMM | L | Github |
| BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth Estimation pdf | ACMMM | L | -- |
| Deformable Enhancement and Adaptive Fusion for Depth Map Super-Resolution pdf | SPL | L | -- |
| RGB GUIDED DEPTH MAP SUPER-RESOLUTION WITH COUPLED U-NET pdf | ICME | L | -- |
| High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion pdf | TIP | L | Github |
| Learning Spatially Variant Linear Representation Models for Joint Filtering pdf | TPAMI | L | Github |
| Multimodal Deep Unfolding for Guided Image Super-Resolution pdf | TIP | L | -- |
| CU-Net+: Deep Fully Interpretable Network for Multi-Modal Image Restoration pdf | ICIP | L | -- |
| Unsharp Mask Guided Filtering pdf | TIP | F | Github |
| Deep edge map guided depth super resolution pdf | SP:IC | L | -- |
| Depth Super-Resolution by Texture-Depth Transformer pdf | ICME | L | -- |
| Frequency-Dependent Depth Map Enhancement via Iterative Depth-Guided Affine Transformation and Intensity-Guided Refinement pdf | TMM | L | Github |
| Depth Map Super-resolution Based on Dual Normal-depth Regularization and Graph Laplacian Prior pdf | TCSVT | P | -- |
| Dual Regularization Based Depth Map Super-Resolution with Graph Laplacian Prior pdf | ICME | P | -- |
| MIG-net: Multi-scale Network Alternatively Guided by Intensity and Gradient Features for Depth Map Super-resolution pdf | TMM | L | Github |
| Depth Map Super-Resolution By Multi-Direction Dictionary And Joint Regularization pdf | ICME | P | -- |
| Unpaired Depth Super-Resolution in the Wild pdf | arXiv | L | -- |
| WAFP-Net: Weighted Attention Fusion based Progressive Residual Learning for Depth Map Super-resolution pdf | TMM | L&P | Github |
| Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution pdf | CVPR | L | Github |
| Progressive Multi-scale Reconstruction for Guided Depth Map Super-Resolution via Deep Residual Gate Fusion Network pdf | CGI | L | -- |
| A Generalized Framework for Edge-preserving and Structure-preserving Image Smoothing pdf | TPAMI | Github | |
| Depth Image Super-resolution via Two-Branch Network pdf | ICCSSP | L | -- |
| Depth Map Reconstruction and Enhancement With Local and Patch Manifold Regularized Deep Depth Priors pdf | Access | P | -- |
| Single Pair Cross-Modality Super Resolution pdf | CVPR | L | Github |
| Depth map super-resolution based on edge-guided joint trilateral upsampling pdf | TVC | F | -- |
| Depth Map Super-Resolution Using Guided Deformable Convolution pdf | Access | L | -- |
| Fast, High-Quality Hierarchical Depth-Map Super-Resolution pdf | ACMMM | L&F | Github |
| Title | Venue | Type | Code |
|---|---|---|---|
| Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion pdf | TPAMI | L&P | GitHub |
| Multimodal Deep Unfolding for Guided Image Super-Resolution pdf | TIP | L&P | -- |
| Probabilistic Pixel-Adaptive Refinement Networks pdf | CVPR | L&F | Github |
| Multi-Direction Dictionary Learning Based Depth Map Super-Resolution With Autoregressive Modeling pdf | TIP | P | -- |
| Single depth map super-resolution via joint non-local and local modeling pdf | MMSP | P | -- |
| Channel Attention Based Iterative Residual Learning for Depth Map Super-Resolution pdf | CVPR | L | Github |
| Guided Deep Decoder: Unsupervised Image Pair Fusion pdf | ECCV | L | Github |
| PMBANet: Progressive Multi-Branch Aggregation Network for Scene Depth Super-Resolution pdf | TIP | L | Github |
| Depth Super-Resolution via Deep Controllable Slicing Network pdf | ACMMM | L | -- |
| Learning Factorized Weight Matrix for Joint Filtering pdf | ICML | L&F | Github |
| Deep Convolutional Grid Warping Network for Joint Depth Map Upsampling pdf | Access | L | -- |
| Guided Depth Map Super-Resolution Using Recumbent Y Network pdf | Access | L | -- |
| DAEANet: Dual auto-encoder attention network for depth map super-resolution pdf | NN | L | -- |
| Depth upsampling based on deep edge-aware learning pdf | PR | L | Github |
| Coupled Real-Synthetic Domain Adaptation for Real-World Deep Depth Enhancemen pdf | TIP | L | -- |
| Depth image super-resolution using correlation-controlled color guidance and multi-scale symmetric network pdf | PR | L | -- |
| Edge-Guided Depth Image Super-Resolution Based on KSVD pdf | Access | P | -- |
| Depth Map Enhancement by Revisiting Multi-Scale Intensity Guidance Within Coarse-to-Fine Stages pdf | TCSVT | L | Github |
| FMPN: Fusing Multiple Progressive CNNs for Depth Map Super-Resolution pdf | Access | L | -- |
| Multi-Scale Frequency Reconstruction for Guided Depth Map Super-Resolution via Deep Residual Network pdf | TCSVT | L | Github |
| Learned Dynamic Guidance for Depth Image Reconstruction pdf | TPAMI | L&P | -- |
| Color-Guided Depth Image Recovery With Adaptive Data Fidelity and Transferred Graph Laplacian Regularization pdf | TCSVT | P | -- |
| Weighted Guided Image Filtering With Steering Kerne pdf | TIP | F | Github |
| Depth image super-resolution based on joint sparse coding pdf | PRL | P | -- |
| Title | Venue | Type | Code |
|---|---|---|---|
| Perceptual Deep Depth Super-Resolution pdf | ICCV | L | GitHub |
| Spatially Variant Linear Representation Models for Joint Filtering pdf | ICCV | L | -- |
| Deep Coupled ISTA Network for Multi-Modal Image Super-Resolution pdf | TIP | L | Github |
| Pixel-Adaptive Convolutional Neural Networks pdf | CVPR | L&F | Github |
| Joint Image Filtering with Deep Convolutional Networks pdf | TPAMI | L | Github |
| Guided Super-Resolution As Pixel-to-Pixel Transformation pdf | ICCV | L | Github |
| Deep Color Guided Coarse-to-Fine Convolutional Network Cascade for Depth Image Super-Resolution pdf | TIP | L&F | -- |
| Pyramid-Structured Depth MAP Super-Resolution Based on Deep Dense-Residual Network pdf | SPL | L | -- |
| A Novel Segmentation Based Depth Map Up-Sampling pdf | TMM | P | -- |
| Simultaneous color-depth super-resolution with conditional generative adversarial networks pdf | PR | L | Github |
| Residual dense network for intensity-guided depth map enhancement pdf | BMVC | L | Github |
| RADAR: Robust Algorithm for Depth Image Super Resolution Based on FRI Theory and Multimodal Dictionary Learning pdf | TCSVT | P | -- |
| Multiscale Directional Fusion for Depth Map Super Resolution with Denoising pdf | ICASSP | L | -- |
| Multi-Direction Dictionary Learning Based Depth Map Super-Resolution with Autoregressive Modeling pdf | TMM | P | -- |
| Photometric Depth Super-Resolution pdf | TPAMI | L | Github |
| Alternately Guided Depth Super-resolution Using Weighted Least Squares and Zero-order Reverse Filtering pdf | ICASSP | P | -- |
| Depth Super-Resolution via Joint Color-Guided Internal and External Regularizations pdf | TIP | P | -- |
| Multiscale Directional Fusion for Depth Map Super Resolution with Denoising pdf | ICASSP | P | -- |
| Title | Venue | Type | Code |
|---|---|---|---|
| Joint Bilateral Filter pdf | TIP | F | GitHub |
| Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution pdf | TIP | L | Github |
| Depth Super-Resolution From RGB-D Pairs With Transform and Spatial Domain Regularization pdf | TIP | P | -- |
| Reconstruction-based Pairwise Depth Dataset for Depth Image Enhancement Using CNN pdf | ECCV | L | Github |
| Mutually Guided Image Filtering pdf | TPAMI | F | Github |
| Depth Restoration From RGB-D Data via Joint Adaptive Regularization and Thresholding on Manifolds pdf | TIP | P | -- |
| Depth Super-Resolution From RGB-D Pairs With Transform and Spatial Domain Regularization pdf | TIP | P | -- |
| Fast End-to-End Trainable Guided Filter pdf | CVPR | L&F | Github |
| Color-Guided Depth Map Super-Resolution via Joint Graph Laplacian and Gradient Consistency Regularization pdf | MMSP | P | -- |
| Single Depth Image Super-Resolution Using Convolutional Neural Networks pdf | ICASSP | L | -- |
| Fast Depth Map Super-Resolution Using Deep Neural Network pdf | ISMA | L | -- |
| Co-occurrent Structural Edge Detection for Color-Guided Depth Map Super-Resolution pdf | ICMM | P | -- |
| Depth image super-resolution algorithm based on structural features and non-local means pdf | OL | P | -- |
| Single-Shot Variational Depth Super-Resolution From Shading pdf | CVPR | L | Github |
| Joint-Feature Guided Depth Map Super-Resolution With Face Priors pdf | TYCB | L | -- |
| Explicit Edge Inconsistency Evaluation Model for Color-guided Depth Map Enhancement pdf | TCSVT | P | -- |
| Minimum spanning forest with embedded edge inconsistency measurement model for guided depth map enhancement pdf | TIP | P | -- |
| Depth image super-resolution reconstruction based on a modified joint trilateral filter pdf | ISMA | F | -- |