Skip to content

This is a list of awesome papers about optical flow and related work.

Notifications You must be signed in to change notification settings

nihalgupta84/All_About_Optical_Flow

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

83 Commits
 
 

Repository files navigation

Awesome-Optical-Flow

This is a list of awesome articles about optical flow and related work. Click here to read in full screen.

The table of contents is on the left side of the "README.md".

Optical Flow

Supervised Models

Time Paper Repo
ECCV22 Disentangling architecture and training for optical flow Autoflow Github stars
ECCV22 FlowFormer: A Transformer Architecture for Optical Flow FlowFormer Github stars
CVPR22 Learning Optical Flow with Kernel Patch Attention
CVPR22 GMFlow: Learning Optical Flow via Global Matching gmflow Github stars
arXiv22.5 SKFlow: Learning Optical Flow with Super Kernels
CVPR22 Deep Equilibrium Optical Flow Estimation deq-flow Github stars
ICCV21 High-Resolution Optical Flow from 1D Attention and Correlation
ICCV21 Learning to Estimate Hidden Motions with Global Motion Aggregation GMA Github stars
CVPR21 Learning Optical Flow from a Few Matches SCV Github stars
TIP21 Detail Preserving Coarse-to-Fine Matching for Stereo Matching and Optical Flow
ECCV20 RAFT: Recurrent All Pairs Field Transforms for Optical Flow RAFT Github stars
CVPR20 MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Mask MaskFlownet Github stars
CVPR20 ScopeFlow: Dynamic Scene Scoping for Optical Flow ScopeFlow Github stars
TPAMI20 A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization LiteFlowNet2 Github stars
NeurIPS19 Volumetric Correspondence Networks for Optical Flow VCN Github stars
CVPR19 Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimation irr Github stars
CVPR18 PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume PWC-Net Github stars
CVPR18 LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation LiteFlowNet Github stars
CVPR17 FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks flownet2-pytorch Github stars
flownet2 Github stars
flownet2-tf Github stars
CVPR17 Optical Flow Estimation using a Spatial Pyramid Network spynet Github stars
ICCV15 FlowNet: Learning Optical Flow with Convolutional Networks FlowNetPytorch Github stars

Semi-supervised Models

Time Paper Repo
ECCV22 Semi-Supervised Learning of Optical Flow by Flow Supervisor

Data Synthesis

Time Paper Repo
ECCV22 RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videos RealFlow Github stars
CVPR21 AutoFlow: Learning a Better Training Set for Optical Flow autoflow Github stars
CVPR21 Learning Optical Flow from Still Images depthstillation Github stars
arXiv21.04 Optical Flow Dataset Synthesis from Unpaired Images

Unsupervised Models

Time Paper Repo
ECCV22 Optical Flow Training under Limited Label Budget via Active Learning optical-flow-active-learning-release Github stars
CVPR21 SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warping
CVPR21 UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning UPFlow_pytorch Github stars
TIP21 OccInpFlow: Occlusion-Inpainting Optical Flow Estimation by Unsupervised Learning depthstillation Github stars
ECCV20 What Matters in Unsupervised Optical Flow uflow GoogleResearch
CVPR20 Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimation ARFlow Github stars
CVPR20 Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo Matching
AAAI19 DDFlow: Learning Optical Flow with Unlabeled Data Distillation DDFlow Github stars
CVPR19 SelFlow: Self-Supervised Learning of Optical Flow SelFlow Github stars
CVPR19 Unsupervised Deep Epipolar Flow for Stationary or Dynamic Scenes EPIFlow Github stars
CVPR18 Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose GeoNet Github stars

Classical Methods

Time Paper Repo
IJCAI1981 An iterative image registration technique with an application to stereo vision
AI1981 Determining optical flow
IJCV1994 Performance of optical flow techniques
TPAMI10 Motion Detail Preserving Optical Flow Estimation
CVPR10 Secrets of Optical Flow Estimation and Their Principles
ICCV13 DeepFlow: Large Displacement Optical Flow with Deep Matching Project
ECCV14 Optical Flow Estimation with Channel Constancy
CVPR15 EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow epic-flow Github stars
CVPR17 S2F: Slow-To-Fast Interpolator Flow

Joint Learning

Time Paper Repo
arXiv21.11 Unifying Flow, Stereo and Depth Estimation unimatch Github stars
CVPR21 EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentation
CVPR21 Feature-Level Collaboration: Joint Unsupervised Learning of Optical Flow, Stereo Depth and Camera Motion

Classical Methods

Time Paper Repo
IJCAI1981 An iterative image registration technique with an application to stereo vision
AI1981 Determining optical flow
TPAMI10 Motion Detail Preserving Optical Flow Estimation
CVPR10 Secrets of Optical Flow Estimation and Their Principles
ICCV13 DeepFlow: Large Displacement Optical Flow with Deep Matching Project
ECCV14 Optical Flow Estimation with Channel Constancy
CVPR17 S2F: Slow-To-Fast Interpolator Flow

Special Scene

Time Paper Repo
ECCV22 Deep 360∘ Optical Flow Estimation Based on Multi-Projection Fusion
AAAI21 Optical flow estimation from a single motion-blurred image
CVPR20 Optical Flow in Dense Foggy Scenes using Semi-Supervised Learning
CVPR20 Optical Flow in the Dark Optical-Flow-in-the-Dark Github stars
ICCV19 RainFlow: Optical Flow under Rain Streaks and Rain Veiling Effect
CVPR18 Robust Optical Flow Estimation in Rainy Scenes

Special Device

Event Camera event-based_vision_resources Github stars

Time Paper Repo
ICCV21 GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learning GyroFlow Github stars

Scene Flow

Time Paper Repo
CVPR21 RAFT-3D: Scene Flow Using Rigid-Motion Embeddings
CVPR21 Just Go With the Flow: Self-Supervised Scene Flow Estimation Just-Go-with-the-Flow-Self-Supervised-Scene-Flow-Estimation Github stars
CVPR21 Learning to Segment Rigid Motions from Two Frames rigidmaskGithub stars
CVPR20 Upgrading Optical Flow to 3D Scene Flow through Optical Expansion expansion Github stars
CVPR20 Self-Supervised Monocular Scene Flow Estimation self-mono-sf Github stars

Applications

Video Frame Interpolation

Time Paper Repo
ECCV22 Improving the Perceptual Quality of 2D Animation Interpolation eisai Github stars
ECCV22 Real-Time Intermediate Flow Estimation for Video Frame Interpolation RIFE Github stars
CVPR22 VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution VideoINR Github stars
CVPR22 IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolation IFRNet Github stars
TOG21 Neural Frame Interpolation for Rendered Content
CVPR21 Deep Animation Video Interpolation in the Wild AnimeInterp Github stars
CVPR20 Softmax Splatting for Video Frame Interpolation softmax-splatting Github stars
CVPR20 Adaptive Collaboration of Flows for Video Frame Interpolation AdaCoF-pytorch Github stars
CVPR20 FeatureFlow: Robust Video Interpolation via Structure-to-Texture Generation FeatureFlow Github stars
NIPS19 Quadratic Video Interpolation
CVPR19 Depth-Aware Video Frame Interpolation DAIN Github stars
CVPR18 Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation Super-SloMo Github stars
ICCV17 Video Frame Synthesis using Deep Voxel Flow voxel-flow Github stars

Video Compression

Time Paper Repo
CVPR19 DVC: An End-to-end Deep Video Compression Framework PyTorchVideoCompression Github stars

Video Inpainting

Time Paper Repo
ECCV22 Flow-Guided Transformer for Video Inpainting FGT Github stars
CVPR22 Inertia-Guided Flow Completion and Style Fusion for Video Inpainting isvi Github stars

Video Action Recognition

Time Paper Repo
CVPR18 Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognition Optical-Flow-Guided-Feature Github stars
GCPR18 On the Integration of Optical Flow and Action Recognition

Video Object Segmentation

Time Paper Repo
ICCV17 SegFlow: Joint Learning for Video Object Segmentation and Optical Flow SegFlow Github stars

Object Tracking

Time Paper Repo
CVPR18 End-to-end Flow Correlation Tracking with Spatial-temporal Attention

Video Stabilization

Time Paper Repo
CVPR20 Learning Video Stabilization Using Optical Flow jiyang.fun
CVPR14 Spatially Smooth Optical Flow for Video Stabilization

Low Level Vision

Time Paper Repo
ICCV21 Deep Reparametrization of Multi-Frame Super-Resolution and Denoising deep-rep Github stars
CVPR21 Deep Burst Super-Resolution deep-burst-sr Github stars
CVPR20 Efficient Dynamic Scene Deblurring Using Spatially Variant Deconvolution Network With Optical Flow Guided Training
TIP20 Deep video super-resolution using HR optical flow estimation SOF-VSR Github stars

Stereo and SLAM

Time Paper Repo
3DV21 RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching RAFT-Stereo Github stars
CVPR20 VOLDOR: Visual Odometry From Log-Logistic Dense Optical Flow Residuals VOLDOR Github stars

About

This is a list of awesome papers about optical flow and related work.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published