Highlights
- Support TIN, CSN, SSN, NonLocal
- Support FP16 training
New Features
- Support NonLocal module and provide ckpt in TSM and I3D (#41)
- Support SSN (#33, #37, #52, #55)
- Support CSN (#87)
- Support TIN (#53)
- Support HMDB51 dataset preparation (#60)
- Support encoding videos from frames (#84)
- Support FP16 training (#25)
- Enhance demo by supporting rawframe inference (#59), output video/gif (#72)
ModelZoo
- Update Slowfast modelzoo (#51)
- Update TSN, TSM video checkpoints (#50)
- Add data benchmark for TSN (#57)
- Add data benchmark for SlowOnly (#77)
- Add BSN/BMN performance results with feature extracted by our codebase (#99)
Improvements
- Polish data preparation codes (#70)
- Improve data preparation scripts (#58)
- Improve unittest coverage and minor fix (#62)
- Support PyTorch 1.6 in CI (#117)
- Support
with_offsetfor rawframe dataset (#48) - Support json annotation files (#119)
- Support
multi-classin TSMHead (#104) - Support using
val_step()to validate data for eachvalworkflow (#123) - Use
xxInit()method to gettotal_framesand maketotal_framesa required key (#90) - Add paper introduction in model readme (#140)
- Adjust the directory structure of
tools/and rename some scripts files (#142)
Bug Fixes
- Fix configs for localization test (#67)
- Fix configs of SlowOnly by fixing lr to 8 gpus (#136)
- Fix the bug in analyze_log (#54)
- Fix the bug of generating HMDB51 class index file (#69)
- Fix the bug of using
load_checkpoint()in ResNet (#93) - Fix the bug of
--work-dirwhen using slurm training script (#110) - Correct the sthv1/sthv2 rawframes filelist generate command (#71)
CosineAnnealingtypo (#47)
Highlights
- MMAction2 is released
New Features
- Support various datasets: UCF101, Kinetics-400, Something-Something V1&V2, Moments in Time, Multi-Moments in Time, THUMOS14
- Support various action recognition methods: TSN, TSM, R(2+1)D, I3D, SlowOnly, SlowFast, Non-local
- Support various action localization methods: BSN, BMN
- Colab demo for action recognition