OpenCapBench is a benchmark designed to bridge the gap between pose estimation and biomechanics. It evaluates pose estimation models under physiological constraints using consistent kinematic metrics computed via OpenSim.
- Unified evaluation benchmark for biomechanics and pose estimation.
- Integration with OpenSim for joint angle computations.
- Fine-tuning models with SynthPose, enabling dense keypoint predictions for accurate kinematic analysis.
- Tools to benchmark custom models on clinically relevant datasets.
SynthPose fine-tunes pre-trained pose estimation models using synthetic datasets to predict arbitrarily dense sets of keypoints.
SynthPose demonstrates superior performance for kinematics compare to models predicting COCO keypoints or SMPL mesh.
Here are the results on OpenCapBench:
TODO
TODO
Examples of marker predictions with SynthPose on OpenCap dataset subjects:
If you find OpenCapBench useful in your research, please cite:
@misc{gozlan2024opencapbenchbenchmarkbridgepose,
title={OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics},
author={Yoni Gozlan and Antoine Falisse and Scott Uhlrich and Anthony Gatti and Michael Black and Akshay Chaudhari},
year={2024},
eprint={2406.09788},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2406.09788},
}This project is licensed under the MIT License.