Skip to content

Commit

Permalink
Update publications.yml
Browse files Browse the repository at this point in the history
  • Loading branch information
yufeiwang63 authored Oct 21, 2024
1 parent ea51dca commit e9620e5
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions _data/publications.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
# Find and Delete these: ’
- abs: "This paper introduces DiffTOP, which utilizes Differentiable Trajectory OPtimization as the policy representation to generate actions for deep reinforcement and imitation learning. Trajectory optimization is a powerful and widely used algorithm in control, parameterized by a cost and a dynamics function. The key to our approach is to leverage the recent progress in differentiable trajectory optimization, which enables computing the gradients of the loss with respect to the parameters of trajectory optimization. As a result, the cost and dynamics functions of trajectory optimization can be learned end-to-end. DiffTOP addresses the ``objective mismatch'' issue of prior model-based RL algorithms, as the dynamics model in DiffTOP is learned to directly maximize task performance by differentiating the policy gradient loss through the trajectory optimization process. We further benchmark DiffTOP for imitation learning on standard robotic manipulation task suites with high-dimensional sensory observations and compare our method to feed-forward policy classes as well as Energy-Based Models (EBM) and Diffusion. Across 15 model-based RL tasks and 35imitation learning tasks with high-dimensional image and point cloud inputs, DiffTOP outperforms prior state-of-the-art methods in both domains."
- title: "DiffTOP: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning"
abs: "This paper introduces DiffTOP, which utilizes Differentiable Trajectory OPtimization as the policy representation to generate actions for deep reinforcement and imitation learning. Trajectory optimization is a powerful and widely used algorithm in control, parameterized by a cost and a dynamics function. The key to our approach is to leverage the recent progress in differentiable trajectory optimization, which enables computing the gradients of the loss with respect to the parameters of trajectory optimization. As a result, the cost and dynamics functions of trajectory optimization can be learned end-to-end. DiffTOP addresses the ``objective mismatch'' issue of prior model-based RL algorithms, as the dynamics model in DiffTOP is learned to directly maximize task performance by differentiating the policy gradient loss through the trajectory optimization process. We further benchmark DiffTOP for imitation learning on standard robotic manipulation task suites with high-dimensional sensory observations and compare our method to feed-forward policy classes as well as Energy-Based Models (EBM) and Diffusion. Across 15 model-based RL tasks and 35imitation learning tasks with high-dimensional image and point cloud inputs, DiffTOP outperforms prior state-of-the-art methods in both domains."
authors: Weikang Wan*, Ziyu Wang*, Yufei Wang*, Zackory Erickson, David Held
bib: |
@inproceedings{wan2024difftop,
Expand All @@ -8,10 +9,9 @@
booktitle={Advances in neural information processing systems (NeurIPS)},
year={2024}
}
img: ../pics/Difftop2024.png
img: ../images/Difftop2024.png
pdf: https://arxiv.org/abs/2402.05421
short_id: wan2024difftop
title: "DiffTOP: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning"
venue: Advances in neural information processing systems (NeurIPS), 2024
video_embed: null
award: <award>Spotlight Presentation</award>
Expand Down

0 comments on commit e9620e5

Please sign in to comment.