🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

UnrealCV: Connecting Computer Vision to Unreal Engine

A library for differentiable nonlinear optimization

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

SAPIEN Manipulation Skill Framework, a open source GPU parallelized robotics simulator and benchmark, led by Hillbot, Inc.

[Embodied-AI-Survey-2024] Paper list and projects for Embodied AI

具身智能中文指南

Unified Reinforcement Learning Framework

[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving & Foundation Models in Autonomous System

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins

Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Google Robot, WidowX+Bridge) (CoRL 2024)

A universal summary of current robotics simulators

A curated list of awesome papers on Embodied AI and related research/industry-driven resources.

🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses

Open Platform for Embodied Agents

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"