SGLang is a fast serving framework for large language models and vision language models.

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

A family of lightweight multimodal models.

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Aircraft design optimization made fast through computational graph transformations (e.g., automatic differentiation). Composable analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

[CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

Famous Vision Language Models and Their Architectures

ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)

A curated list of awesome papers on Embodied AI and related research/industry-driven resources.

EVE: Encoder-Free Vision-Language Models

Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon

Awesome LLM Papers and repos on very comprehensive topics.

Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

Seamlessly integrate state-of-the-art transformer models into robotics stacks

LLaRA: Large Language and Robotics Assistant