AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Vision utilities for web interaction agents 👀

Control Any Computer Using LLMs

Lightweight GPT-4 Vision processing over the Webcam

Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

Draw your projects to life

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

Convert different model APIs into the OpenAI API format out of the box.

GPT-4V in Wonderland: LMMs as Smartphone Agents

Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

The ultimate sketch to code app made using GPT4o serving 25k+ users. Choose your desired framework (React, Next, React Native, Flutter) for your app. It will instantly generate code and preview (sandbox) from a simple hand drawn sketch on paper captured from webcam

Early Alpha Release: Chat with Your Image - Leveraging GPT-4 Vision and Function Calls for AI-Powered Image Analysis and Description

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Video Voiceover with gpt-4o-mini

Monitor the performance of OpenAI's GPT-4V model over time.

This repository offers a Python framework for a retrieval-augmented generation (RAG) pipeline using text and images from MHTML documents, leveraging Azure AI and OpenAI services. It includes ingestion and enrichment flows, a RAG with Vision pipeline, and evaluation tools.

Mark web pages for use with vision-language models

Language instructions to mycobot using GPT-4V

Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2