SGLang is a fast serving framework for large language models and vision language models.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Drop in replacement for the OpenAI Assistants API

An Automated AI-Powered Prompt Optimization Framework

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning

AI agent with RAG+ReAct on Indian Constitution & BNS

A versatile CLI and Python wrapper for Perplexity's suite of large language models including their flagship 'Sonar' models (built on top of Meta's latest and most advanced open-source model 'Llama-3.1'). Streamline the creation of chatbots, and search the web with AI (in real-time) with ease.

Multimodal RAG based on Llama 3.2

The GroqCloud API wrapper for Delphi provides access to models from Meta, OpenAI, MistralAI and Google on Groq’s LPUs, offering chat, text generation, image analysis, audio transcription, JSON output, tool integration, and content moderation capabilities.

AI Screen Analyzer allows users to capture screenshots, analyze them using various AI providers and models, and engage in conversations about the images.

An example of integrating local LLMS using mlc-llm into an iOS app

This repository contains projects developed to showcase how to apply Generative AI and open-source LLMs in the construction industry

AI Engineering: Annotated NBs to dive into Self-Attention, In-Context Learning, RAG, Knowledge-Graphs, Fine-Tuning, Model Optimization, and many more.

ResurrectAI is an AI-driven chat application designed to bring the wisdom and knowledge of great historical personalities to life. Leveraging advanced language models and fine-tuning techniques, ResurrectAI enables users to interact with AI avatars of iconic figures, gaining access to their insights, guidance, and philosophical teaching in realtime

A Python base cli tool for tagging images with joy-caption-pre-alpha models.

Generate an optimal path on a map a la Traveling Salesman Problem to hit different landmarks in an input city using Cloudflare Workers AI (using LlaMA-3.1), LangChain (for prompt templates and comma separated list output parser), Mapbox to create a map and get information about cities and landmarks in those cities, and Folium to edit the map.

Import Clickup Docs and chat with a local llama

Codehive Genie is an AI-powered coding assistant integrated into the Codehive platform, designed to simplify coding tasks such as code generation, bug fixing, and optimization. Powered by Llama 3.1 and deployed on Vercel, it supports multiple programming languages, including Python, C, Java, JavaScript, TypeScript, and C++.