Skip to content
@BudEcosystem

Bud Ecosystem

Making the world a bit more intelligent every day, One fork at a time :)

 Bud Ecosystem

About Bud Ecosystem

We are an AI research company specializing in multimodal generative AI. We build tools that simplify access to AI and break down the technical and financial barriers that prevent organizations and individuals from using it.

What We Build

  • Bud AI Foundry : A control panel for your GenAI deployments, designed to maximize infrastructure performance and give you full control over every aspect, from deployment administration to compliance and security management—All in one place.

  • Bud Models : A collection of GenAI models including LLMs, SLMs, Diffusion models, Code models. Some of them deliver SOTA performances. are pre-trained/finetuned for domain specific use cases.

  • Bud Runtime : A universal, self-healing runtime supporting diverse AI architectures (LLMs, STT, OCR, etc.) across CPUs, GPUs, and HPUs. It auto-tunes deployments for performance (0.3x–4x speedups) and ensures stable, zero-config scaling.

  • Bud AI Gateway : A high-performance, multi-modal AI gateway. It offers <1 ms latency for 10K+ QPS, supports 200+ model providers, self-optimizes via feedback, and cuts costs by up to 40%.

  • Bud Sentinel : A security and compliance suite for AI systems, featuring zero-trust model governance, <10 ms guardrails, 300+ probes, and confidential computing . It ensures robust protection for models, prompts, and infrastructure.

  • Bud Scaler : Automates scaling of AI resources across clouds and hardware, optimizing for cost, uptime, and compliance. Features include SLO-aware routing, distributed KV caching, and disaggregated compute for maximum ROI.\

  • Bud Studio : A collaborative GenAI builder platform allowing users to create, share, and deploy agents, tools, and prompts. It includes enterprise-grade RBAC/SSO, OpenStack integration, and AI-in-a-Box offerings for CSPs.

  • Bud Agent & Tool Runtime : A production-scale runtime for AI agents and tools, featuring MCP orchestration (400+ MCPs), agent PaaS, and secure, scalable deployment. It enables composable agent networks with built-in guardrails and artifact sharing.

Pinned Loading

  1. bud-runtime bud-runtime Public

    Bud AI Foundry - A comprehensive inference stack for compound AI deployment, optimization and scaling. Bud Stack provides intelligent infrastructure automation, performance optimization, and seamle…

    Python 9 3

  2. bud-connect bud-connect Public

    BudConnect is a cloud service that provides compatibility checking and update synchronization for Bud inference runtimes on customer infrastructure. It acts as a central registry for validated mode…

    Python

Repositories

Showing 10 of 58 repositories
  • bud-runtime Public

    Bud AI Foundry - A comprehensive inference stack for compound AI deployment, optimization and scaling. Bud Stack provides intelligent infrastructure automation, performance optimization, and seamless model deployment across multi-cloud/multi-hardware environments.

    BudEcosystem/bud-runtime’s past year of commit activity
    Python 9 AGPL-3.0 3 30 14 Updated Dec 8, 2025
  • GPU-Virt-Bench Public

    A GPU Virtualisation benchmarking tool - For LLM like workloads, overhead evaluations and on resource isolation metrics

    BudEcosystem/GPU-Virt-Bench’s past year of commit activity
    Cuda 3 0 0 0 Updated Dec 7, 2025
  • onyx Public Forked from onyx-dot-app/onyx

    Open Source AI Platform - AI Chat with advanced features that works with every LLM

    BudEcosystem/onyx’s past year of commit activity
    Python 0 2,317 0 0 Updated Dec 5, 2025
  • vllm-plugins Public

    vLLM Plugins for additional features like decoding strategies, monitoring, models etc

    BudEcosystem/vllm-plugins’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Dec 5, 2025
  • scid Public Forked from sinanmohd/scid

    CI/CD/Stateless/Helm/Sops/ExecJobs/WatchPaths/Git/SlackIntegration

    BudEcosystem/scid’s past year of commit activity
    Go 0 1 0 0 Updated Dec 4, 2025
  • bud-connect Public

    BudConnect is a cloud service that provides compatibility checking and update synchronization for Bud inference runtimes on customer infrastructure. It acts as a central registry for validated models and engine versions.

    BudEcosystem/bud-connect’s past year of commit activity
    Python 0 Apache-2.0 0 0 1 Updated Dec 3, 2025
  • Legal-Obligations-Agents Public

    An agent that can detect legal obligations with an SLM

    BudEcosystem/Legal-Obligations-Agents’s past year of commit activity
    Python 0 0 0 0 Updated Dec 2, 2025
  • simulator Public Forked from jithinAB/BudSimulator

    Decoder only, Encoder only, Diffusion model simulation.

    BudEcosystem/simulator’s past year of commit activity
    Python 0 19 0 1 Updated Nov 28, 2025
  • opencompass Public Forked from open-compass/opencompass

    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

    BudEcosystem/opencompass’s past year of commit activity
    Python 0 Apache-2.0 699 0 0 Updated Nov 26, 2025
  • .github Public
    BudEcosystem/.github’s past year of commit activity
    0 0 0 0 Updated Nov 26, 2025

Top languages

Loading…

Most used topics

Loading…