The New Generation AI Agent Platform & Framework
Work WITH AI, not replaced by it.
A comprehensive AI Agent platform & framework with 3D avatars, interactive worlds, and extensible plugin system. Your personal AI companion that appears everywhere - phone, computer, TV - with live interactive notifications and real-time collaboration.
🌍 Cross-Platform: Windows, macOS, Linux, Server (AWS, Azure, GCP, Docker)
🔗 Connect through: Discord, WhatsApp, Telegram, Slack, Phone apps, or Web
Capabilities:
- 🤖 3D AI Avatars - See, hear, and interact naturally
- 💻 System Control - Controls computer, browser, phone
- 💰 Stock Trading - Paper & Live trading with Alpaca API
- 🔒 Security Scanner - Protect your websites
- 📞 Call Center - Automated customer calls
- 🎨 No Code UI - Send JSON, get beautiful interfaces
- 🧠 Any LLM - Claude, GPT, or local models
- 🌐 Website Core - Use as foundation for your platform
Your AI companion sees you, hears you, and interacts naturally through 3D avatars
Professional stock & crypto trading powered by Alpaca API
Comprehensive dashboard for managing agents, tasks, and integrations
Choose from Ready Player Me, Mixamo, or upload custom 3D characters
- 👥 Your AI Companion Everywhere - Mobile, desktop, TV - your AI friend appears wherever you need with live interactive notifications
- 🤖 AI-Powered 3D Avatars - Fully animated characters that see you, hear you, and interact naturally
- 🧠 Personality & Memory - Agents remember conversations and learn from experience
- 🤝 For Everyone - Built for both non-developers AND developers
- 💰 100% FREE - Completely free and open source
- 🔧 Any LLM Model - Use Claude, GPT, or run local models (Llama, Mixtral) on your computer
- 🎨 No UI Coding Needed - Send JSON, get beautiful UI - auto-renders without designing pages
- 📊 Stock & Crypto Trading - Professional trading platform with Alpaca API (Paper & Live modes)
- 🛡️ Security Scanner - WAF protection to scan and protect your websites
- 📞 Call Center - AI agents can call customers automatically
- 🔍 SEO Agent - Built-in SEO tools for website optimization
- 🌍 Interactive 3D Worlds - Build educational environments and explorable spaces with physics
- 🔌 Unlimited Extensions - Expandable plugin system - add only what you need
- 🎮 Full System Control - Controls computer, browser, phone + writes code + accomplishes tasks
- 💬 Multi-Channel - Connect through Discord, WhatsApp, Telegram, Slack, Phone apps
- 🌐 Website Core - Use as the foundation for your website or services - fully customizable
- And much more...
Agent Player is not just another AI tool - it's the next-generation agent platform that changes everything:
1. For Everyone, Not Just Developers
- Non-developers: Use ready UI, no coding required
- Developers: Extend with JavaScript, full API access
2. True AI Companion
- Not a chatbot - a living presence with 3D avatar
- Appears everywhere: phone, computer, TV
- Has personality and remembers everything
3. Revolutionary UI System
- Send JSON → Get beautiful UI instantly
- No HTML/CSS/React coding needed
- 54+ components ready to use
4. 100% FREE Forever
- No subscriptions, no limits
- No hidden costs
- Completely open source
5. Privacy & Control
- Run locally on your computer
- Use any LLM (cloud or local)
- You own your data
6. Real Business Value
- Call Center automation
- Website security scanning
- SEO optimization
- Stock trading platform
This is the new generation of agent platforms - where AI truly becomes your companion and teammate.
| Feature | Traditional AI Tools | Agent Player |
|---|---|---|
| Interface | Text chat only | 3D Avatar + Voice + Chat |
| Availability | Web browser only | Mobile, Desktop, TV, Everywhere |
| Channels | Single platform | Discord, WhatsApp, Telegram, Slack, Phone |
| Personality | Generic responses | Remembers you, has personality |
| UI Building | Code React/HTML/CSS | Send JSON, auto-renders |
| System Control | None | Computer, Browser, Phone control |
| Code Writing | Limited | Writes Python, JavaScript, SQL code |
| For Non-Devs | Limited features | Full access to everything |
| Privacy | Cloud-only | Run 100% locally |
| Cost | Monthly subscription | 100% FREE forever |
| LLM Models | One vendor | Any model (Claude, GPT, local) |
| Extensions | Limited or none | 12 built-in + unlimited custom |
| Business Tools | Basic only | Call Center, Security, Trading, SEO |
| Use as Platform | Tool only | Complete website/service foundation |
| Cross-Platform | Limited | Windows, Mac, Linux, Server, Docker |
| Framework | Not a framework | Complete agent framework |
Create immersive 3D educational experiences with AI tutors that appear as interactive avatars. Students can explore virtual worlds while learning from AI agents in real-time.
Agent Player gives you a close personal AI companion that appears wherever you need:
- 📱 Mobile - Your AI friend on your phone
- 💻 Desktop - Always available on your computer
- 📺 TV/Screens - Display on any screen you want
- 🔔 Live Interactive Notifications - Real-time alerts with voice and avatar responses
Agent Player doesn't work 100% autonomously deleting or adding messages without you. Instead:
- ✅ You work WITH the AI - Enhance your capabilities
- ✅ You stay in control - AI assists, you decide
- ✅ Any LLM Model - Use Claude, GPT, or local models (Llama, Mixtral, etc.)
- ✅ Runs locally - Install and run on your own computer
Agent Player is the next-generation agent platform you need:
- Modular architecture - Add only what you need
- Extensible plugin system - Build custom features
- Multi-agent coordination - Run specialized agent teams
- Cross-platform - Works everywhere
- 📞 Call Center - AI agents call customers automatically with natural conversations
- 🛡️ Website Security - Scan and protect your websites with built-in WAF security scanner
- 🔍 SEO Optimization - Built-in SEO agent analyzes and improves your website rankings
- 📊 Stock Trading - Automate trading strategies or get AI trading advice
- 🎨 No UI Coding - Build interfaces with JSON instead of writing React/HTML
- 🔌 Extension System - Create plugins in pure JavaScript - no complex build tools
- 🤖 Multi-Agent Teams - Coordinate specialized agents for complex workflows
- 💻 Desktop Automation - Control computer with AI (testing, data entry, automation)
- 👥 AI Companion - Your personal assistant available everywhere
- 🎓 Learning Tutor - Interactive 3D educational experiences
- 📱 Smart Notifications - Live, interactive alerts with voice and avatar
- 🌍 Virtual Worlds - Explore and create 3D environments
- 💰 100% FREE - No subscriptions, no hidden costs
- 🔒 Privacy First - Run completely locally if you want
- 🧑💻 No Technical Skills Required - Designed for non-developers too
- 🌐 Open Source - Fully transparent, modify as you wish
Download the installer for your platform:
Windows:
# Download: agent-player-installer-1.3.0-win-x64.msi (90 MB)
# Right-click → Run as Administrator
# Follow 8-step wizard → Done!Linux:
# Download: agent-player-installer-1.3.0-linux-x86_64.AppImage (95 MB)
wget https://github.com/Agent-Player/Agent-Player/releases/download/v1.3.0/agent-player-installer-1.3.0-linux-x86_64.AppImage
chmod +x agent-player-installer-1.3.0-linux-x86_64.AppImage
./agent-player-installer-1.3.0-linux-x86_64.AppImagemacOS:
# Download: agent-player-installer-1.3.0-macos-universal.dmg (92 MB)
# Open DMG → Drag to Applications → RunWhat You Get:
- ✅ System tray application - Start/Stop/Restart with one click
- ✅ Auto-updater - Always stay up to date
- ✅ Three deployment modes: Docker, Direct (localhost), or Server (remote)
- ✅ Automatic service management - No manual terminal commands
- ✅ Professional uninstaller - Clean removal with data cleanup options
- ✅ 5-10 minute installation - Everything configured automatically
After Installation:
- Open browser → http://localhost:41521
- Login with credentials you created during installation
- Start creating AI agents! 🎉
📖 Full Installation Guide: docs/INSTALLATION.md
If you want to run from source code or contribute to development:
git clone https://github.com/Agent-Player/Agent-Player.git
cd Agent-Player
pnpm install
cd packages/backend
pnpm install
cp .env.example .env
# Edit .env: add ANTHROPIC_API_KEYRun (Two Terminals):
Terminal 1 - Backend:
cd packages/backend
pnpm dev
# → http://localhost:41522Terminal 2 - Frontend:
cd Agent-Player
pnpm dev
# → http://localhost:41521📖 Developer Setup: docs/DEVELOPMENT.md
Agent Player works with any Large Language Model you choose:
- Anthropic Claude (Sonnet, Opus, Haiku) - Default, best performance
- OpenAI GPT (GPT-4, GPT-4 Turbo, GPT-3.5)
- Google Gemini (Pro, Ultra)
- Others - Any API-compatible LLM
- Llama 3 (8B, 70B) via Ollama
- Mixtral (8x7B, 8x22B) via Ollama
- Mistral (7B) via Ollama
- Any GGUF model compatible with Ollama/LM Studio
No vendor lock-in - Switch models anytime. Run 100% locally if you want complete privacy.
Agent Player features ui-web4 - a breakthrough UI system where you don't need to design or code any pages:
How it works:
- ✨ Send JSON - Just describe what you want in JSON format
- 🎯 Automatic Rendering - AI understands and renders beautiful UI instantly
- 🚀 Zero Design Work - No HTML, CSS, React code needed
- 📱 Responsive - Works perfectly on all screen sizes
Example:
{
"type": "card",
"title": "Welcome Dashboard",
"children": [
{ "type": "metric", "label": "Total Users", "value": "1,234" },
{ "type": "button", "text": "View Details" }
]
}Result: A fully styled, interactive dashboard appears instantly!
54+ Built-in Components:
- Cards, Tables, Forms, Charts
- Buttons, Inputs, Dropdowns
- Metrics, Alerts, Notifications
- And much more...
This is the new generation of agents - intelligent UI that adapts to your needs.
Agent Player isn't just a tool - it's a complete platform you can use as the foundation for:
- Customer Service Platform - AI handles customer inquiries 24/7
- Sales Dashboard - Trading, analytics, customer management
- Admin Panel - Manage everything through AI conversations
- Smart Store - AI assistant helps customers shop
- Order Management - Process orders through voice commands
- Inventory Control - AI monitors stock and alerts you
- Online Courses - 3D interactive learning environments
- Student Portals - AI tutors available anytime
- Assessment Tools - Automated testing and grading
- White-Label Platform - Rebrand as your own product
- API-First - Integrate with any service
- Multi-Tenant - Serve multiple customers
Simply customize the extensions and UI - Agent Player becomes your complete backend + frontend solution.
Agent Player is not just a platform - it's a complete framework for building AI agent applications.
1. Complete Architecture
- ✅ Backend Framework - Fastify-based API with built-in routing, middleware, database
- ✅ Frontend Framework - Next.js + React with 54+ ready components
- ✅ UI Framework - JSON-to-UI rendering system (ui-web4)
- ✅ Agent Framework - Multi-agent orchestration, memory, tools
2. Multi-Language Support
- 🐍 Python - TTS, STT, desktop control scripts
- 📜 JavaScript/TypeScript - Extensions, tools, API routes
- 🗄️ SQL - Database migrations and queries
- 🎨 JSON - Configuration and UI definitions
- 🌐 Any Language - Integrate via API endpoints
3. Built for Community
- 🌍 Open Source - MIT License, fully transparent
- 🤝 Community-Driven - Built for developers, by developers
- 📚 Well Documented - Complete guides, examples, templates
- 🔌 Extension SDK - Create and share extensions easily
3. Cross-Platform
- 🪟 Windows - Full support on Windows 10/11
- 🍎 macOS - Works perfectly on Mac
- 🐧 Linux - Compatible with Ubuntu, Debian, CentOS
- ☁️ Server - Deploy on any cloud (AWS, Azure, GCP, DigitalOcean)
- 🐳 Docker - Containerized deployment ready
4. Framework Features
- 🏗️ Modular Architecture - Use only what you need
- 🔧 Dependency Injection - Clean, testable code
- 📦 Plugin System - Extend without modifying core
- 🎨 Theming System - Customize UI completely
- 🌐 API-First - Everything accessible via REST APIs
- 🔐 Security Built-in - JWT, encryption, audit logs
What You Can Build:
1. Custom AI Agents
// Create your own agent in minutes
const myAgent = {
name: "Customer Support Bot",
tools: ["email", "database", "calendar"],
personality: "helpful and friendly",
memory: "multi-tier"
};2. Extensions & Plugins
// Build custom extensions
export default {
name: "My Extension",
routes: [...], // API endpoints
tools: [...], // AI tools
ui: {...} // JSON UI config
};3. Complete Applications
- CRM systems with AI assistants
- Trading platforms with automation
- Educational apps with 3D avatars
- Customer service platforms
- SaaS products with AI cores
4. Integration Services
- Connect to ANY external API
- Build custom channel integrations
- Create workflow automation
- Data processing pipelines
Getting Started:
docs/FRAMEWORK_GUIDE.md- Complete framework guidedocs/EXTENSION_DEVELOPMENT.md- Build extensionsdocs/API.md- API referenceextensions/README.md- Extension examples
Community:
- GitHub Discussions - Ask questions, share projects
- Extension Registry - Share your extensions
- Examples Repository - Learn from real projects
| Feature | Traditional Frameworks | Agent Player Framework |
|---|---|---|
| AI-Native | Add AI later | AI-first architecture |
| UI System | Manual coding | JSON → Auto-render |
| Multi-Agent | Single agent | Coordinate agent teams |
| Extensions | Complex setup | JavaScript only, simple |
| Backend | Choose/build | Fastify included |
| Frontend | Choose/build | Next.js included |
| Database | Setup required | SQLite ready |
| Real-time | WebSocket setup | Built-in SSE/WebSocket |
| 3D Avatars | Build from scratch | Ready to use |
| Memory System | Implement yourself | 3-tier system ready |
| Learning Curve | Weeks | Hours |
- Multi-Agent Architecture - Run multiple specialized agents simultaneously
- 19 Professional Tools - Browser automation, memory, storage, code execution, desktop control
- Full System Control:
- 💻 Computer Control - Mouse, keyboard, screenshots, file management
- 🌐 Browser Automation - Navigate websites, fill forms, extract data
- 📱 Phone Integration - Control mobile apps through integrations
- 💾 Code Writing - AI writes and executes Python, JavaScript, SQL code
- ✅ Task Completion - Autonomous task execution with verification
- Programmatic Tool Calling - 10x faster multi-step workflows with
execute_codetool - Self-Evolving Agents - Agents learn from experience and improve over time
- Multi-Tier Memory - Working, Experiential, and Factual memory layers
- Multi-Agent Memory Sharing - Agents share knowledge and learn from each other's experiences
- Memory Deduplication - Automatic detection and merging of duplicate memories
- Cost Optimization - Intelligent model routing (90% cost savings)
- 3D Avatar Viewer - Fully animated characters with lip-sync and emotions
- Ready Player Me Integration - Use any RPM avatar instantly
- Mixamo Support - Thousands of animations and characters
- Custom Avatars - Upload your own GLB/VRM files
- Special Effects - Weather, particles, lighting effects
- WebRTC Video Calls - Video calls with AI vision capabilities
- World Builder - Create and edit 3D worlds with manual building tools
- Resizable sidebar (200-600px) for better workspace control
- AI Assistant integrated in left sidebar
- Horizontally scrollable tabs for compact views
- Real-time 3D preview with physics
- Multiverse System - Tab-based world management
- My Worlds: Create, edit, and manage your personal worlds
- Explore: Discover public worlds from other users
- World Builder: Manual world creation with AI assistance (no file upload required)
- Bots: AI agents for world management
- Physics & Controls - WASD movement, jump, gravity, third-person camera
- Simplified Workflow - Create world → Opens World Builder → Build manually
Browse a collection of high-quality 3D characters. From realistic to cartoon, fantasy to sci-fi, there's a character for every purpose. Each character comes fully textured and rigged so you can use immediately in your creative projects.
Supported Character Types:
| Platform | Description | Link |
|---|---|---|
| Ready Player Me | Customizable 3D avatars with full-body tracking | readyplayer.me |
| Mixamo Characters | Adobe's collection of rigged and animated characters | mixamo.com |
How to Use:
- Create or download your character (GLB/VRM format)
- Upload to Avatar Viewer settings
- Choose animations from Mixamo library
- Start interacting with your AI agent!
Built-in stock & crypto trading platform powered by Alpaca API:
- Paper Trading - Practice with $100,000 virtual money
- Live Trading - Real money trading (requires Alpaca account + KYC)
- Assets: US Stocks (AAPL, TSLA, MSFT...) + Crypto (BTC, ETH, DOGE...)
- AI Trading Tools - Execute trades through chat commands
- Real-time Data - Live quotes, portfolio tracking, order management
- 4 Built-in Strategies - Moving Average, RSI, Breakout, AI-Powered
Quick Start:
# 1. Enable Trading extension in /dashboard/extensions
# 2. Get free Alpaca API keys at alpaca.markets
# 3. Connect account in /dashboard/trading
# 4. Start trading: "Buy 10 shares of Apple"📖 Full Documentation: docs/TRADING_EXTENSION.md
Business & Automation:
- 📞 Call Center - AI agents make automated calls to customers with natural conversations
- 🛡️ WAF Security - Scan websites for vulnerabilities, SQL injection, XSS attacks
- 🔍 SEO Tools - Analyze and optimize website SEO, keywords, meta tags automatically
- 📊 Trading - Stock & crypto trading platform with Alpaca API (Paper & Live modes)
Communication Channels:
- 💬 Discord - Connect your AI agent to Discord servers
- 📱 Telegram - Run AI bot on Telegram with full feature support
- 💼 Slack - Integrate AI into Slack workspaces
- 📲 WhatsApp - WhatsApp Business API integration for customer support
Productivity & Collaboration:
- 📧 Email Client - Multi-account email management (Gmail, Outlook, IMAP)
- 📅 Calendar - Google Calendar, iCal, CalDAV sync
- 👥 Team Management - Create teams, invite members, role-based permissions
- 🗨️ Public Chat - Multi-user chat rooms with AI agents
All extensions are:
- ✅ FREE - No additional costs
- ✅ Open Source - Modify as you need
- ✅ Easy to Install - One-click activation
- ✅ Fully Documented - Complete guides included
Want more? Create custom extensions with our SDK - only JavaScript knowledge needed!
packages/backend/ # Backend (Fastify)
├── src/api/routes/ # API endpoints
├── src/tools/ # AI tools
├── extensions/ # Plugins
└── .data/ # Local data
src/ # Frontend (Next.js)
├── app/ # Pages
└── components/ # React components
Edit packages/backend/.env:
ANTHROPIC_API_KEY=sk-ant-...
JWT_SECRET=random_secret
PORT=41522
FRONTEND_URL=http://localhost:41521- Navigate to Dashboard → Multiverse
- Go to My Worlds tab
- Click Create New World
- Enter world name and description
- Set visibility (Public/Private) and max players (default: 10, max: 100)
- Click Create → Automatically opens World Builder
- Left Sidebar Tools:
- Tools: Add objects, lights, terrain features
- Ground: Configure floor size and appearance
- Size: Adjust world dimensions
- AI: Use AI assistant to generate world elements (enter commands)
- Resize Sidebar: Drag the right edge (200-600px range)
- Scroll Tabs: Tabs scroll horizontally when sidebar is narrow
- Real-time Preview: See changes instantly in 3D viewport
- Save & Export: Save changes or export as GLB file
- Go to Explore tab in Multiverse
- Browse public worlds created by other users
- Click Join World to enter and explore
- Physics-based movement: WASD keys, Space to jump
- Mouse drag for 360° camera rotation
- docs/SETUP.md - Installation & running
- docs/EXTENSIONS.md - Build extensions
- docs/SKILLS.md - Install skills from Skill Hub
- docs/API.md - API endpoints
- docs/DATABASE.md - Database structure
- docs/AGENT_PERSONALITY.md - Agent personality system
Next.js 15, React 19, Fastify 5, SQLite, Claude Sonnet 4.5, Three.js
Want to contribute? See CONTRIBUTING.md for:
- Development setup
- How to create a branch
- How to submit pull requests
- Code style guidelines
See CHANGELOG.md for version history and recent updates.
This project was collaboratively built by:
- 9mtm - Creator & Lead Developer
- Claude Code - AI Assistant
- Google Antigravity - AI Assistant
MIT - See LICENSE for details