AI-Powered Screenshot Assistant for Linux
Transform screenshots into actionable workflows with intelligent, context-aware interfaces.
Auri is a generative desktop assistant that automatically processes screenshots as you take them. Instead of manually extracting information, Auri:
- Detects screenshots instantly using file system monitoring
- Analyzes content using AI vision (Gemini 2.0 Flash)
- Generates custom interactive UIs based on what it sees
- Enables one-click actions (add to calendar, create tasks, log expenses, etc.)
No manual file selection. No copying and pasting. Just screenshot and act.
| Type | What Auri Extracts | Available Actions |
|---|---|---|
| Event Flyers | Title, date, time, location, organizer | Add to calendar, plan journey |
| Checklists | List items, priorities, due dates | Create tasks, mark complete |
| Receipts | Merchant, total, items, category | Log expense, track spending |
| Study Notes | Topics, concepts, Q&A pairs | Generate flashcards, export |
| Destinations | Address, coordinates | Plan journey, open maps, add travel time |
| Generic | Text content, summary | Copy text, search web |
- Generative UI: Dynamic components rendered based on content type (powered by Tambo)
- Conversational Editing: Chat with AI to refine extracted data in real-time
- Journey Planning: Integrated maps with route calculation and travel time estimates
- Inline Editing: All extracted fields are editable with click-to-edit interface
- Overlay Windows: Floating, frameless windows that appear near your cursor
- Privacy-Focused: Local processing, no persistent storage of screenshots
- OS: Ubuntu 20.04+ (or other Linux distribution)
- Node.js: v18.0.0 or higher
- npm: v9.0.0 or higher
# Clone the repository
git clone https://github.com/your-org/auri.git
cd auri
# Install dependencies
npm install
# Set up environment variables
cp .env.example .env
# Edit .env and add your Gemini API keyCreate a .env file with your API keys:
# Required: Gemini API key for vision analysis
GEMINI_API_KEY=your-gemini-api-key-here
# Required: Tambo API key for generative UI
TAMBO_API_KEY=your-tambo-api-key-here
# Optional overrides
SCREENSHOT_DIR=~/Pictures/Screenshots
OVERLAY_WIDTH=360
OVERLAY_HEIGHT=420Get API keys:
- Gemini: https://ai.google.dev/
- Tambo: https://tambo.ai/
# Start development server
npm run dev
# This runs both:
# - Vite dev server (React frontend)
# - Electron main process (desktop app)The app will launch and start monitoring ~/Pictures/Screenshots/. Take a screenshot and watch Auri in action!
# Build the app
npm run build
# Package as distributable
npm run package
# Output: dist/auri-{version}-{platform}.{ext}For complete documentation, see DOCUMENTATION.md
Proprietary Software - All Rights Reserved
Copyright (c) 2026 Auri Project
This software and associated documentation files (the "Software") are proprietary and confidential. Unauthorized copying, modification, distribution, or use of this Software, via any medium, is strictly prohibited without prior written permission from the copyright holder.
The Software is provided for evaluation purposes only. Any use, reproduction, or distribution of the Software without explicit written authorization is prohibited and may result in legal action.
For licensing inquiries, please contact the project maintainers.