Skip to content

Automated web application that discovers and analyzes trending AI tools daily using web scraping, AI/ML analysis, and modern full-stack architecture. Built with Python, FastAPI, Next.js, and deployed on cloud infrastructure with CI/CD automation.

Notifications You must be signed in to change notification settings

Ravant2005/ai-tool-tracker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

54 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸš€ AI Tool Discovery Platform

Automated SaaS platform that discovers, analyzes, and tracks trending AI tools daily

Live Demo


πŸ“Έ Screenshots

Dashboard Dashboard showing trending AI tools with real-time statistics


✨ Features

πŸ” Automated Discovery

  • Scrapes 50+ AI tools daily from GitHub Trending, Product Hunt, and Hugging Face
  • Completely autonomous - runs daily at 12:00 PM UTC via GitHub Actions
  • Intelligent filtering to identify AI/ML-specific projects

πŸ€– AI-Powered Analysis

  • Automatic summarization using Hugging Face Transformers
  • Smart categorization (NLP, Computer Vision, Audio, etc.)
  • Hype score algorithm based on stars, likes, and engagement
  • Pricing detection (Free, Freemium, Paid)

πŸ“Š Beautiful Dashboard

  • Real-time statistics and trending tools
  • Advanced filtering by category and pricing
  • Responsive design (mobile, tablet, desktop)
  • Fast, optimized performance with Next.js

⚑ Production-Ready

  • 99%+ uptime with cloud hosting
  • Automated CI/CD pipeline
  • Secure API key management
  • Error handling and logging
  • RESTful API with auto-generated documentation

πŸ› οΈ Tech Stack

Backend

Python FastAPI PostgreSQL

  • FastAPI - Modern, high-performance web framework
  • BeautifulSoup4 - HTML parsing and web scraping
  • Hugging Face Transformers - AI-powered text analysis
  • Supabase - PostgreSQL database with real-time capabilities
  • APScheduler - Task scheduling and automation

Frontend

Next.js React TypeScript Tailwind

  • Next.js 14 - React framework with App Router
  • TypeScript - Type-safe development
  • Tailwind CSS - Utility-first styling
  • Lucide React - Beautiful icon library

DevOps & Infrastructure

GitHub Actions netlify Render

  • GitHub Actions - Automated daily scraping
  • netlify - Frontend hosting with edge network
  • Render - Backend API hosting with auto-scaling
  • Git - Version control

πŸ—οΈ Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    DAILY AUTOMATION                          β”‚
β”‚  (Runs automatically every 24 hours via GitHub Actions)      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                     β”‚
                     β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   WEB SCRAPER          β”‚
        β”‚ β€’ GitHub Trending      β”‚
        β”‚ β€’ Product Hunt         β”‚
        β”‚ β€’ Hugging Face         β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                   β”‚
                   β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   AI ANALYZER          β”‚
        β”‚ β€’ Summarization        β”‚
        β”‚ β€’ Categorization       β”‚
        β”‚ β€’ Hype Score Calc      β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                   β”‚
                   β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   DATABASE             β”‚
        β”‚ PostgreSQL (Supabase)  β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                   β”‚
                   β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   FASTAPI BACKEND      β”‚
        β”‚ RESTful API            β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                   β”‚
                   β–Ό
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚   NEXT.JS FRONTEND     β”‚
        β”‚ Interactive Dashboard  β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ“Š API Endpoints

Endpoint Method Description
/api/tools GET Get all tools (with filters)
/api/tools/trending GET Get today's trending tools
/api/tools/{id} GET Get specific tool details
/api/stats GET Dashboard statistics
/api/categories GET List all categories
/api/scan/manual POST Trigger manual scan

πŸš€ Local Development

Prerequisites

  • Python 3.11+
  • Node.js 20+
  • Supabase account (free)

Backend Setup

# Clone repository
git clone https://github.com/YOUR_USERNAME/ai-tool-tracker.git
cd ai-tool-tracker/backend

# Create virtual environment
python -m venv venv
source venv/bin/activate  # Windows: venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

# Setup environment variables
cp .env.example .env
# Edit .env with your credentials

# Run server
python main.py

Backend runs on http://localhost:8000

Frontend Setup

# Navigate to frontend
cd ../frontend

# Install dependencies
npm install

# Setup environment
echo "NEXT_PUBLIC_API_URL=http://localhost:8000" > .env.local

# Run development server
npm run dev

Frontend runs on http://localhost:3000


πŸ—„οΈ Database Schema

CREATE TABLE ai_tools (
    id BIGSERIAL PRIMARY KEY,
    name TEXT NOT NULL,
    description TEXT,
    url TEXT NOT NULL,
    source TEXT NOT NULL,
    category TEXT,
    hype_score INTEGER,
    github_stars INTEGER,
    pricing TEXT,
    use_cases TEXT[],
    tags TEXT[],
    created_at TIMESTAMP DEFAULT NOW(),
    updated_at TIMESTAMP DEFAULT NOW()
);

-- Performance indexes
CREATE INDEX idx_hype_score ON ai_tools(hype_score DESC);
CREATE INDEX idx_category ON ai_tools(category);
CREATE INDEX idx_discovered_date ON ai_tools(discovered_date DESC);

πŸ”’ Environment Variables

Backend (.env)

SUPABASE_URL=your_supabase_url
SUPABASE_SERVICE_ROLE_KEY=your_supabase_service_role_key
HUGGINGFACE_API_KEY=your_hf_token  # Optional but recommended

Frontend (.env.local)

NEXT_PUBLIC_API_URL=your_backend_url

πŸ“ˆ Key Learnings & Achievements

Backend Development

βœ… Built production-ready RESTful APIs with FastAPI
βœ… Implemented ethical web scraping with rate limiting
βœ… Integrated third-party APIs (Hugging Face)
βœ… Designed normalized database schemas
βœ… Mastered async/await patterns in Python

Frontend Development

βœ… Built responsive UIs with React & Next.js 14
βœ… Implemented TypeScript for type safety
βœ… Created reusable component architecture
βœ… Optimized performance with client/server components

AI/ML Integration

βœ… Used Hugging Face Transformers for NLP tasks
βœ… Implemented custom hype score algorithm
βœ… Automated content categorization

DevOps & Deployment

βœ… Set up CI/CD with GitHub Actions
βœ… Deployed to production on Vercel + Render
βœ… Configured automated daily jobs
βœ… Managed secrets and environment variables securely


🎯 Future Enhancements

  • User authentication and favorites
  • Email notifications for new trending tools
  • Advanced search with Elasticsearch
  • Chrome extension for quick access
  • Community ratings and reviews
  • AI-powered recommendations
  • Export tools as CSV/JSON
  • Integration with more sources (Twitter, Reddit)

🀝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

πŸ‘¨β€πŸ’» Author

Ravant Vignesh


πŸ™ Acknowledgments


⭐ Show Your Support

Give a ⭐️ if this project helped you learn something new!


Built with ❀️ and lots of coffee β˜•

Live Project

```

About

Automated web application that discovers and analyzes trending AI tools daily using web scraping, AI/ML analysis, and modern full-stack architecture. Built with Python, FastAPI, Next.js, and deployed on cloud infrastructure with CI/CD automation.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published