Skip to content

An asynchronous Twitter scraper using Twikit to fetch tweets efficiently.

Notifications You must be signed in to change notification settings

manishch7/GraphRAG-Based-Brand-Intelligence-System-

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

67 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🐦 Graph Rag Based Brand Intelligence System

Asynchronous Twitter Scraper

This project is an asynchronous Twitter scraper that fetches tweets based on a specified brand or keyword.

The scraper utilizes Twikit to interact with Twitter's search feature and supports pagination using cursors to fetch large amounts of data efficiently.

Try it on Twikit

🚀 Key Features

  • 🔍 Fetches real-time tweets mentioning specific brands (e.g., Nike, Adidas, Under Armour)
  • 🕒 Supports asynchronous execution for non-blocking API requests
  • 📦 Stores tweets in CSV format for easy data analysis
  • 🔄 Handles rate limits gracefully using Twikit's API headers
  • Uses cursor-based pagination for continuous tweet extraction
  • 🛠️ Well-structured modular codebase for easy customization
  • Skips duplicate tweets to avoid redundant data

About

An asynchronous Twitter scraper using Twikit to fetch tweets efficiently.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •  

Languages