Skip to content

Avaray/steamid-scraper

Repository files navigation

👾 Steam Community ID Scraper

I created it spontaneously because I needed a huge amount of valid SteamIDs for testing my another project.

I recommend not collecting or sharing the generated SteamID databases.
Use this tool for educational purposes only. As the creator of this tool, I am not responsible for its use.

This scraper is not finished yet, but it works.
The only big issue is that it saves IDs into one single file. I need to change it in first place.

How does it work?

  1. First we start with at least one valid SteamID.
  2. We get friends of this SteamID.
  3. We get friends of friends of friends.
  4. And so on, until we have enough SteamIDs.
  5. Script is also checking if profiles are public and if they exist at all.

Requirements

Usage

  1. You need to clone or download this repository.
  2. Set STEAM_API_KEY in .env file.
  3. Run bun install in root directory to install dependencies.
  4. Run bun run scrape_from_urls.ts in /scraper directory. It will create list of about 10k SteamIDs. That will be enough for the beginning. File will be saved in root directory with name ids_.json. Then rename it manually to ids.json.
  5. Run bun run index.ts and wait. By default it will do maximum 25k requests per day. You can change it in config.ts file. But keep in mind that Steam API has limit of 100k requests per day.

TODO's

  • Split database into smaller files (e.g. 10k IDs per file)
  • Make code better. Especially flow.