How to Use Web Scraping for Price Intelligence

We invite you to explore our blog for more details.

Setting Up Your Coding Environment

Before building the application, you’ll need to set up a basic Python environment. Follow these steps to get started:

1. Install Python 3 on your system.
2. Install the required dependencies by running:

python -m pip install -r requirements.txt

Obtaining API Credentials

1. Create an account at Crawlbase and log in.
2. After registration, you will receive 5,000 free requests.
3. Locate and copy your Crawling API Normal requests token.

Running the Example Scripts

Before running the examples, make sure to replace every instance of "<Normal requests token>" with your Crawling API Normal requests token.

Example Scripts

Please refer to the accompanying blog for detailed instructions and further guidance.

🛡 Disclaimer This repository is for educational purposes only. Please make sure you comply with the Terms of Service of any website you scrape. Use this responsibly and only where permitted.

---

Copyright 2025 Crawlbase