Web-scrapper

Service for tesmanian.com

Scrapping the latest articles from tesmanian.com and auto-publishing posts to Tesmanian telegram channel.

Tech:

• Python 3.10
• requests
• Beautifulsoup4
• PostgreSQL
• Telebot
• Docker

Installation

Clone the project

git clone git@github.com:danielshtel/web-scrapper.git

⚠️ Copy env.tmpl to .env and substitute the default values with your own usernames and passwords.

Web-scrapper Docker:

Make sure you set environment variables in .env

cd web-scrapper

To run services (with logs):

docker-compose up

To stop services:

docker-compose down

If you want to remove all your data, use:

docker volume prune

How it works? 🤔

Welcome to my demo telegram channel Tesmanian to see how it works! 🎇
Subscribe and read actual news!