Skip to content

CRUD Wildberries Goods Monitor RestAPI with Django, DRF, JWT Auth, Celery[RabbitMQ], Docker-compose

Notifications You must be signed in to change notification settings

genndy007/wb_scraper

Repository files navigation

Wildberries Goods Scraper/Monitor

This software lets you to set regular scraping of goods at Wildberries Marketplace. You can add articuls of particular goods you are interested in, and then get information about cost changes in certain period of time.

Table of Contents

Installation

Download project to your computer, change to project directory, then:

End user run

# Run with sudo because of docker-compose usage
sudo ./build-n-run.sh

Build with hands

# Run with Python3, PostgreSQL and Celery[RabbitMQ]
cp .env.example .env  # fill env file with values
pip install poetry
poetry install   # --no-dev flag for no testing libs

# terminal 1
sudo rabbitmq-server   # run queue backend
# terminal 2
createdb wb_app -O postgres -U postgres   # create postgres database
# terminal 3
poetry run python ./src/manage.py runserver 0.0.0.0:8000   # django backend
# terminal 4
cd ./src
poetry run celery -A main worker -B -l INFO   # celery tasks worker 

Compose

# root privileges
docker-compose build
docker-compose up

Usage

I hope I would add Swagger interactive documentation

User authentication

Request Definition
POST /users/register/ Register a new user
POST /users/login/ Login into account
GET /users/me/ Check yourself logged in
POST /users/logout/ Log out

Cards CRUD

Request Definition
POST /cards/ Add new card
GET /cards/ Get all your cards
DELETE /cards/ Delete all cards
DELETE /cards/1/ Delete one card
GET /cards/update/ Update stats now
GET /cards/1/stats?start=2022-01-01&end=2023-01-01&interval=1 Retrieve statistics

Tests

To run all tests

# testing libs must be installed 
poetry install
poetry shell
./test.sh

Support

Check my GitHub account page for contacts. Please open an issue for support.

Contributing

Please contribute using GitHub Flow. Create a branch, add commits, and open a pull request.

About

CRUD Wildberries Goods Monitor RestAPI with Django, DRF, JWT Auth, Celery[RabbitMQ], Docker-compose

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published