Visualize how pages on wikipedia are connected (up to 3 degrees of depth).
- install docker-compose.
- create
.env
file with the required env variables defined bellow - run the app with the following command:
docker-compose up
In the project directory, you can run:
-
Install dependencies with
npm i
oryarn install
-
Run server app with
npm start
oryarn start
Provide mysql database credentials manually:
DB_HOST = localhost
DB_PORT = 3306
DB_USER = someuser
DB_NAME = databasename
DB_PASSWORD = yourpassword
-
List of available commands:
node src/bin/cli --help
-
Start with this command. Scrapes all neighbours from given page url:
node src/bin/cli scrape --link <url>
-
Scrapes 3 degrees from given page url (breath first search):
node src/bin/cli bfs --initial <url>
-
Scrapes degrees from given url (depth first scrape):
node src/bin/cli dbs --initial <wiki-link> --degrees <num>