Skip to content

Rayhanga/datagundar-py

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data Gundar

Data Gundar is a Python module to scrap and process data from Gunadarma's Website without any hassle.

Installation

Install virtualenv:

pip install virtualenv

Create new virtualenv and install depedencies:

  • Windows:

    virtualenv venv
    venv\Scripts\activate
    pip install -r requirements.txt
    
  • Linux / MacOS:

    virtualenv venv &&
    . venv/bin/activate && 
    pip install -r requirements.txt

Install geckodriver

  • Windows:

    • Download latest geckodriver.exe from here.
    • Unzip and move / copy geckodriver.exe into your venv\Scripts\ folder.
  • Linux / MacOS:

    • Download latest geckodriver from here.
    • Untar and move / copy geckodriver into your /usr/bin or any other directory inside PATH.

Usage

Always use virtualenv when interacting with these modules

  • Windows:

    venv\Scripts\activate
    
  • Linux / MacOS:

    . venv/bin/activate

As a CLI

python -m datagundar

As a REST API server:

To startup the development server use:

python -m restapi

For production server use gunicorn or any other WSGI.

# Example deployment with gunicorn
gunicorn restapi:app

For more documentation on available API please refer to restapi README.md

As a python module

Please refer to datagundar README.md

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License

GNU GPLv3.0

About

Gunadarma's web scraper as a python module

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages