Skip to content

DiPierro/comm-177p-project-fda-recalls

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

COMM 177P Project FDA Recalls

A simple scraper.

Setup

Before using this project, please ensure all dependencies are installed. See the project home page for details.

After creating this project:

  • cd comm-177p-project-fda-recalls
  • pipenv install

Save and push your work

This project includes a few command-line tasks that help with the daily workflow of our course. The tasks were created using invoke, a task execution library.

Below are the most import commands:

invoke --list
Available tasks:

  code.push   Saves local work and pushes changes to GitHub
  code.save   Saves changes locally (in git)

After creating or modifying files in your text editor of choice, you should use these tasks to save your changes locally and push them to GitHub.

It's good to get in the habit of running these commands whenever you wrap up a coding session.

cd comm-177p-project-fda-recalls

# Activate the virtual environment
pipenv shell

# Save the work and push to GitHub
invoke code.save
invoke code.push

Installing Python libraries

Depending on the type of project you're working on, you may want to install additional Python packages. Below are some useful libraries for common tasks such as interacting with APIs, scraping web pages, and data analysis:

The standard workflow is:

cd comm-177p-project-fda-recalls
# Install one or libraries, e.g. requests and BeautifulSoup
pipenv install requests beautifulsoup4

Files & Directories

Below is an overview of the project structure:

├── Pipfile
├── Pipfile.lock
├── README.md
├── data
│   ├── processed (Raw data that has been transformed)
│   └── raw  (Copy of original source data)
├── lib (Re-usable Python code in .py files)
│   ├── __init__.py
│   └── utils.py
├── notebooks (Jupyter notebooks)
├── scripts (Number-prefixed data processing scripts)
│   └── 1-etl.py
└── tasks (invoke task definitions)
    ├── __init__.py
    └── code.py
        

Reference

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published