Skip to content

Configurable and schedulable web scrapping tool. Used to extract raw article content and metadata for aggregated news feeds.

Notifications You must be signed in to change notification settings

HarryDulaney/news-feed-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

News-Feed-Scraper

This is a web crawler, scraper, and extractor used internally at SessionApi for extracting financial news articles which are subsequently aggregated on some of our web products. See

Configure what crawl and what to extract

Execute on Schedule

To schedule the crawler to run automatically. Define a cron expression in your application.yml.

About

Configurable and schedulable web scrapping tool. Used to extract raw article content and metadata for aggregated news feeds.

Topics

Resources

Stars

Watchers

Forks

Languages