Skip to content

zehr0s/spiders

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

78 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Crawler

  • Reader: Takes a dictionary and returns a list with the last tag content
  • Downloader: Takes a list of images and downloads them into a file
  • Gallery: Creates a gallery of images (files or links)

TODO

  • Crawler
    • Get pages through a dictionary
    • Add option either get text or source from a tag
    • Pages menu
      • Single selection
      • Range selection
  • Downloader
    • From list
    • History
      • Continue downloading
      • Save links
    • Only new files
    • Output Levels
  • Tools
    • Gallery
      • From files
      • From links
      • Scroll
      • Grid
    • Encrypt from large names to short names
    • Human Sorting
    • Input Levels

About

Crawling the web: Url/Image Downloader; Create Local Grid/Scrollable Gallery

Resources

Stars

Watchers

Forks