Skip to content

gnd/archive_downloader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Archive_downloader

A node.js book downloader from Archive.org

Install

For downloading borrowed books from Archive.org you will first need:

apt-get install npm
npm install sleep
npm install request

To convert and OCR the downloaded images into a pdf with make_pdf.sh you will also need:

apt-get install imagemagick tesseract-ocr poppler-tools

Downloading a book:

  1. Install EditThisCookie for Chrome, or use something else for cookie extraction
  2. Login to archive.org
  3. Borrow a book
  4. Copy your cookies:
  • In EditThisCookie options, first set the preferred export format to 'Semicolon separated name=value pairs'
  • Click export and paste just the cookies (without comments) into the cookies = ''; in the node_dl.js
  • If you are using another way to retrieve your cookies, just put your cookies into the cookies variable in node_dl.js
  • Set other variables like ua (user-agent), pages (how many pages the book has), local_name (where to download and how to name the files)
  1. You might want to create a directory for the files, eg. books/my_book. In that case the local_name should be books/my_book/book_name
  2. Run node node_dl.js

Converting downloaded files into searchable OCR'ed pdf:

  1. Run make_pdf.sh books/my_book output_name
  2. This will convert all jp2 files in the folder books/my_book into jpg's, OCR those jpg files and output into separate pdfs and finally join all pdfs into output_name.pdf