mahabrain 🧠 📚

Overview

A web scrape of sacred-texts.com into an Obsidian Vault

Obsidian Vault Info

• Size: ~2.22 GB
• File Types: .md
• The vault in this repo (sacred_obsidian_vault) was scraped in March 2023 when the latest ISTA flash drive edition was 9.0.

Steps to Open in Obsidian

1. Download sacred_obsidian_vault from this repo
   • Do not run Scrapy the web-scraper script as this may be considered abuse and increase cost to run the sacred-texts website. Only download from the pre-scraped vault above.
2. Download latest Obsidian.md version here
3. Open Obsidian & choose Open folder as vault option
4. Select the recently downloaded sacred_obsidian_vault
5. Allow Obsidian to finish indexing the 120k+ files
6. 🎉 You're good to go! Enjoy exploring!

Steps Used to Run Scraper (Only Use If Necessary)

Requirements

• Python 3.7+
• Works on Linux, Windows, macOS, BSD

Install

Run code below in project root directory in pyenv or venv

pip install -r requirements.txt

Run Scrapy

Execute the following to begin scraping sacred-texts.com into sacred_obsidian_vault top-level directory:

scrapy crawl books

ℹ️ Note: This web scrape may take up to 1 hour to complete.