This repo attempts to establish a pattern for a public data dump. It includes 2 data explorer queries you can use to export all your public data.
Public data is defined as forum topics and posts that anonymous users can access.
First you need to define 2 queries using data explorer:
Once defined note the data explorer query ids as specified in the URL
Next, define an API key with rights to run the 2 queries.
Create a config.json specifying the domain of your discourse site, api key and data explorer query ids.
The first phase of the import is importing the site into a sqlite3 db. This intermediary db stores all the content.
Run: ruby download_topics.rb
- Start with a blank DB
- Run
ruby import_db.rb