Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement database storage instead of ZIP containers for pages and objects #1

Open
6 tasks
ivbeg opened this issue Nov 5, 2021 · 0 comments
Open
6 tasks
Assignees
Labels
enhancement New feature or request

Comments

@ivbeg
Copy link
Contributor

ivbeg commented Nov 5, 2021

An idea is to store raw pages and collected objects not as JSON/XML files but using embedded DB like SQLite.

  • Review SQLite, LevelsDB, RocksDB and other file storages.
  • Consider using SQL engine or MongoDB too.
  • Choose best storage as default
  • Consider implementing multiple db storages
  • Implement at least one db storage.
  • Linked to implementation of "update" command

Implementation should provide effective storage with builtin compression.

@ivbeg ivbeg self-assigned this Jun 24, 2022
@ivbeg ivbeg added the enhancement New feature or request label Jun 24, 2022
@ivbeg ivbeg moved this from Todo to Priority in Ruarxive public tasks list Jun 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Development

No branches or pull requests

1 participant