This repository has been archived by the owner on Mar 29, 2024. It is now read-only.

Sharding / federation #9

Open

ztl8702 opened this issue Jan 30, 2018 · 1 comment

Collaborator

ztl8702 commented Jan 30, 2018

A task pool can be divided into multiple shards.

Server exchange shards. One task can only be on one server at any time. Need a resilient way to exchange stuff.

DB only stores metadata, not resource blobs. Resources are not sharded.

Collaborator Author

ztl8702 commented Feb 1, 2018

Or "hand off" some portion of the task pool to AWS Mturk and other external services

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.