index.html

---
layout: default
---

  <section>
    
    <p>Twitter's <a href="https://dev.twitter.com/overview/terms/agreement-and-policy#f-be-a-good-partner-to-twitter">terms of service</a> don't allow tweet datasets to be published on the web, but they do allow tweet identifier datasets to be shared. This speaks to users rights as content creators, while also allowing researchers to share their data with others.</p>

    <p>This site is a catalog of datasets that are publicly available on the web. If you would like to turn these tweet identifier datasets back into the original JSON first download the dataset and then use the <a href="https://github.com/docnow/hydrator#readme">Hydrator</a> desktop application, or <a href="https://github.com/docnow/twarc">Twarc</a> if you are comfortable working at the command line.</p>

    <p>You can add your own datasets to the catalog by following <a href="https://github.com/DocNow/catalog/blob/master/README.md">these instructions</a>. If you'd like updates when datasets are added please subscribe to the <a href="{{ site.baseurl }}/feed.xml">RSS feed</a>. All metadata listed here is licensed <a href="https://creativecommons.org/licenses/by/4.0/">CC0</a>. You may want to refer to <a href="https://github.com/DocNow/code-of-conduct#readme">our code of conduct</a> if you have questions or concerns about the datasets we list here.</p>

  </section>

  <ul class="datasets">
    {% assign sorted_datasets = site.data.datasets | sort: 'added' | reverse %}
    {% for dataset in sorted_datasets %}
    <li class="dataset">
      <div class="title"><a href="{{ dataset.url }}">{{ dataset.title }}</a></div>
      <div class="creator">Creator: {{ dataset.creator | join: ', ' }}</div>
      <div class="tweets">Tweets: {{ dataset.tweets }}</div>
      <div class="added">Added: {{ dataset.added }}</div>
      <div class="published">Published: {{ dataset.published }}</div>
      {% if dataset.dates %}<div class="dates">Date Coverage: {{ dataset.dates | join: ', '}}</div>{% endif %}
      <div class="tags">Tags: {{ dataset.tags | join: ', '}}</div>
      <br>
      <details class="description">
        <summary>Description</summary>
        <p>{{ dataset.description | markdownify }}</p>
      </details>
    </li>
    {% endfor %}
  </ul>