Skip to content

Commit

Permalink
🤖 Bump v2024.10.28
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Oct 28, 2024
1 parent 25449ef commit 1e13cf3
Show file tree
Hide file tree
Showing 3 changed files with 97 additions and 7 deletions.
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

[![Dataset on HF](https://huggingface.co/datasets/huggingface/badges/resolve/main/dataset-on-hf-md-dark.svg)](https://huggingface.co/datasets/antoinejeannot/jurisprudence) [![GitHub](https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white)](https://github.com/antoinejeannot/jurisprudence)

# ✨ Jurisprudence, release v2024.10.25 🏛️
# ✨ Jurisprudence, release v2024.10.28 🏛️

Jurisprudence is an open-source project that automates the collection and distribution of French legal decisions. It leverages the Judilibre API provided by the Cour de Cassation to:

Expand All @@ -17,12 +17,12 @@ Whether you're conducting legal research, developing AI models, or simply intere

| Jurisdiction | Jurisprudences | Oldest | Latest | Tokens | JSONL (gzipped) | Parquet |
|--------------|----------------|--------|--------|--------|-----------------|---------|
| Cour d'Appel | 395,224 | 1996-03-25 | 2024-10-18 | 1,977,104,348 | [Download (1.73 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.jsonl.gz?download=true) | [Download (2.89 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.parquet?download=true) |
| Tribunal Judiciaire | 79,721 | 2023-12-14 | 2024-10-17 | 283,788,133 | [Download (256.39 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.jsonl.gz?download=true) | [Download (425.64 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.parquet?download=true) |
| Cour de Cassation | 537,065 | 1860-08-01 | 2024-10-24 | 1,107,898,877 | [Download (932.22 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.jsonl.gz?download=true) | [Download (1.58 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet?download=true) |
| **Total** | **1,012,010** | **1860-08-01** | **2024-10-24** | **3,368,791,358** | **2.89 GB** | **4.88 GB** |
| Cour d'Appel | 396,317 | 1996-03-25 | 2024-10-22 | 1,981,675,335 | [Download (1.74 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.jsonl.gz?download=true) | [Download (2.90 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.parquet?download=true) |
| Tribunal Judiciaire | 82,085 | 2023-12-14 | 2024-10-22 | 291,028,506 | [Download (263.20 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.jsonl.gz?download=true) | [Download (436.65 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.parquet?download=true) |
| Cour de Cassation | 537,252 | 1860-08-01 | 2024-10-24 | 1,107,801,271 | [Download (932.25 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.jsonl.gz?download=true) | [Download (1.58 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet?download=true) |
| **Total** | **1,015,654** | **1860-08-01** | **2024-10-24** | **3,380,505,112** | **2.90 GB** | **4.90 GB** |

<i>Latest update date: 2024-10-25</i>
<i>Latest update date: 2024-10-28</i>

<i># Tokens are computed using GPT-4 tiktoken and the `text` column.</i>

Expand Down
2 changes: 1 addition & 1 deletion jurisprudence/settings.py
Original file line number Diff line number Diff line change
@@ -1 +1 @@
JURISPRUDENCE_LAST_EXPORT_DATETIME = "2024-10-25 01:05:25"
JURISPRUDENCE_LAST_EXPORT_DATETIME = "2024-10-28 01:05:49"
90 changes: 90 additions & 0 deletions release_notes/v2024.10.28.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,90 @@
<p align="center"><img src="https://raw.githubusercontent.com/antoinejeannot/jurisprudence/artefacts/jurisprudence.svg" width=650></p>

[![Dataset on HF](https://huggingface.co/datasets/huggingface/badges/resolve/main/dataset-on-hf-md-dark.svg)](https://huggingface.co/datasets/antoinejeannot/jurisprudence) [![GitHub](https://img.shields.io/badge/github-%23121011.svg?style=for-the-badge&logo=github&logoColor=white)](https://github.com/antoinejeannot/jurisprudence)

# ✨ Jurisprudence, release v2024.10.28 🏛️

Jurisprudence is an open-source project that automates the collection and distribution of French legal decisions. It leverages the Judilibre API provided by the Cour de Cassation to:

- Fetch rulings from major French courts (Cour de Cassation, Cour d'Appel, Tribunal Judiciaire)
- Process and convert the data into easily accessible formats
- Publish & version updated datasets on Hugging Face every few days.

It aims to democratize access to legal information, enabling researchers, legal professionals and the public to easily access and analyze French court decisions.
Whether you're conducting legal research, developing AI models, or simply interested in French jurisprudence, this project might provide a valuable, open resource for exploring the French legal landscape.

## 📊 Exported Data

| Jurisdiction | Jurisprudences | Oldest | Latest | Tokens | JSONL (gzipped) | Parquet |
|--------------|----------------|--------|--------|--------|-----------------|---------|
| Cour d'Appel | 396,317 | 1996-03-25 | 2024-10-22 | 1,981,675,335 | [Download (1.74 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.jsonl.gz?download=true) | [Download (2.90 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.parquet?download=true) |
| Tribunal Judiciaire | 82,085 | 2023-12-14 | 2024-10-22 | 291,028,506 | [Download (263.20 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.jsonl.gz?download=true) | [Download (436.65 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.parquet?download=true) |
| Cour de Cassation | 537,252 | 1860-08-01 | 2024-10-24 | 1,107,801,271 | [Download (932.25 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.jsonl.gz?download=true) | [Download (1.58 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet?download=true) |
| **Total** | **1,015,654** | **1860-08-01** | **2024-10-24** | **3,380,505,112** | **2.90 GB** | **4.90 GB** |

<i>Latest update date: 2024-10-28</i>

<i># Tokens are computed using GPT-4 tiktoken and the `text` column.</i>

## 🤗 Hugging Face Dataset

The up-to-date jurisprudences dataset is available at: https://huggingface.co/datasets/antoinejeannot/jurisprudence in JSONL (gzipped) and parquet formats.

This allows you to easily fetch, query, process and index all jurisprudences in the blink of an eye!

### Usage Examples
#### HuggingFace Datasets
```python
# pip install datasets
import datasets

dataset = load_dataset("antoinejeannot/jurisprudence")
dataset.shape
>> {'tribunal_judiciaire': (58986, 33),
'cour_d_appel': (378392, 33),
'cour_de_cassation': (534258, 33)}

# alternatively, you can load each jurisdiction separately
cour_d_appel = load_dataset("antoinejeannot/jurisprudence", "cour_d_appel")
tribunal_judiciaire = load_dataset("antoinejeannot/jurisprudence", "tribunal_judiciaire")
cour_de_cassation = load_dataset("antoinejeannot/jurisprudence", "cour_de_cassation")
```

Leveraging datasets allows you to easily ingest data to [PyTorch](https://huggingface.co/docs/datasets/use_with_pytorch), [Tensorflow](https://huggingface.co/docs/datasets/use_with_tensorflow), [Jax](https://huggingface.co/docs/datasets/use_with_jax) etc.

#### BYOL: Bring Your Own Lib
For analysis, using polars, pandas or duckdb is quite common and also possible:
```python
url = "https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet" # or tribunal_judiciaire.parquet, cour_d_appel.parquet

# pip install polars
import polars as pl
df = pl.scan_parquet(url)

# pip install pandas
import pandas as pd
df = pd.read_parquet(url)

# pip install duckdb
import duckdb
table = duckdb.read_parquet(url)
```

## 🪪 Citing & Authors

If you use this code in your research, please use the following BibTeX entry:
```bibtex
@misc{antoinejeannot2024,
author = {Jeannot Antoine and {Cour de Cassation}},
title = {Jurisprudence},
year = {2024},
howpublished = {\url{https://github.com/antoinejeannot/jurisprudence}},
note = {Data source: API Judilibre, \url{https://www.data.gouv.fr/en/datasets/api-judilibre/}}
}
```

This project relies on the [Judilibre API par la Cour de Cassation](https://www.data.gouv.fr/en/datasets/api-judilibre/), which is made available under the Open License 2.0 (Licence Ouverte 2.0)

It scans the API every 3 days at midnight UTC and exports its data in various formats to Hugging Face, without any fundamental transformation but conversions.

<p align="center"><a href="https://www.etalab.gouv.fr/licence-ouverte-open-licence/"><img src="https://raw.githubusercontent.com/antoinejeannot/jurisprudence/artefacts/license.png" width=50 alt="license ouverte / open license"></a></p>

0 comments on commit 1e13cf3

Please sign in to comment.