-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
349ffa8
commit 25449ef
Showing
3 changed files
with
97 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| JURISPRUDENCE_LAST_EXPORT_DATETIME = "2024-10-22 01:05:15" | ||
| JURISPRUDENCE_LAST_EXPORT_DATETIME = "2024-10-25 01:05:25" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,90 @@ | ||
| <p align="center"><img src="https://raw.githubusercontent.com/antoinejeannot/jurisprudence/artefacts/jurisprudence.svg" width=650></p> | ||
|
|
||
| [](https://huggingface.co/datasets/antoinejeannot/jurisprudence) [](https://github.com/antoinejeannot/jurisprudence) | ||
|
|
||
| # ✨ Jurisprudence, release v2024.10.25 🏛️ | ||
|
|
||
| Jurisprudence is an open-source project that automates the collection and distribution of French legal decisions. It leverages the Judilibre API provided by the Cour de Cassation to: | ||
|
|
||
| - Fetch rulings from major French courts (Cour de Cassation, Cour d'Appel, Tribunal Judiciaire) | ||
| - Process and convert the data into easily accessible formats | ||
| - Publish & version updated datasets on Hugging Face every few days. | ||
|
|
||
| It aims to democratize access to legal information, enabling researchers, legal professionals and the public to easily access and analyze French court decisions. | ||
| Whether you're conducting legal research, developing AI models, or simply interested in French jurisprudence, this project might provide a valuable, open resource for exploring the French legal landscape. | ||
|
|
||
| ## 📊 Exported Data | ||
|
|
||
| | Jurisdiction | Jurisprudences | Oldest | Latest | Tokens | JSONL (gzipped) | Parquet | | ||
| |--------------|----------------|--------|--------|--------|-----------------|---------| | ||
| | Cour d'Appel | 395,224 | 1996-03-25 | 2024-10-18 | 1,977,104,348 | [Download (1.73 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.jsonl.gz?download=true) | [Download (2.89 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_d_appel.parquet?download=true) | | ||
| | Tribunal Judiciaire | 79,721 | 2023-12-14 | 2024-10-17 | 283,788,133 | [Download (256.39 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.jsonl.gz?download=true) | [Download (425.64 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/tribunal_judiciaire.parquet?download=true) | | ||
| | Cour de Cassation | 537,065 | 1860-08-01 | 2024-10-24 | 1,107,898,877 | [Download (932.22 MB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.jsonl.gz?download=true) | [Download (1.58 GB)](https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet?download=true) | | ||
| | **Total** | **1,012,010** | **1860-08-01** | **2024-10-24** | **3,368,791,358** | **2.89 GB** | **4.88 GB** | | ||
|
|
||
| <i>Latest update date: 2024-10-25</i> | ||
|
|
||
| <i># Tokens are computed using GPT-4 tiktoken and the `text` column.</i> | ||
|
|
||
| ## 🤗 Hugging Face Dataset | ||
|
|
||
| The up-to-date jurisprudences dataset is available at: https://huggingface.co/datasets/antoinejeannot/jurisprudence in JSONL (gzipped) and parquet formats. | ||
|
|
||
| This allows you to easily fetch, query, process and index all jurisprudences in the blink of an eye! | ||
|
|
||
| ### Usage Examples | ||
| #### HuggingFace Datasets | ||
| ```python | ||
| # pip install datasets | ||
| import datasets | ||
|
|
||
| dataset = load_dataset("antoinejeannot/jurisprudence") | ||
| dataset.shape | ||
| >> {'tribunal_judiciaire': (58986, 33), | ||
| 'cour_d_appel': (378392, 33), | ||
| 'cour_de_cassation': (534258, 33)} | ||
|
|
||
| # alternatively, you can load each jurisdiction separately | ||
| cour_d_appel = load_dataset("antoinejeannot/jurisprudence", "cour_d_appel") | ||
| tribunal_judiciaire = load_dataset("antoinejeannot/jurisprudence", "tribunal_judiciaire") | ||
| cour_de_cassation = load_dataset("antoinejeannot/jurisprudence", "cour_de_cassation") | ||
| ``` | ||
|
|
||
| Leveraging datasets allows you to easily ingest data to [PyTorch](https://huggingface.co/docs/datasets/use_with_pytorch), [Tensorflow](https://huggingface.co/docs/datasets/use_with_tensorflow), [Jax](https://huggingface.co/docs/datasets/use_with_jax) etc. | ||
|
|
||
| #### BYOL: Bring Your Own Lib | ||
| For analysis, using polars, pandas or duckdb is quite common and also possible: | ||
| ```python | ||
| url = "https://huggingface.co/datasets/antoinejeannot/jurisprudence/resolve/main/cour_de_cassation.parquet" # or tribunal_judiciaire.parquet, cour_d_appel.parquet | ||
|
|
||
| # pip install polars | ||
| import polars as pl | ||
| df = pl.scan_parquet(url) | ||
|
|
||
| # pip install pandas | ||
| import pandas as pd | ||
| df = pd.read_parquet(url) | ||
|
|
||
| # pip install duckdb | ||
| import duckdb | ||
| table = duckdb.read_parquet(url) | ||
| ``` | ||
|
|
||
| ## 🪪 Citing & Authors | ||
|
|
||
| If you use this code in your research, please use the following BibTeX entry: | ||
| ```bibtex | ||
| @misc{antoinejeannot2024, | ||
| author = {Jeannot Antoine and {Cour de Cassation}}, | ||
| title = {Jurisprudence}, | ||
| year = {2024}, | ||
| howpublished = {\url{https://github.com/antoinejeannot/jurisprudence}}, | ||
| note = {Data source: API Judilibre, \url{https://www.data.gouv.fr/en/datasets/api-judilibre/}} | ||
| } | ||
| ``` | ||
|
|
||
| This project relies on the [Judilibre API par la Cour de Cassation](https://www.data.gouv.fr/en/datasets/api-judilibre/), which is made available under the Open License 2.0 (Licence Ouverte 2.0) | ||
|
|
||
| It scans the API every 3 days at midnight UTC and exports its data in various formats to Hugging Face, without any fundamental transformation but conversions. | ||
|
|
||
| <p align="center"><a href="https://www.etalab.gouv.fr/licence-ouverte-open-licence/"><img src="https://raw.githubusercontent.com/antoinejeannot/jurisprudence/artefacts/license.png" width=50 alt="license ouverte / open license"></a></p> |