Skip to content

Commit 1973402

Browse files
committed
update README
1 parent fe8c756 commit 1973402

File tree

2 files changed

+35
-20
lines changed

2 files changed

+35
-20
lines changed

README.md

Lines changed: 20 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -12,19 +12,21 @@ License](https://img.shields.io/github/license/BirkhoffG/jax-dataloader.svg)
1212

1313
## Overview
1414

15-
`jax_dataloader` provides a high-level *pytorch-like* dataloader API for
16-
`jax`. It supports
17-
18-
- **downloading and pre-processing datasets** via [huggingface
19-
datasets](https://github.com/huggingface/datasets), [pytorch
20-
Dataset](https://pytorch.org/docs/stable/data.html#torch.utils.data.Dataset),
21-
and [tensorflow dataset](www.tensorflow.org/datasets);
22-
23-
- **iteratively loading batches** via (vanillla) [jax
24-
dataloader](https://birkhoffg.github.io/jax-dataloader/core.html#jax-dataloader),
25-
[pytorch
26-
dataloader](https://pytorch.org/docs/stable/data.html#torch.utils.data.DataLoader)
27-
and [tensorflow dataset](www.tensorflow.org/datasets).
15+
`jax_dataloader` brings *pytorch-like* dataloader API to `jax`. It
16+
supports
17+
18+
- **4 datasets to download and pre-process data**:
19+
- [jax dataset](https://birkhoffg.github.io/jax-dataloader/dataset/)
20+
- [huggingface datasets](https://github.com/huggingface/datasets)
21+
- [pytorch
22+
Dataset](https://pytorch.org/docs/stable/data.html#torch.utils.data.Dataset)
23+
- [tensorflow dataset](www.tensorflow.org/datasets)
24+
- **3 backends to iteratively load batches**:
25+
- [jax
26+
dataloader](https://birkhoffg.github.io/jax-dataloader/core.html#jax-dataloader)
27+
- [pytorch
28+
dataloader](https://pytorch.org/docs/stable/data.html#torch.utils.data.DataLoader)
29+
- [tensorflow dataset](www.tensorflow.org/datasets)
2830

2931
A minimum `jax-dataloader` example:
3032

@@ -57,9 +59,11 @@ pip install git+https://github.com/BirkhoffG/jax-dataloader.git
5759

5860
> **Note**
5961
>
60-
> We will only install `jax`-related dependencies. If you wish to use
61-
> integration of `pytorch`, huggingface `datasets`, or `tensorflow`, we
62-
> recommend manually install those dependencies.
62+
> We keep `jax-dataloader`’s dependencies minimum, which only install
63+
> `jax`-related dependencies, and `plum-dispatch` for backend
64+
> dispatching. If you wish to use integration of `pytorch`, huggingface
65+
> `datasets`, or `tensorflow`, we recommend manually install those
66+
> dependencies.
6367
>
6468
> You can also run `pip install jax-dataloader[all]` to install
6569
> everything (not recommended).

nbs/index.ipynb

Lines changed: 15 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -28,12 +28,19 @@
2828
"source": [
2929
"## Overview\n",
3030
"\n",
31-
"`jax_dataloader` provides a high-level *pytorch-like* dataloader API for `jax`. \n",
31+
"`jax_dataloader` brings *pytorch-like* dataloader API to `jax`. \n",
3232
"It supports\n",
3333
"\n",
34-
"* **downloading and pre-processing datasets** via [huggingface datasets](https://github.com/huggingface/datasets), [pytorch Dataset](https://pytorch.org/docs/stable/data.html#torch.utils.data.Dataset), and [tensorflow dataset](www.tensorflow.org/datasets);\n",
34+
"* **4 datasets to download and pre-process data**: \n",
35+
" * [jax dataset](https://birkhoffg.github.io/jax-dataloader/dataset/)\n",
36+
" * [huggingface datasets](https://github.com/huggingface/datasets) \n",
37+
" * [pytorch Dataset](https://pytorch.org/docs/stable/data.html#torch.utils.data.Dataset)\n",
38+
" * [tensorflow dataset](www.tensorflow.org/datasets)\n",
3539
"\n",
36-
"* **iteratively loading batches** via (vanillla) [jax dataloader](https://birkhoffg.github.io/jax-dataloader/core.html#jax-dataloader), [pytorch dataloader](https://pytorch.org/docs/stable/data.html#torch.utils.data.DataLoader) and [tensorflow dataset](www.tensorflow.org/datasets).\n",
40+
"* **3 backends to iteratively load batches**: \n",
41+
" * [jax dataloader](https://birkhoffg.github.io/jax-dataloader/core.html#jax-dataloader)\n",
42+
" * [pytorch dataloader](https://pytorch.org/docs/stable/data.html#torch.utils.data.DataLoader) \n",
43+
" * [tensorflow dataset](www.tensorflow.org/datasets)\n",
3744
"\n",
3845
"\n",
3946
"A minimum `jax-dataloader` example:\n",
@@ -71,7 +78,7 @@
7178
"\n",
7279
":::{.callout-note} \n",
7380
"\n",
74-
"We will only install `jax`-related dependencies. \n",
81+
"We keep `jax-dataloader`'s dependencies minimum, which only install `jax`-related dependencies, and `plum-dispatch` for backend dispatching.\n",
7582
"If you wish to use integration of `pytorch`, huggingface `datasets`, or `tensorflow`,\n",
7683
"we recommend manually install those dependencies.\n",
7784
"\n",
@@ -420,6 +427,10 @@
420427
"display_name": "python3",
421428
"language": "python",
422429
"name": "python3"
430+
},
431+
"language_info": {
432+
"name": "python",
433+
"version": "3.8.10"
423434
}
424435
},
425436
"nbformat": 4,

0 commit comments

Comments
 (0)