Skip to content

download_and_prepare takes all RAM #5

@Dmitriuso

Description

@Dmitriuso

Hi,
Thank you very much for your great dataset, we would like to use for fine-tuning our model, but every time we run tfds.builder.download_and_prepare, even with Apache Beam option, we get the RAM overwhelmed and the job crashes. Could you provide more details how to download and prepare BIG_PATENT in order to have it ready and feed it to the model.
Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions