Skip to content

Commit

Permalink
Remove trust remove code for predefined datasets
Browse files Browse the repository at this point in the history
  • Loading branch information
echarlaix committed Jun 17, 2024
1 parent a05203f commit e54b32c
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions optimum/intel/openvino/quantization.py
Original file line number Diff line number Diff line change
Expand Up @@ -757,9 +757,6 @@ def transform_fn(data_item):

dataset_metadata = PREDEFINED_SD_DATASETS[dataset_name]
datasets_kwargs = {"split": dataset_metadata["split"], "streaming": True}
if is_datasets_version(">=", "2.20.0"):
datasets_kwargs["trust_remote_code"] = True

dataset = load_dataset(dataset_name, **datasets_kwargs).shuffle(seed=self.seed)

input_names = dataset_metadata["inputs"]
Expand Down

0 comments on commit e54b32c

Please sign in to comment.