Code

Model patcher#567

Code

Merged

echarlaix merged 41 commits intohuggingface:mainhuggingface/optimum-intel:mainfrom jiqing-feng:model_patcherjiqing-feng/optimum-intel:model_patcherCopy head branch name to clipboardMar 8, 2024

+558-14

Commits

Commits on Feb 18, 2024

• llama model patcher

  jiqing-feng

  committed
  6c09841

  Copy full SHA for 6c09841

• fix jit model

  jiqing-feng

  committed
  8749a5a

  Copy full SHA for 8749a5a

• fix jit model

  jiqing-feng

  committed
  e05557a

  Copy full SHA for e05557a

• rm autocast in model

  jiqing-feng

  committed
  151712d

  Copy full SHA for 151712d

Commits on Feb 19, 2024

• add llama model patcher

  jiqing-feng

  committed
  c81a5f8

  Copy full SHA for c81a5f8

Commits on Feb 21, 2024

• support assisted decoding and add reorder cache function

  jiqing-feng

  committed
  1782a50

  Copy full SHA for 1782a50

Commits on Feb 26, 2024

• Merge branch 'main' into model_patcher

  jiqing-feng

  authored
  c0c9f5b

  Copy full SHA for c0c9f5b

• add comment for _prepare_past_key_values

  jiqing-feng

  committed
  41bf0f5

  Copy full SHA for 41bf0f5

• Merge branch 'main' into jit

  jiqing-feng

  authored
  6509035

  Copy full SHA for 6509035

• rebase main

  jiqing-feng

  committed
  dd63ee7

  Copy full SHA for dd63ee7

• fix model_dtype

  jiqing-feng

  committed
  16706d3

  Copy full SHA for 16706d3

• rm useless comments

  jiqing-feng

  committed
  1244772

  Copy full SHA for 1244772

• merge jit branch

  jiqing-feng

  committed
  daabe80

  Copy full SHA for daabe80

• fix llama

  jiqing-feng

  committed
  4c1c636

  Copy full SHA for 4c1c636

• add comments for ipex_rope and ipex_scale_dot_product

  jiqing-feng

  committed
  b04b435

  Copy full SHA for b04b435

Commits on Feb 28, 2024

• fix comments

  jiqing-feng

  committed
  38ed051

  Copy full SHA for 38ed051

• add enable_tpp comments

  jiqing-feng

  committed
  0dbde50

  Copy full SHA for 0dbde50

• fix import

  jiqing-feng

  committed
  e5b7afd

  Copy full SHA for e5b7afd

Commits on Mar 1, 2024

• fix review aroun2

  jiqing-feng

  committed
  eb6ab6a

  Copy full SHA for eb6ab6a

• add torch.no_grad to avoid auto_kernel_selection issue

  jiqing-feng

  committed
  41ca8c4

  Copy full SHA for 41ca8c4

• use torch.no_grad in jit trace

  jiqing-feng

  committed
  7b67c1f

  Copy full SHA for 7b67c1f

• fix ipex model testing

  jiqing-feng

  committed
  f1598a9

  Copy full SHA for f1598a9

• add tests for ipex model generation with multi inputs

  jiqing-feng

  committed
  eeac729

  Copy full SHA for eeac729

• fix code style

  jiqing-feng

  committed
  5acfac8

  Copy full SHA for 5acfac8

• remove __get__(self) as _reorder_cache is static method for the class

  jiqing-feng

  committed
  fea73d3

  Copy full SHA for fea73d3

• fix reorder_cache

  jiqing-feng

  committed
  2e45bcc

  Copy full SHA for 2e45bcc

• use model_type

  jiqing-feng

  committed
  1ef2c96

  Copy full SHA for 1ef2c96

• check if reorder_cache is a static method

  jiqing-feng

  committed
  de2f468

  Copy full SHA for de2f468

• fix _reorder_cache

  jiqing-feng

  committed
  31d42a5

  Copy full SHA for 31d42a5

• Merge branch 'huggingface:main' into model_patcher

  jiqing-feng

  authored
  809542c

  Copy full SHA for 809542c

Commits on Mar 4, 2024

• fix raise import error

  jiqing-feng

  committed
  3a86c40

  Copy full SHA for 3a86c40

• test ipex patching

  jiqing-feng

  committed
  e03259c

  Copy full SHA for e03259c

Commits on Mar 6, 2024

• fix comments

  jiqing-feng

  committed
  4c3335b

  Copy full SHA for 4c3335b

• Merge branch 'huggingface:main' into model_patcher

  jiqing-feng

  authored
  b1f704a

  Copy full SHA for b1f704a

Commits on Mar 7, 2024

• Merge branch 'huggingface:main' into model_patcher

  jiqing-feng

  authored
  4e0ec0a

  Copy full SHA for 4e0ec0a

• update API name and testing

  jiqing-feng

  committed
  aa3008f

  Copy full SHA for aa3008f

• disable untill ipex version 2.5.0

  jiqing-feng

  committed
  37e8cc4

  Copy full SHA for 37e8cc4

• update testing name

  jiqing-feng

  committed
  e3a7024

  Copy full SHA for e3a7024

Commits on Mar 8, 2024

• Update optimum/intel/ipex/modeling_base.py

  Show description for 070a0dc
  

  jiqing-feng

  and

  echarlaix

  authored
  070a0dc

  Copy full SHA for 070a0dc

• Update tests/ipex/test_modeling.py

  Show description for 8c60c7a
  

  jiqing-feng

  and

  echarlaix

  authored
  8c60c7a

  Copy full SHA for 8c60c7a

• fix tests

  jiqing-feng

  committed
  f8d3f74

  Copy full SHA for f8d3f74