Support layerwise quantization #1018
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
Signed-off-by: changwangss <chang1.wang@intel.com>
Signed-off-by: changwa1 <chang1.wang@intel.com>
changwangss
force-pushed
the
wangchang/layerwise
branch
from
572e37c to
5f14658
Compare
Signed-off-by: changwa1 <chang1.wang@intel.com>
Signed-off-by: changwa1 <chang1.wang@intel.com>
Signed-off-by: changwa1 <chang1.wang@intel.com>
Signed-off-by: changwa1 <chang1.wang@intel.com>
|
Hi @echarlaix, Due to some layer-wise bug fixes in INC 3.2, and with the release planned for 12.9, I’ve set the installation to point to a specific commit for now. Once INC 3.2 is officially released, I will raise a PR to update this. Let me know your thoughts! |
|
CI IPEX issue fixed by #1009 , detail has discussed with @IlyasMoutawwakil in #1027 . |
Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>
Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>
Signed-off-by: changwangss <chang1.wang@intel.com>
Signed-off-by: changwangss <chang1.wang@intel.com>
Signed-off-by: changwangss <chang1.wang@intel.com>
|
@echarlaix I improve the |
There was a problem hiding this comment.
LGTM, thanks @changwangss ! Do you know when the next release of neural-compressor is planned?
Scheduled for release on December 9th. @thuang6 |
Original plan is Dec. 9, but likely push to end of this month. |
| quantization_config.update(**{"device": "xpu"}) | ||
| quantization_config.post_init_xpu() | ||
|
|
||
| if getattr(quantization_config, "use_layer_wise", False): |
There was a problem hiding this comment.
we can check here for the neural-compressor version and disable if not supported (a warning should be added as well) so that support is ready for neural-compressor next release
There was a problem hiding this comment.
agree, improved.
Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>
Signed-off-by: changwangss <chang1.wang@intel.com>
What does this PR do?
INC support layer-wise feature, both supported cpu and xpu.
because 3.2 plan to release Dec, 9, so I limit the INC installation commit id now.
Once INC 3.2 is officially released, I will raise a PR to update this
Fixes # (issue)
Before submitting