Support Paraformer ASR model exporting to OpenVINO.#1582
Open
10vliu13 wants to merge 1 commit intohuggingface:mainfrom
Open
Support Paraformer ASR model exporting to OpenVINO.#158210vliu13 wants to merge 1 commit intohuggingface:mainfrom
10vliu13 wants to merge 1 commit intohuggingface:mainfrom
Conversation
rkazants
requested changes
Jan 12, 2026
Collaborator
rkazants
left a comment
rkazants
left a comment
There was a problem hiding this comment.
you also need to implement inference part.
Please use API we have already implemented for SpeechT5 TTS model
echarlaix
reviewed
Jan 13, 2026
| super(LayerNorm, self).__init__(nout, eps=1e-12) | ||
| self.dim = dim | ||
|
|
||
| class BaseTransformerDecoder(nn.Module): |
Collaborator
There was a problem hiding this comment.
@10vliu13 we shouldn't add a modeling code in optimum-intel, we can instead add export support via export_from_model
when the model is already loaded using funasr for example. If we want to show users how to export their model, adding a script should be enough (the number of downloads for this architecture seems too low to add model loading via
TasksManager.get_model_from_task)
Author
There was a problem hiding this comment.
It seems SpeechT5 TTS model also a example to uses export_from_model. I will refers to SpeechT5 TTS model code flow and reimplement my patch. Thanks for the comment.
Author
I would like to confirm that the @rkazants want me to refer to the API in the below link to provide inference part. Thanks |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR would like to support Paraformer ASR model exporting to OpenVINO. The command to export to OpenVINO is showed in below:
cmd: optimum-cli export openvino --trust-remote-code --model funasr/paraformer-zh paraformer-zh
Please have a review and comment. Thanks