You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, is it possible to load an open_clip text embedding model as a backend on the triton server? Not sure how I would export the weights of the model to TRT and formulate the config. Also not sure how I orchestration would work if I used the python backend instead. If anyone has experience with this please do let me know and apologies if this discussion does not belong here (also asked in open clip repo).
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hello, is it possible to load an open_clip text embedding model as a backend on the triton server? Not sure how I would export the weights of the model to TRT and formulate the config. Also not sure how I orchestration would work if I used the python backend instead. If anyone has experience with this please do let me know and apologies if this discussion does not belong here (also asked in open clip repo).
thanks
Beta Was this translation helpful? Give feedback.
All reactions