Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Philip's blog #32

Open
p208p2002 opened this issue Dec 19, 2023 · 0 comments
Open

Philip's blog #32

p208p2002 opened this issue Dec 19, 2023 · 0 comments
Labels
chat-template Gitalk

Comments

@p208p2002
Copy link
Owner

https://blog.philip-huang.tech/?page=chat-template

- tags: chat-template transformers LLM chat-model - date: 2023/12/19

新版本的 transformers 已經增加 tokenizer.chat_template 屬性，有了這個 chat_template ，能確保我們在使用或訓練時遵循模型的需要的模板。

許多第三方的部屬框架 (如: vllm, openllm) 也已經開始支援這個屬性，但如果沒有設置 .chat_template 則會使用 .default_chat_template ，需要特別注意。

這些框架號稱支援多種不同模型與 chat_template ，但以 chatglm3 和 vllm 舉例
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
chat-template Gitalk
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@p208p2002