-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support direct weight loading #3764
Conversation
…ager # Conflicts: # python/sglang/srt/openai_api/adapter.py
# Conflicts: # python/sglang/srt/managers/detokenizer_manager.py
Can you explain your PR a bit including the motivation and implementation? |
@FrankLeeeee Hi, this is one PR among the series to integrate SGLang into Verl, and is being reviewed now. After the dependent PRs are merged, the code diff shown in github will be much cleaner. |
Noted, thanks! |
You are welcome! |
After discussing with Lianmin, now I know there is no need to follow implementation requirements in e.g. 2736. Thus I spent several hours writing a new PR #3852, and this one is deprecated. |
Motivation
Just #2845
This PR supports verl megatron weights to be passed in.
Modifications
Checklist