Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAFT Issues #868

Open
jujipotle opened this issue Jun 25, 2024 · 2 comments
Open

RAFT Issues #868

jujipotle opened this issue Jun 25, 2024 · 2 comments

Comments

@jujipotle
Copy link

Hello,
I am trying to replicate RAFT, but am running into several issues when running ./scripts/run_raft_align.sh. I've tried both the main LMFlow branch and the LMFlow_RAFT_Dev subbranch, but both seem to be outdated. Have the authors or anyone else tried running RAFT and had it work? What branch was used to produce the results from the original RAFT paper?

@research4pan
Copy link
Contributor

Thanks for your interest in LMFlow! The latest RAFT will be integrated soon (#867). For temporary usage, you may try this script https://github.com/RLHFlow/Online-RLHF/blob/main/run_loop.sh by changing --loss_type sigmoid in line 33 to --loss_type raft first. Hope this information can be helpful 😄

@jujipotle
Copy link
Author

Thanks for the quick response! So if I want to replicate the RAFT paper, I can only do so through RLHFlow, and not LMFlow?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants