Skip to content

Tutel v0.1.3
Compare
Choose a tag to compare
@ghostplant ghostplant released this 29 Dec 03:29
· 52 commits to v0.1.x since this release
v0.1.3
ea17ea6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's New in v0.1.3:

  1. Add Tutel Launcher Support based on Open MPI;
  2. Support Establishing Data Model Parallel in Initialization;
  3. Support Single Expert Evenly Sharded on Multiple GPUs;
  4. Support List of Gates and Forwarding MoE Layer with Specified Gating Index;
  5. Fix NVRTC Compatibility when Enabling USE_NVRTC=1;
  6. Other Implementation Enhancements & Correctness Checking;
How to Setup:
python3 -m pip install --user https://github.com/microsoft/tutel/archive/refs/tags/v0.1.3.tar.gz

Contributors: @ghostplant, @EricWangCN, @guoshzhao.

Contributors

ghostplant, EricWangCN, and guoshzhao
Assets 2
Loading