Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] A tensor parallel API for beginners #40

Merged
merged 13 commits into from
Oct 31, 2023
Merged

[WIP] A tensor parallel API for beginners #40

merged 13 commits into from
Oct 31, 2023

Commits on Oct 10, 2023

  1. make easy-mode the default

    @siddharth9820
    siddharth9820 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    bb91272 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge branch 'develop' into easy-tensor-parallelism

    @siddharth9820
    siddharth9820 authored Oct 17, 2023
    Configuration menu
    Copy the full SHA
    33caaf3 View commit details
    Browse the repository at this point in the history

  2. reformat and change Tensor_Parallel_Linear to Linear

    @siddharth9820
    siddharth9820 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    34abe16 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. add grad normalization feature

    @siddharth9820
    siddharth9820 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    9392fa7 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Merge branch 'develop' into easy-tensor-parallelism

    @siddharth9820
    siddharth9820 authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    a003277 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into easy-tensor-parallelism

    @siddharth9820
    siddharth9820 authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    270b7dc View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. correct custom forward and add grad norm

    @siddharth9820
    siddharth9820 committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    0c7111f View commit details
    Browse the repository at this point in the history

  2. bug fixes in CI and fully connected

    @siddharth9820
    siddharth9820 committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    1b1cb45 View commit details
    Browse the repository at this point in the history

  3. formatting

    @siddharth9820
    siddharth9820 committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    a911f89 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. changes for hf

    @siddharth9820
    siddharth9820 committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    79c95a5 View commit details
    Browse the repository at this point in the history

  2. add CI tests for loading checkpoints and grad norm

    @siddharth9820
    siddharth9820 committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    7409b0e View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. fix bugs in grad norm, and update CI

    @siddharth9820
    siddharth9820 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    d468565 View commit details
    Browse the repository at this point in the history

  2. check bias grads in CI as well

    @siddharth9820
    siddharth9820 committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    3618a12 View commit details
    Browse the repository at this point in the history