Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Phi-3 model #374

Merged
merged 9 commits into from
May 30, 2024
Merged

Add Phi-3 model #374

merged 9 commits into from
May 30, 2024

Commits on Apr 26, 2024

  1. Attempt to load phi-3

    @bowyern
    bowyern committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    2adab78 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. wip

    @bowyern
    bowyern committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    abb6508 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Add phi3 test and all model variants.

    @bowyern
    bowyern committed May 29, 2024
    Configuration menu
    Copy the full SHA
    6461ed0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'elixir-nx:main' into main

    @bowyern
    bowyern committed May 29, 2024
    Configuration menu
    Copy the full SHA
    2a90d97 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Format

    @jonatanklosko
    jonatanklosko committed May 30, 2024
    Configuration menu
    Copy the full SHA
    b8e8e23 View commit details
    Browse the repository at this point in the history

  2. Up

    @jonatanklosko
    jonatanklosko committed May 30, 2024
    Configuration menu
    Copy the full SHA
    f0a344b View commit details
    Browse the repository at this point in the history

  3. Split gated ffn projections for consistency with other models

    @jonatanklosko
    jonatanklosko committed May 30, 2024
    Configuration menu
    Copy the full SHA
    3a808c0 View commit details
    Browse the repository at this point in the history

  4. Up

    @jonatanklosko
    jonatanklosko committed May 30, 2024
    Configuration menu
    Copy the full SHA
    f89f96a View commit details
    Browse the repository at this point in the history

  5. Adjust scaling 

    Adjust scaling strategies
    @jonatanklosko
    jonatanklosko committed May 30, 2024
    Configuration menu
    Copy the full SHA
    08a3e47 View commit details
    Browse the repository at this point in the history