Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Arbitrary Matrix Shapes #4

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Commits on Sep 24, 2024

  1. [feature] WIP Support arbitrary matrix shapes

    Important Changes:
    - Change scaling of Softmax from 2**7-1 to 2**8-1
    
    Current Limitations:
    - Only works without biases
    - Only works with ReLU activation
    - FeedForward and MatMul do only work with one Tile
    Xeratec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    8f49ccf View commit details
    Browse the repository at this point in the history
  2. [hwpe] WIP Support for HWPE version

    Changes:
    - Add register for shape parameters
    
    Current Limitations:
    - Only works without biases
    - Only works with ReLU activation
    - FeedForward and MatMul do only work with one Tile
    Xeratec committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    2ca210a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    391da13 View commit details
    Browse the repository at this point in the history