Skip to content

Conversation

@smorad
Copy link
Owner

@smorad smorad commented Dec 2, 2025

This performs S6 cleanup and model builder improvements

  • Only implement S6 as a diagonal model, as in the Mamba paper. The full-rank version is quite slow and not really used elsewhere.
  • Pass kwargs through to RNN layers in the model builder

@smorad smorad changed the title Cleanup Cleanup S6 and Plumb kwargs into builder Dec 2, 2025
@smorad smorad merged commit d78ee06 into main Dec 2, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants