Skip to content
View mathispink's full-sized avatar
13 followers · 11 following

Achievements

Achievement: Pull Shark

Achievements

Achievement: Pull Shark

Highlights

  • Pro

Block or report mathispink

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. attention-saver attention-saver Public

    Attention Saver lets you extract entire attention matrices or row-wise statistics (e.g. entropy) from any HuggingFace causal LLM layer for ultra-long context when using flash-attention without runn…

    Python

  2. BatchEntropyRegularization BatchEntropyRegularization Public

    A Tensorflow implementation of Batch Entropy Regularization (Peer et al 2022).

    Python