Skip to content

Commit

Permalink
project management
Browse files Browse the repository at this point in the history
  • Loading branch information
lucidrains authored Jun 12, 2022
1 parent 2b48b3d commit 610ebf2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ logits = model(amino_acids) # (1, 512, 21)

- [x] grouped heads with customizable depthwise convs (for variable k-mers), as well as grouped alibi pos bias
- [ ] figure out attention to retrieved (looks like axial attention?)
- [ ] play around with protein gym, and start betting on huggingface's accelerate

## Citations

Expand Down

0 comments on commit 610ebf2

Please sign in to comment.