Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ilanaliouchouche authored Jun 23, 2024
1 parent 161df9a commit d97af36
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,16 +43,16 @@ In KANs, each weight parameter is replaced by a univariate function, typically p
| `utils/` | Utility files for the project |
| `utils/encoder.py` | Implementation of the Encoder layer |
| `utils/multiheadattention.py`| Implementation of the MultiHeadAttention layer |
| `utils/positionwise.py` | Implementation of the PositionWiseFeedForward layer |
| `utils/rope.py` | Implementation of the RoPE layer |
| `utils/positionwise.py` | Implementation of the Position wise Feed Forward layer |
| `utils/rope.py` | Implementation of the RoPE for positional encoding |
| `utils/config.py` | Configuration file for the KANBert model |
| `model_tests/` | Contains the test files for the project |
| `model_tests/kanbert_test.py`| Unit tests for the KANBert model |
| `model_tests/utils_tests/` | Contains the test files for the utility components |
| `model_tests/utils_tests/encoder_test.py`| Unit tests for the Encoder layer |
| `model_tests/utils_tests/multiheadattention_test.py`| Unit tests for the MultiHeadAttention layer |
| `model_tests/utils_tests/positionwise_test.py`| Unit tests for the PositionWiseFeedForward layer|
| `model_tests/utils_tests/rope_test.py`| Unit tests for the RoPE layer |
| `model_tests/utils_tests/rope_test.py`| Unit tests for the RoPE |

## Testing

Expand All @@ -71,4 +71,4 @@ flake8 .
[1] ResearchGate, *The Transformer based BERT base architecture with twelve encoder blocks*, [https://www.researchgate.net/figure/The-Transformer-based-BERT-base-architecture-with-twelve-encoder-blocks_fig2_349546860](https://www.researchgate.net/figure/The-Transformer-based-BERT-base-architecture-with-twelve-encoder-blocks_fig2_349546860)


[2] Massachusetts Institute of Technology, *KAN: Kolmogorov–Arnold Networks*, [https://arxiv.org/abs/2404.19756](https://arxiv.org/abs/2404.19756)
[2] Massachusetts Institute of Technology, *KAN: Kolmogorov–Arnold Networks*, [https://arxiv.org/abs/2404.19756](https://arxiv.org/abs/2404.19756)

0 comments on commit d97af36

Please sign in to comment.