[Development]The project misses requirements for test.

[zhen8838]

I met a bug as follow:

  File "TileOPs/benchmarks/flash_attn/gqa.py", line 3, in <module>
    import flash_attn_interface
ModuleNotFoundError: No module named 'flash_attn_interface'

But currently, the requirements.txt and requirements - lint.txt do not mention flash_attn_interface. I suggest we add a requirements.test.txt.

[RMLYC]

This is indeed a bug, but the issue should not be fixed by modifying the requirements. TileOps should only depend on TileLang and PyTorch for operator implementations. The missing flash_attn_interface (FA-3) mentioned here is actually a third-party library required for performance testing of the MultiHeadAttention operator. It should not be a dependency for top-level unit tests or general development.
Follow this issue：#136

[RMLYC]

The solution to this bug, I believe, is as follows:

1. Move the import of flash_attn_interface inside the baseline function instead of importing it globally.

2. Place the installation of flash_attn_interface (FA-3) separately in the benchmarks module, so it is only installed when performance comparison is required.

[RMLYC]

This issue will fix in #136