Break up cutlass_extensions.cu, pt 2

Summary: X-link: facebookresearch/FBGEMM#57 - Break up cutlass_extensions.cu, pt 2 Differential Revision: D60942612
pytorch · Aug 9, 2024 · 18ff9ba · 18ff9ba
1 parent 3c559ab
commit 18ff9ba
Show file tree

Hide file tree

Showing 7 changed files with 976 additions and 900 deletions.
diff --git a/fbgemm_gpu/experimental/gen_ai/CMakeLists.txt b/fbgemm_gpu/experimental/gen_ai/CMakeLists.txt
@@ -32,6 +32,9 @@ set(attention_ops_sources
 
 set(quantize_ops_sources
     src/quantize/cutlass_extensions.cu
+    src/quantize/cutlass_extensions/f8f8bf16_blockwise.cu
+    src/quantize/cutlass_extensions/f8f8bf16_cublas.cu
+    src/quantize/cutlass_extensions/f8f8bf16_rowwise.cu
     src/quantize/cutlass_extensions/i8i8bf16.cu
     src/quantize/cutlass_extensions/i8i8bf16_dynamic.cu
     src/quantize/quantize.cu