Skip to content

Add FP4 since blackwell supports #11

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
winston-zhang-orz wants to merge 14 commits into from
Closed

Add FP4 since blackwell supports #11

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
6e0fc8d
Add FP4 since blackwell supports
winston-zhang-orz Feb 26, 2025
779413a
Add markdown rendered files
Feb 26, 2025
99bcd87
Update fp4 in specs.json for all asics
winston-zhang-orz Feb 26, 2025
a32fa52
Add markdown rendered files
Feb 26, 2025
5b4f0bf
add area and tech header
winston-zhang-orz Feb 27, 2025
6551ad8
Add markdown rendered files
Feb 27, 2025
9711e93
move technology to front
winston-zhang-orz Feb 27, 2025
a7cf436
Add markdown rendered files
Feb 27, 2025
8fa7471
add RTX4090
winston-zhang-orz Feb 27, 2025
21ab714
Add markdown rendered files
Feb 27, 2025
1cf0c3c
follow review guide to comply with nv datasheet
winston-zhang-orz Feb 28, 2025
097f0fb
Add markdown rendered files
Feb 28, 2025
5ca33da
change Tech -> process
winston-zhang-orz Feb 28, 2025
4b0c72d
Add markdown rendered files
Feb 28, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,8 @@ BF16 Tensor Core with Sparsity (TFLOPS) | 1513 | 733 | 624
FP8 (TFLOPS) | N/A | N/A | N/A
FP8 Tensor Core (TFLOPS) | ? | 733 | N/A
FP8 Tensor Core with Sparsity (TFLOPS) | 3026 | 1466 | N/A
FP4 (TFLOPS) | N/A | N/A | N/A
FP4 Tensor Core (TFLOPS) | N/A | N/A | N/A
INT8 (TOPS) | ? | ? | ?
INT8 Tensor Core (TOPS) | ? | 733 | 624
INT8 Tensor Core with Sparsity (TOPS) | 3026 | 1466 | 1248
Expand All @@ -60,6 +62,7 @@ INT4 Tensor Core with Sparsity (TOPS) | ? | 1466 | ?
GPU Name | H100 | L40S | A100 PCIe 80GB
Manufacturer | NVIDIA | NVIDIA | NVIDIA
Architecture | Hopper | Ada Lovelace | Ampere
Manufacturing Process | ? | ? | ?
NVIDIA RT Cores | ? | 142 (3rd gen) | ?
NVIDIA Tensor Cores | 456 (4th gen) | 568 (4th gen) | 432 (3rd gen)
NVIDIA CUDA Cores | 14592 | 18176 | 6912
Expand All @@ -69,4 +72,5 @@ Interconnect Type | PCIe Gen5 | PCIe Gen4 | PCIe Gen4
Encoders and Decoders | 0, 7 | 3, 3 | 0, 5
CUDA Compute Capability | 9 | 8.9 | 8
Power Consumption (W) | 350 | 300 | 300
Die Size (mm2) | ? | ? | ?

Loading