Skip to content

Add FP4 since blackwell supports#11

Closed
winston-zhang-orz wants to merge 14 commits intogmasse:mainfrom
winston-zhang-orz:main
Closed

Add FP4 since blackwell supports#11
winston-zhang-orz wants to merge 14 commits intogmasse:mainfrom
winston-zhang-orz:main

Conversation

@winston-zhang-orz
Copy link
Contributor

@winston-zhang-orz
Copy link
Contributor Author

hi @gmasse,

Can you help review the PR ?

data/specs.json Outdated
"cuda_compute_capability": { "full_name": "CUDA Compute Capability" },
"power_consumption": { "full_name": "Power Consumption", "unit": "W" }
"power_consumption": { "full_name": "Power Consumption", "unit": "W" },
"area": { "full_name": "Area", "unit": "mm2" }
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To comply with NVIDIA data sheets, I suggest to name this field "Die Size" (die_size).

data/specs.json Outdated
"int4_tensor_core_sparsity": { "full_name": "INT4 Tensor Core with Sparsity", "unit": "TOPS" },
"manufacturer": { "full_name": "Manufacturer" },
"architecture": { "full_name": "Architecture" },
"technology": { "full_name": "Technology" },
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To comply with NVIDIA data sheets, I suggest to name this field "Manufacturing Process" (process).

@gmasse
Copy link
Owner

gmasse commented Feb 27, 2025

Thanks for your contribution @winston-zhang-orz . Please review my comments above.

@gmasse
Copy link
Owner

gmasse commented Feb 28, 2025

Hi @winston-zhang-orz
For the RTX 4090, I see discrepancies in values with Nvidia's reference document (https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf). For example: FP32 82.6/165.2.
Do you think you can adjust the JSON to reflect Nvidia's data?

@gmasse gmasse mentioned this pull request Mar 31, 2025
@gmasse
Copy link
Owner

gmasse commented Mar 31, 2025

Replaced by PR #12

@gmasse gmasse closed this Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants