3.1.0 - Invalid Plots generated using --disk16 parameter (Ubuntu 22.04)

[jiongxuan]

Hi, I am using Ubuntu 22.04, GPU plotting to generate a compressed plot, disk 16 mode, compression level C1. The generation process was all normal, but when using the --check 1000 parameter to check these Plots, it was found that the "invalid proof ratio" reached 55%.

Among them, because a Cuda out of memory error occurred during the process, I followed the instructions in issue #276 and changed the parameters (BBCU_BUCKET_COUNT) from 128u to 256u.

Please help me find out what is the reason and how to solve it. Thanks!

My hardware:

GPU: NVidia 3060 Laptop (6Gib vram)
RAM: 16Gib
SSD: NVMe 512G
System: Ubuntu 22.02
Cuda: 12.0.1

Commands and logs: (Keys hidden)

./bladebit_cuda -z 1 -f b818... -c xch10... cudaplot --disk-16 --check 1000 -t1 ~/Documents/ChiaTemp ~/Documents/ChiaPlotsNew

Bladebit Chia Plotter
Version : 3.1.0-dev
Git Commit : e9836f8
Compiled With: gcc 11.4.0

[Global Plotting Config]
Will create 1 plots.
Thread count : 16
Warm start enabled : false
NUMA disabled : false
CPU affinity disabled : false
Farmer public key : b818...
Pool contract address : xch10...
Compression Level : 1
Benchmark mode : disabled
Warning: 16G mode is experimental and still under development.
Please use the --check parameter to validate plots when using this mode.
Direct I/O not supported in 16G mode at the moment. Disabing it.

[Bladebit CUDA Plotter]
Host RAM : 15 GiB
Plot checks : enabled ( 1000 )
Plot check threshold: 0.600

Selected cuda device 0 : NVIDIA GeForce RTX 3060 Laptop GPU
CUDA Compute Capability : 8.6
SM count : 30
Max blocks per SM : 16
Max threads per SM : 1536
Async Engine Count : 2
L2 cache size : 3.00 MB
L2 persist cache max size : 2.25 MB
Stack Size : 1.00 KB
Memory:
Total : 5.80 GB
Free : 5.68 GB

Allocating buffers (this may take a few seconds)...
Kernel RAM required : 2557364432 bytes ( 2438.89 MiB or 2.38 GiB )
Intermediate RAM required : 2315526144 bytes ( 2208.26 MiB or 2.16 GiB )
Host RAM required : 2147483648 bytes ( 2048.00 MiB or 2.00 GiB )
Total Host RAM required : 4704848080 bytes ( 4486.89 MiB or 4.38 GiB )
GPU RAM required : 5585768448 bytes ( 5327.00 MiB or 5.20 GiB )
Allocating buffers...
Done.

Generating plot 1 / 1: 1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a
Plot temporary file: /home/aaa/Documents/ChiaPlotsNew/plot-k32-c01-2023-11-18-01-38-1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a.plot.tmp

Generating F1
Finished F1 in 67.73 seconds.
Table 2 completed in 222.39 seconds with 4294889465 entries.
Table 3 completed in 342.50 seconds with 4294750322 entries.
Table 4 completed in 420.01 seconds with 4294505025 entries.
Table 5 completed in 388.82 seconds with 4294074464 entries.
Table 6 completed in 373.89 seconds with 4292932808 entries.
Table 7 completed in 314.62 seconds with 4290890159 entries.
Finalizing Table 7
Finalized Table 7 in 126.11 seconds.
Completed Phase 1 in 2256.23 seconds
Marked Table 6 in 15.07 seconds.
Marked Table 5 in 12.22 seconds.
Marked Table 4 in 12.45 seconds.
Marked Table 3 in 12.66 seconds.
Completed Phase 2 in 52.40 seconds
Compressing Table 2 and 3...
Step 1 completed step in 178.79 seconds.
Step 2 completed step in 185.01 seconds.
Completed table 2 in 363.81 seconds with 3439490657 / 4294750322 entries ( 80.09% ).
Compressing tables 3 and 4...
Step 1 completed step in 161.52 seconds.
Step 2 completed step in 208.98 seconds.
Step 3 completed step in 162.15 seconds.
Completed table 3 in 532.75 seconds with 3465395293 / 4294505025 entries ( 80.69% ).
Compressing tables 4 and 5...
Step 1 completed step in 98.62 seconds.
Step 2 completed step in 199.75 seconds.
Step 3 completed step in 161.29 seconds.
Completed table 4 in 459.71 seconds with 3531741771 / 4294074464 entries ( 82.25% ).
Compressing tables 5 and 6...
Step 1 completed step in 89.37 seconds.
Step 2 completed step in 199.53 seconds.
Step 3 completed step in 170.83 seconds.
Completed table 5 in 459.74 seconds with 3711415126 / 4292932808 entries ( 86.45% ).
Compressing tables 6 and 7...
Step 1 completed step in 95.61 seconds.
Step 2 completed step in 209.04 seconds.
Step 3 completed step in 176.45 seconds.
Completed table 6 in 481.11 seconds with 4290890159 / 4290890159 entries ( 100.00% ).
Serializing P7 entries
Completed serializing P7 entries in 90.44 seconds.
Completed Phase 3 in 2387.64 seconds
Completed Plot 1 in 4696.27 seconds ( 78.27 minutes )

Checking 1000 random proofs with seed 0x71c40627fcaaad9138a40934ba743156df0335ee8d1f3a07fad207c0075cd74b...
Plot compression level: 1
10%...
20%...
30%...
40%...
50%...
60%...
70%...
80%...
90%...
Seed used: 0x71c40627fcaaad9138a40934ba743156df0335ee8d1f3a07fad207c0075cd74b
Proofs requested/fetched: 536 / 1000 ( 53.600% )
Proof fetches failed : 2 ( 0.200% )
Proof validation failed : 512 ( 51.200% )

WARNING: Deleting plot '/home/aaa/Documents/ChiaPlotsNew/plot-k32-c01-2023-11-18-01-38-1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a.plot.tmp' as it failed to fetch some proofs. This might indicate corrupt plot file.

Completed writing plot in 20.28 seconds