-
Notifications
You must be signed in to change notification settings - Fork 4
/
Copy pathJPQ_MSRVTT_1kA.txt
2576 lines (2576 loc) · 191 KB
/
JPQ_MSRVTT_1kA.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Experiment directory: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA
Preparing the dataloaders ...
Loading dataset MSRVTT_jsfusion_trainval in ram ...
Finish loading dataset MSRVTT_jsfusion_trainval in ram, taking 282.4452736377716 s.
Loading dataset MSRVTT_jsfusion_test in ram ...
Finish loading dataset MSRVTT_jsfusion_test in ram, taking 27.18897771835327 s.
Loading dataset MSRVTT_jsfusion_test in ram ...
Finish loading dataset MSRVTT_jsfusion_test in ram, taking 31.39389395713806 s.
Experiment directory: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA
Preparing the dataloaders ...
Loading dataset MSRVTT_jsfusion_trainval in ram ...
Experiment directory: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA
Preparing the dataloaders ...
Loading dataset MSRVTT_jsfusion_trainval in ram ...
Finish loading dataset MSRVTT_jsfusion_trainval in ram, taking 295.9216055870056 s.
Loading dataset MSRVTT_jsfusion_test in ram ...
Finish loading dataset MSRVTT_jsfusion_test in ram, taking 32.31790208816528 s.
Loading dataset MSRVTT_jsfusion_test in ram ...
Finish loading dataset MSRVTT_jsfusion_test in ram, taking 24.342007637023926 s.
Training ...
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch0.pth ...
Done in 1.625s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch0.pth ...
Done in 3.176s
epoch : 0
loss : 0
learning_rate : 5e-05
n_samples : 0
n_steps : 0
MSRVTT_jsfusion_test/t2v_metrics/R1: 0.1
MSRVTT_jsfusion_test/t2v_metrics/R5: 0.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 0.9
MSRVTT_jsfusion_test/t2v_metrics/R50: 4.8
MSRVTT_jsfusion_test/t2v_metrics/MedR: 498.5
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 501.728
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 0.26207413942088975
MSRVTT_jsfusion_test/v2t_metrics/R1: 0.0
MSRVTT_jsfusion_test/v2t_metrics/R5: 0.7
MSRVTT_jsfusion_test/v2t_metrics/R10: 1.1
MSRVTT_jsfusion_test/v2t_metrics/R50: 5.4
MSRVTT_jsfusion_test/v2t_metrics/MedR: 503.5
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 503.615
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 0.0
mnt_best : 0.26207413942088975
not_improved_count: 0
Train Epoch: 1 [1/250 128/32000 (0%)] Loss: 0.10620 (QuantReg: 0.13934) QuantErr: 0.13934 batch_time=28.20778
Train Epoch: 1 [12/250 1536/32000 (5%)] Loss: 0.09766 (QuantReg: 0.14360) QuantErr: 0.14360 batch_time=0.41727
Train Epoch: 1 [23/250 2944/32000 (9%)] Loss: 0.09229 (QuantReg: 0.13917) QuantErr: 0.13917 batch_time=0.42636
Train Epoch: 1 [34/250 4352/32000 (14%)] Loss: 0.07764 (QuantReg: 0.13491) QuantErr: 0.13491 batch_time=0.43412
Train Epoch: 1 [45/250 5760/32000 (18%)] Loss: 0.06555 (QuantReg: 0.13649) QuantErr: 0.13649 batch_time=0.43370
Train Epoch: 1 [56/250 7168/32000 (22%)] Loss: 0.05127 (QuantReg: 0.13993) QuantErr: 0.13993 batch_time=0.43641
Train Epoch: 1 [67/250 8576/32000 (27%)] Loss: 0.04156 (QuantReg: 0.14314) QuantErr: 0.14314 batch_time=0.43698
Train Epoch: 1 [78/250 9984/32000 (31%)] Loss: 0.03424 (QuantReg: 0.14037) QuantErr: 0.14037 batch_time=0.42260
Train Epoch: 1 [89/250 11392/32000 (36%)] Loss: 0.03308 (QuantReg: 0.13772) QuantErr: 0.13772 batch_time=0.42746
Train Epoch: 1 [100/250 12800/32000 (40%)] Loss: 0.03271 (QuantReg: 0.14062) QuantErr: 0.14062 batch_time=0.43890
Train Epoch: 1 [111/250 14208/32000 (44%)] Loss: 0.03430 (QuantReg: 0.13845) QuantErr: 0.13845 batch_time=0.43402
Train Epoch: 1 [122/250 15616/32000 (49%)] Loss: 0.02701 (QuantReg: 0.14077) QuantErr: 0.14077 batch_time=0.43139
Train Epoch: 1 [133/250 17024/32000 (53%)] Loss: 0.03099 (QuantReg: 0.13917) QuantErr: 0.13917 batch_time=0.43604
Train Epoch: 1 [144/250 18432/32000 (58%)] Loss: 0.02725 (QuantReg: 0.13786) QuantErr: 0.13786 batch_time=0.42667
Train Epoch: 1 [155/250 19840/32000 (62%)] Loss: 0.02667 (QuantReg: 0.13852) QuantErr: 0.13852 batch_time=0.43477
Train Epoch: 1 [166/250 21248/32000 (66%)] Loss: 0.02393 (QuantReg: 0.13887) QuantErr: 0.13887 batch_time=0.47189
Train Epoch: 1 [177/250 22656/32000 (71%)] Loss: 0.02455 (QuantReg: 0.13913) QuantErr: 0.13913 batch_time=0.42551
Train Epoch: 1 [188/250 24064/32000 (75%)] Loss: 0.02356 (QuantReg: 0.14077) QuantErr: 0.14077 batch_time=0.45764
Train Epoch: 1 [199/250 25472/32000 (80%)] Loss: 0.01877 (QuantReg: 0.13868) QuantErr: 0.13868 batch_time=0.41653
Train Epoch: 1 [210/250 26880/32000 (84%)] Loss: 0.02202 (QuantReg: 0.13761) QuantErr: 0.13761 batch_time=0.47180
Train Epoch: 1 [221/250 28288/32000 (88%)] Loss: 0.02255 (QuantReg: 0.13644) QuantErr: 0.13644 batch_time=0.41668
Train Epoch: 1 [232/250 29696/32000 (93%)] Loss: 0.01884 (QuantReg: 0.13762) QuantErr: 0.13762 batch_time=0.41779
Train Epoch: 1 [243/250 31104/32000 (97%)] Loss: 0.01935 (QuantReg: 0.13637) QuantErr: 0.13637 batch_time=0.41444
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch1.pth ...
Done in 3.800s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch1.pth ...
Done in 7.486s
epoch : 1
loss : 0.039697021484375
quant_reg : 0.13852145028114318
quant_err : 0.13852145028114318
learning_rate : 5e-05
n_samples : 32000
n_steps : 250
MSRVTT_jsfusion_test/t2v_metrics/R1: 3.2
MSRVTT_jsfusion_test/t2v_metrics/R5: 13.9
MSRVTT_jsfusion_test/t2v_metrics/R10: 22.3
MSRVTT_jsfusion_test/t2v_metrics/R50: 60.9
MSRVTT_jsfusion_test/t2v_metrics/MedR: 35.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 75.479
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 9.972940175972777
MSRVTT_jsfusion_test/v2t_metrics/R1: 4.1
MSRVTT_jsfusion_test/v2t_metrics/R5: 13.2
MSRVTT_jsfusion_test/v2t_metrics/R10: 23.7
MSRVTT_jsfusion_test/v2t_metrics/R50: 61.9
MSRVTT_jsfusion_test/v2t_metrics/MedR: 31.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 72.793
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 10.865141283288725
mnt_best : 9.972940175972777
not_improved_count: 0
Train Epoch: 2 [1/250 128/32000 (0%)] Loss: 0.01848 (QuantReg: 0.13503) QuantErr: 0.13503 batch_time=32.34617
Train Epoch: 2 [12/250 1536/32000 (5%)] Loss: 0.01756 (QuantReg: 0.13621) QuantErr: 0.13621 batch_time=0.41763
Train Epoch: 2 [23/250 2944/32000 (9%)] Loss: 0.01767 (QuantReg: 0.13657) QuantErr: 0.13657 batch_time=0.43211
Train Epoch: 2 [34/250 4352/32000 (14%)] Loss: 0.02039 (QuantReg: 0.13831) QuantErr: 0.13831 batch_time=0.45435
Train Epoch: 2 [45/250 5760/32000 (18%)] Loss: 0.01256 (QuantReg: 0.13773) QuantErr: 0.13773 batch_time=0.68720
Train Epoch: 2 [56/250 7168/32000 (22%)] Loss: 0.01478 (QuantReg: 0.13862) QuantErr: 0.13862 batch_time=0.45573
Train Epoch: 2 [67/250 8576/32000 (27%)] Loss: 0.01224 (QuantReg: 0.13708) QuantErr: 0.13708 batch_time=2.59813
Train Epoch: 2 [78/250 9984/32000 (31%)] Loss: 0.01553 (QuantReg: 0.13857) QuantErr: 0.13857 batch_time=0.40989
Train Epoch: 2 [89/250 11392/32000 (36%)] Loss: 0.01495 (QuantReg: 0.13547) QuantErr: 0.13547 batch_time=0.44144
Train Epoch: 2 [100/250 12800/32000 (40%)] Loss: 0.01584 (QuantReg: 0.13599) QuantErr: 0.13599 batch_time=0.42544
Train Epoch: 2 [111/250 14208/32000 (44%)] Loss: 0.01965 (QuantReg: 0.13658) QuantErr: 0.13658 batch_time=0.41681
Train Epoch: 2 [122/250 15616/32000 (49%)] Loss: 0.01508 (QuantReg: 0.13590) QuantErr: 0.13590 batch_time=0.41738
Train Epoch: 2 [133/250 17024/32000 (53%)] Loss: 0.01807 (QuantReg: 0.13787) QuantErr: 0.13787 batch_time=0.41394
Train Epoch: 2 [144/250 18432/32000 (58%)] Loss: 0.01422 (QuantReg: 0.13706) QuantErr: 0.13706 batch_time=0.44007
Train Epoch: 2 [155/250 19840/32000 (62%)] Loss: 0.02557 (QuantReg: 0.13780) QuantErr: 0.13780 batch_time=0.41386
Train Epoch: 2 [166/250 21248/32000 (66%)] Loss: 0.01270 (QuantReg: 0.13840) QuantErr: 0.13840 batch_time=0.47553
Train Epoch: 2 [177/250 22656/32000 (71%)] Loss: 0.01929 (QuantReg: 0.13538) QuantErr: 0.13538 batch_time=0.41628
Train Epoch: 2 [188/250 24064/32000 (75%)] Loss: 0.01663 (QuantReg: 0.13594) QuantErr: 0.13594 batch_time=0.41862
Train Epoch: 2 [199/250 25472/32000 (80%)] Loss: 0.01642 (QuantReg: 0.14029) QuantErr: 0.14029 batch_time=0.43982
Train Epoch: 2 [210/250 26880/32000 (84%)] Loss: 0.01396 (QuantReg: 0.14027) QuantErr: 0.14027 batch_time=0.42945
Train Epoch: 2 [221/250 28288/32000 (88%)] Loss: 0.01139 (QuantReg: 0.13695) QuantErr: 0.13695 batch_time=0.42837
Train Epoch: 2 [232/250 29696/32000 (93%)] Loss: 0.01239 (QuantReg: 0.13948) QuantErr: 0.13948 batch_time=0.43972
Train Epoch: 2 [243/250 31104/32000 (97%)] Loss: 0.01481 (QuantReg: 0.13862) QuantErr: 0.13862 batch_time=0.42118
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch2.pth ...
Done in 5.933s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch2.pth ...
Done in 9.710s
removing stale ckpt [epoch 1] [took 0.00s]
removing stale ckpt [epoch 0] [took 0.00s]
epoch : 2
loss : 0.016452178955078126
quant_reg : 0.13729151290655137
quant_err : 0.13729151290655137
learning_rate : 4.75e-05
n_samples : 64000
n_steps : 500
MSRVTT_jsfusion_test/t2v_metrics/R1: 5.3
MSRVTT_jsfusion_test/t2v_metrics/R5: 20.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 31.6
MSRVTT_jsfusion_test/t2v_metrics/R50: 70.9
MSRVTT_jsfusion_test/t2v_metrics/MedR: 24.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 56.913
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 15.011984496313852
MSRVTT_jsfusion_test/v2t_metrics/R1: 5.1
MSRVTT_jsfusion_test/v2t_metrics/R5: 19.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 31.1
MSRVTT_jsfusion_test/v2t_metrics/R50: 70.2
MSRVTT_jsfusion_test/v2t_metrics/MedR: 22.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 55.881
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 14.469537314860128
mnt_best : 15.011984496313852
not_improved_count: 0
Train Epoch: 3 [1/250 128/32000 (0%)] Loss: 0.01300 (QuantReg: 0.13743) QuantErr: 0.13743 batch_time=28.96844
Train Epoch: 3 [12/250 1536/32000 (5%)] Loss: 0.01234 (QuantReg: 0.13742) QuantErr: 0.13742 batch_time=0.42752
Train Epoch: 3 [23/250 2944/32000 (9%)] Loss: 0.01432 (QuantReg: 0.14009) QuantErr: 0.14009 batch_time=0.41896
Train Epoch: 3 [34/250 4352/32000 (14%)] Loss: 0.01639 (QuantReg: 0.13838) QuantErr: 0.13838 batch_time=0.42278
Train Epoch: 3 [45/250 5760/32000 (18%)] Loss: 0.01463 (QuantReg: 0.13786) QuantErr: 0.13786 batch_time=0.42049
Train Epoch: 3 [56/250 7168/32000 (22%)] Loss: 0.01324 (QuantReg: 0.13723) QuantErr: 0.13723 batch_time=0.42233
Train Epoch: 3 [67/250 8576/32000 (27%)] Loss: 0.01265 (QuantReg: 0.13565) QuantErr: 0.13565 batch_time=0.41824
Train Epoch: 3 [78/250 9984/32000 (31%)] Loss: 0.01485 (QuantReg: 0.13753) QuantErr: 0.13753 batch_time=0.44257
Train Epoch: 3 [89/250 11392/32000 (36%)] Loss: 0.01173 (QuantReg: 0.13766) QuantErr: 0.13766 batch_time=0.44316
Train Epoch: 3 [100/250 12800/32000 (40%)] Loss: 0.01218 (QuantReg: 0.13657) QuantErr: 0.13657 batch_time=0.42736
Train Epoch: 3 [111/250 14208/32000 (44%)] Loss: 0.01192 (QuantReg: 0.13582) QuantErr: 0.13582 batch_time=0.43204
Train Epoch: 3 [122/250 15616/32000 (49%)] Loss: 0.01376 (QuantReg: 0.14018) QuantErr: 0.14018 batch_time=0.42543
Train Epoch: 3 [133/250 17024/32000 (53%)] Loss: 0.01434 (QuantReg: 0.13804) QuantErr: 0.13804 batch_time=0.41661
Train Epoch: 3 [144/250 18432/32000 (58%)] Loss: 0.01436 (QuantReg: 0.13790) QuantErr: 0.13790 batch_time=2.35777
Train Epoch: 3 [155/250 19840/32000 (62%)] Loss: 0.01086 (QuantReg: 0.13599) QuantErr: 0.13599 batch_time=0.43284
Train Epoch: 3 [166/250 21248/32000 (66%)] Loss: 0.01068 (QuantReg: 0.13850) QuantErr: 0.13850 batch_time=0.42398
Train Epoch: 3 [177/250 22656/32000 (71%)] Loss: 0.01469 (QuantReg: 0.13862) QuantErr: 0.13862 batch_time=0.42777
Train Epoch: 3 [188/250 24064/32000 (75%)] Loss: 0.01138 (QuantReg: 0.13870) QuantErr: 0.13870 batch_time=0.53215
Train Epoch: 3 [199/250 25472/32000 (80%)] Loss: 0.01134 (QuantReg: 0.13925) QuantErr: 0.13925 batch_time=0.99890
Train Epoch: 3 [210/250 26880/32000 (84%)] Loss: 0.01065 (QuantReg: 0.13872) QuantErr: 0.13872 batch_time=3.43877
Train Epoch: 3 [221/250 28288/32000 (88%)] Loss: 0.00894 (QuantReg: 0.13810) QuantErr: 0.13810 batch_time=0.42242
Train Epoch: 3 [232/250 29696/32000 (93%)] Loss: 0.01590 (QuantReg: 0.13697) QuantErr: 0.13697 batch_time=0.42314
Train Epoch: 3 [243/250 31104/32000 (97%)] Loss: 0.01249 (QuantReg: 0.14029) QuantErr: 0.14029 batch_time=0.42139
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch3.pth ...
Done in 3.941s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch3.pth ...
Done in 7.826s
removing stale ckpt [epoch 2] [took 0.00s]
epoch : 3
loss : 0.012883636474609375
quant_reg : 0.1381472162604332
quant_err : 0.1381472162604332
learning_rate : 4.5125e-05
n_samples : 96000
n_steps : 750
MSRVTT_jsfusion_test/t2v_metrics/R1: 6.8
MSRVTT_jsfusion_test/t2v_metrics/R5: 22.3
MSRVTT_jsfusion_test/t2v_metrics/R10: 35.9
MSRVTT_jsfusion_test/t2v_metrics/R50: 73.6
MSRVTT_jsfusion_test/t2v_metrics/MedR: 19.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 48.761
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 17.591494685179068
MSRVTT_jsfusion_test/v2t_metrics/R1: 8.1
MSRVTT_jsfusion_test/v2t_metrics/R5: 24.8
MSRVTT_jsfusion_test/v2t_metrics/R10: 38.5
MSRVTT_jsfusion_test/v2t_metrics/R50: 74.7
MSRVTT_jsfusion_test/v2t_metrics/MedR: 18.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 47.699
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 19.775727833468025
mnt_best : 17.591494685179068
not_improved_count: 0
Train Epoch: 4 [1/250 128/32000 (0%)] Loss: 0.00986 (QuantReg: 0.13737) QuantErr: 0.13737 batch_time=29.20283
Train Epoch: 4 [12/250 1536/32000 (5%)] Loss: 0.01471 (QuantReg: 0.13626) QuantErr: 0.13626 batch_time=0.45329
Train Epoch: 4 [23/250 2944/32000 (9%)] Loss: 0.01125 (QuantReg: 0.13778) QuantErr: 0.13778 batch_time=0.45174
Train Epoch: 4 [34/250 4352/32000 (14%)] Loss: 0.01017 (QuantReg: 0.13853) QuantErr: 0.13853 batch_time=0.42249
Train Epoch: 4 [45/250 5760/32000 (18%)] Loss: 0.01131 (QuantReg: 0.13570) QuantErr: 0.13570 batch_time=0.42641
Train Epoch: 4 [56/250 7168/32000 (22%)] Loss: 0.01096 (QuantReg: 0.13626) QuantErr: 0.13626 batch_time=0.44800
Train Epoch: 4 [67/250 8576/32000 (27%)] Loss: 0.01212 (QuantReg: 0.13440) QuantErr: 0.13440 batch_time=0.42567
Train Epoch: 4 [78/250 9984/32000 (31%)] Loss: 0.01401 (QuantReg: 0.13575) QuantErr: 0.13575 batch_time=0.42214
Train Epoch: 4 [89/250 11392/32000 (36%)] Loss: 0.01137 (QuantReg: 0.13855) QuantErr: 0.13855 batch_time=0.42513
Train Epoch: 4 [100/250 12800/32000 (40%)] Loss: 0.01282 (QuantReg: 0.13948) QuantErr: 0.13948 batch_time=0.42550
Train Epoch: 4 [111/250 14208/32000 (44%)] Loss: 0.00732 (QuantReg: 0.13597) QuantErr: 0.13597 batch_time=0.42752
Train Epoch: 4 [122/250 15616/32000 (49%)] Loss: 0.01199 (QuantReg: 0.13626) QuantErr: 0.13626 batch_time=0.42993
Train Epoch: 4 [133/250 17024/32000 (53%)] Loss: 0.00879 (QuantReg: 0.13611) QuantErr: 0.13611 batch_time=0.43301
Train Epoch: 4 [144/250 18432/32000 (58%)] Loss: 0.01022 (QuantReg: 0.13648) QuantErr: 0.13648 batch_time=2.96981
Train Epoch: 4 [155/250 19840/32000 (62%)] Loss: 0.01349 (QuantReg: 0.13842) QuantErr: 0.13842 batch_time=0.42264
Train Epoch: 4 [166/250 21248/32000 (66%)] Loss: 0.01169 (QuantReg: 0.13713) QuantErr: 0.13713 batch_time=0.45286
Train Epoch: 4 [177/250 22656/32000 (71%)] Loss: 0.01131 (QuantReg: 0.13519) QuantErr: 0.13519 batch_time=0.41765
Train Epoch: 4 [188/250 24064/32000 (75%)] Loss: 0.00854 (QuantReg: 0.13871) QuantErr: 0.13871 batch_time=0.47593
Train Epoch: 4 [199/250 25472/32000 (80%)] Loss: 0.00970 (QuantReg: 0.14014) QuantErr: 0.14014 batch_time=0.42611
Train Epoch: 4 [210/250 26880/32000 (84%)] Loss: 0.01048 (QuantReg: 0.13898) QuantErr: 0.13898 batch_time=0.43342
Train Epoch: 4 [221/250 28288/32000 (88%)] Loss: 0.00931 (QuantReg: 0.13670) QuantErr: 0.13670 batch_time=0.42222
Train Epoch: 4 [232/250 29696/32000 (93%)] Loss: 0.01154 (QuantReg: 0.13814) QuantErr: 0.13814 batch_time=0.42739
Train Epoch: 4 [243/250 31104/32000 (97%)] Loss: 0.01117 (QuantReg: 0.13879) QuantErr: 0.13879 batch_time=0.42604
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch4.pth ...
Done in 3.839s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch4.pth ...
Done in 7.620s
removing stale ckpt [epoch 3] [took 0.00s]
epoch : 4
loss : 0.01086553955078125
quant_reg : 0.13740485805273056
quant_err : 0.13740485805273056
learning_rate : 4.2868749999999995e-05
n_samples : 128000
n_steps : 1000
MSRVTT_jsfusion_test/t2v_metrics/R1: 8.7
MSRVTT_jsfusion_test/t2v_metrics/R5: 25.9
MSRVTT_jsfusion_test/t2v_metrics/R10: 38.6
MSRVTT_jsfusion_test/t2v_metrics/R50: 76.8
MSRVTT_jsfusion_test/t2v_metrics/MedR: 17.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 46.076
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 20.565318525454806
MSRVTT_jsfusion_test/v2t_metrics/R1: 8.7
MSRVTT_jsfusion_test/v2t_metrics/R5: 27.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 40.4
MSRVTT_jsfusion_test/v2t_metrics/R50: 76.5
MSRVTT_jsfusion_test/v2t_metrics/MedR: 16.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 45.3455
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 21.197759938942152
mnt_best : 20.565318525454806
not_improved_count: 0
Train Epoch: 5 [1/250 128/32000 (0%)] Loss: 0.00978 (QuantReg: 0.13670) QuantErr: 0.13670 batch_time=27.97334
Train Epoch: 5 [12/250 1536/32000 (5%)] Loss: 0.01077 (QuantReg: 0.13792) QuantErr: 0.13792 batch_time=0.41965
Train Epoch: 5 [23/250 2944/32000 (9%)] Loss: 0.01145 (QuantReg: 0.13636) QuantErr: 0.13636 batch_time=0.64700
Train Epoch: 5 [34/250 4352/32000 (14%)] Loss: 0.00757 (QuantReg: 0.13764) QuantErr: 0.13764 batch_time=0.41809
Train Epoch: 5 [45/250 5760/32000 (18%)] Loss: 0.00903 (QuantReg: 0.13670) QuantErr: 0.13670 batch_time=0.42794
Train Epoch: 5 [56/250 7168/32000 (22%)] Loss: 0.00601 (QuantReg: 0.13932) QuantErr: 0.13932 batch_time=0.41768
Train Epoch: 5 [67/250 8576/32000 (27%)] Loss: 0.01308 (QuantReg: 0.14009) QuantErr: 0.14009 batch_time=0.43647
Train Epoch: 5 [78/250 9984/32000 (31%)] Loss: 0.00801 (QuantReg: 0.14057) QuantErr: 0.14057 batch_time=1.54459
Train Epoch: 5 [89/250 11392/32000 (36%)] Loss: 0.00933 (QuantReg: 0.14034) QuantErr: 0.14034 batch_time=1.76952
Train Epoch: 5 [100/250 12800/32000 (40%)] Loss: 0.01003 (QuantReg: 0.14126) QuantErr: 0.14126 batch_time=3.14539
Train Epoch: 5 [111/250 14208/32000 (44%)] Loss: 0.00976 (QuantReg: 0.13706) QuantErr: 0.13706 batch_time=0.43219
Train Epoch: 5 [122/250 15616/32000 (49%)] Loss: 0.00684 (QuantReg: 0.14063) QuantErr: 0.14063 batch_time=0.42953
Train Epoch: 5 [133/250 17024/32000 (53%)] Loss: 0.01254 (QuantReg: 0.13911) QuantErr: 0.13911 batch_time=0.42236
Train Epoch: 5 [144/250 18432/32000 (58%)] Loss: 0.01334 (QuantReg: 0.13935) QuantErr: 0.13935 batch_time=0.44368
Train Epoch: 5 [155/250 19840/32000 (62%)] Loss: 0.00914 (QuantReg: 0.14229) QuantErr: 0.14229 batch_time=0.42713
Train Epoch: 5 [166/250 21248/32000 (66%)] Loss: 0.00954 (QuantReg: 0.13959) QuantErr: 0.13959 batch_time=0.43897
Train Epoch: 5 [177/250 22656/32000 (71%)] Loss: 0.01110 (QuantReg: 0.13964) QuantErr: 0.13964 batch_time=0.43451
Train Epoch: 5 [188/250 24064/32000 (75%)] Loss: 0.00957 (QuantReg: 0.13952) QuantErr: 0.13952 batch_time=0.41834
Train Epoch: 5 [199/250 25472/32000 (80%)] Loss: 0.01231 (QuantReg: 0.14039) QuantErr: 0.14039 batch_time=2.21158
Train Epoch: 5 [210/250 26880/32000 (84%)] Loss: 0.00912 (QuantReg: 0.14001) QuantErr: 0.14001 batch_time=0.42093
Train Epoch: 5 [221/250 28288/32000 (88%)] Loss: 0.00698 (QuantReg: 0.14128) QuantErr: 0.14128 batch_time=0.43254
Train Epoch: 5 [232/250 29696/32000 (93%)] Loss: 0.00978 (QuantReg: 0.13926) QuantErr: 0.13926 batch_time=0.42875
Train Epoch: 5 [243/250 31104/32000 (97%)] Loss: 0.00808 (QuantReg: 0.14158) QuantErr: 0.14158 batch_time=0.43196
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch5.pth ...
Done in 4.093s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch5.pth ...
Done in 8.065s
removing stale ckpt [epoch 4] [took 0.00s]
epoch : 5
loss : 0.00952801513671875
quant_reg : 0.13906184780597686
quant_err : 0.13906184780597686
learning_rate : 4.072531249999999e-05
n_samples : 160000
n_steps : 1250
MSRVTT_jsfusion_test/t2v_metrics/R1: 9.9
MSRVTT_jsfusion_test/t2v_metrics/R5: 29.4
MSRVTT_jsfusion_test/t2v_metrics/R10: 41.4
MSRVTT_jsfusion_test/t2v_metrics/R50: 78.6
MSRVTT_jsfusion_test/t2v_metrics/MedR: 15.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 42.053
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 22.92596484100372
MSRVTT_jsfusion_test/v2t_metrics/R1: 9.0
MSRVTT_jsfusion_test/v2t_metrics/R5: 31.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 43.2
MSRVTT_jsfusion_test/v2t_metrics/R50: 80.6
MSRVTT_jsfusion_test/v2t_metrics/MedR: 14.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 40.568
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 22.952441109043136
mnt_best : 22.92596484100372
not_improved_count: 0
Train Epoch: 6 [1/250 128/32000 (0%)] Loss: 0.00807 (QuantReg: 0.13661) QuantErr: 0.13661 batch_time=26.55855
Train Epoch: 6 [12/250 1536/32000 (5%)] Loss: 0.00476 (QuantReg: 0.13821) QuantErr: 0.13821 batch_time=0.42139
Train Epoch: 6 [23/250 2944/32000 (9%)] Loss: 0.00836 (QuantReg: 0.13893) QuantErr: 0.13893 batch_time=0.44567
Train Epoch: 6 [34/250 4352/32000 (14%)] Loss: 0.00745 (QuantReg: 0.13928) QuantErr: 0.13928 batch_time=0.43937
Train Epoch: 6 [45/250 5760/32000 (18%)] Loss: 0.01037 (QuantReg: 0.14137) QuantErr: 0.14137 batch_time=0.43102
Train Epoch: 6 [56/250 7168/32000 (22%)] Loss: 0.01244 (QuantReg: 0.14008) QuantErr: 0.14008 batch_time=0.43228
Train Epoch: 6 [67/250 8576/32000 (27%)] Loss: 0.00810 (QuantReg: 0.13783) QuantErr: 0.13783 batch_time=0.42121
Train Epoch: 6 [78/250 9984/32000 (31%)] Loss: 0.00873 (QuantReg: 0.13880) QuantErr: 0.13880 batch_time=0.42750
Train Epoch: 6 [89/250 11392/32000 (36%)] Loss: 0.00896 (QuantReg: 0.13983) QuantErr: 0.13983 batch_time=0.42526
Train Epoch: 6 [100/250 12800/32000 (40%)] Loss: 0.00707 (QuantReg: 0.13583) QuantErr: 0.13583 batch_time=0.43875
Train Epoch: 6 [111/250 14208/32000 (44%)] Loss: 0.01015 (QuantReg: 0.14025) QuantErr: 0.14025 batch_time=0.45756
Train Epoch: 6 [122/250 15616/32000 (49%)] Loss: 0.00944 (QuantReg: 0.13695) QuantErr: 0.13695 batch_time=0.42846
Train Epoch: 6 [133/250 17024/32000 (53%)] Loss: 0.00787 (QuantReg: 0.13795) QuantErr: 0.13795 batch_time=0.45074
Train Epoch: 6 [144/250 18432/32000 (58%)] Loss: 0.00887 (QuantReg: 0.13943) QuantErr: 0.13943 batch_time=0.45244
Train Epoch: 6 [155/250 19840/32000 (62%)] Loss: 0.00513 (QuantReg: 0.13756) QuantErr: 0.13756 batch_time=0.42691
Train Epoch: 6 [166/250 21248/32000 (66%)] Loss: 0.01096 (QuantReg: 0.14135) QuantErr: 0.14135 batch_time=0.42681
Train Epoch: 6 [177/250 22656/32000 (71%)] Loss: 0.00721 (QuantReg: 0.13888) QuantErr: 0.13888 batch_time=0.46028
Train Epoch: 6 [188/250 24064/32000 (75%)] Loss: 0.00833 (QuantReg: 0.13644) QuantErr: 0.13644 batch_time=0.44915
Train Epoch: 6 [199/250 25472/32000 (80%)] Loss: 0.00790 (QuantReg: 0.13943) QuantErr: 0.13943 batch_time=0.42976
Train Epoch: 6 [210/250 26880/32000 (84%)] Loss: 0.00826 (QuantReg: 0.13814) QuantErr: 0.13814 batch_time=0.42810
Train Epoch: 6 [221/250 28288/32000 (88%)] Loss: 0.00912 (QuantReg: 0.13914) QuantErr: 0.13914 batch_time=0.42942
Train Epoch: 6 [232/250 29696/32000 (93%)] Loss: 0.01139 (QuantReg: 0.14177) QuantErr: 0.14177 batch_time=0.42606
Train Epoch: 6 [243/250 31104/32000 (97%)] Loss: 0.00707 (QuantReg: 0.13712) QuantErr: 0.13712 batch_time=0.42556
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch6.pth ...
Done in 15.452s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch6.pth ...
Done in 19.455s
removing stale ckpt [epoch 5] [took 0.00s]
epoch : 6
loss : 0.008568832397460938
quant_reg : 0.1389672200679779
quant_err : 0.1389672200679779
learning_rate : 3.868904687499999e-05
n_samples : 192000
n_steps : 1500
MSRVTT_jsfusion_test/t2v_metrics/R1: 10.5
MSRVTT_jsfusion_test/t2v_metrics/R5: 29.3
MSRVTT_jsfusion_test/t2v_metrics/R10: 43.7
MSRVTT_jsfusion_test/t2v_metrics/R50: 81.0
MSRVTT_jsfusion_test/t2v_metrics/MedR: 14.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 39.886
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 23.778226090058308
MSRVTT_jsfusion_test/v2t_metrics/R1: 9.0
MSRVTT_jsfusion_test/v2t_metrics/R5: 30.4
MSRVTT_jsfusion_test/v2t_metrics/R10: 45.8
MSRVTT_jsfusion_test/v2t_metrics/R50: 81.1
MSRVTT_jsfusion_test/v2t_metrics/MedR: 13.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 38.712
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 23.227039420805678
mnt_best : 23.778226090058308
not_improved_count: 0
Train Epoch: 7 [1/250 128/32000 (0%)] Loss: 0.00905 (QuantReg: 0.14009) QuantErr: 0.14009 batch_time=35.36343
Train Epoch: 7 [12/250 1536/32000 (5%)] Loss: 0.00813 (QuantReg: 0.13993) QuantErr: 0.13993 batch_time=0.41378
Train Epoch: 7 [23/250 2944/32000 (9%)] Loss: 0.01057 (QuantReg: 0.13839) QuantErr: 0.13839 batch_time=0.43570
Train Epoch: 7 [34/250 4352/32000 (14%)] Loss: 0.01348 (QuantReg: 0.14158) QuantErr: 0.14158 batch_time=0.42956
Train Epoch: 7 [45/250 5760/32000 (18%)] Loss: 0.00652 (QuantReg: 0.14094) QuantErr: 0.14094 batch_time=0.42511
Train Epoch: 7 [56/250 7168/32000 (22%)] Loss: 0.00789 (QuantReg: 0.14200) QuantErr: 0.14200 batch_time=0.46327
Train Epoch: 7 [67/250 8576/32000 (27%)] Loss: 0.00831 (QuantReg: 0.13869) QuantErr: 0.13869 batch_time=0.41708
Train Epoch: 7 [78/250 9984/32000 (31%)] Loss: 0.00750 (QuantReg: 0.13921) QuantErr: 0.13921 batch_time=0.43104
Train Epoch: 7 [89/250 11392/32000 (36%)] Loss: 0.00895 (QuantReg: 0.14051) QuantErr: 0.14051 batch_time=0.46811
Train Epoch: 7 [100/250 12800/32000 (40%)] Loss: 0.00793 (QuantReg: 0.14091) QuantErr: 0.14091 batch_time=0.42785
Train Epoch: 7 [111/250 14208/32000 (44%)] Loss: 0.00626 (QuantReg: 0.13879) QuantErr: 0.13879 batch_time=0.47487
Train Epoch: 7 [122/250 15616/32000 (49%)] Loss: 0.00679 (QuantReg: 0.13985) QuantErr: 0.13985 batch_time=0.43913
Train Epoch: 7 [133/250 17024/32000 (53%)] Loss: 0.01059 (QuantReg: 0.14007) QuantErr: 0.14007 batch_time=0.42886
Train Epoch: 7 [144/250 18432/32000 (58%)] Loss: 0.01115 (QuantReg: 0.13771) QuantErr: 0.13771 batch_time=0.65314
Train Epoch: 7 [155/250 19840/32000 (62%)] Loss: 0.00713 (QuantReg: 0.14004) QuantErr: 0.14004 batch_time=0.42567
Train Epoch: 7 [166/250 21248/32000 (66%)] Loss: 0.00836 (QuantReg: 0.14107) QuantErr: 0.14107 batch_time=0.42405
Train Epoch: 7 [177/250 22656/32000 (71%)] Loss: 0.00859 (QuantReg: 0.14023) QuantErr: 0.14023 batch_time=0.41870
Train Epoch: 7 [188/250 24064/32000 (75%)] Loss: 0.00638 (QuantReg: 0.13985) QuantErr: 0.13985 batch_time=0.55241
Train Epoch: 7 [199/250 25472/32000 (80%)] Loss: 0.00724 (QuantReg: 0.14016) QuantErr: 0.14016 batch_time=0.42158
Train Epoch: 7 [210/250 26880/32000 (84%)] Loss: 0.00830 (QuantReg: 0.13939) QuantErr: 0.13939 batch_time=0.43165
Train Epoch: 7 [221/250 28288/32000 (88%)] Loss: 0.00836 (QuantReg: 0.14375) QuantErr: 0.14375 batch_time=1.77661
Train Epoch: 7 [232/250 29696/32000 (93%)] Loss: 0.00993 (QuantReg: 0.13939) QuantErr: 0.13939 batch_time=0.45498
Train Epoch: 7 [243/250 31104/32000 (97%)] Loss: 0.00614 (QuantReg: 0.13930) QuantErr: 0.13930 batch_time=0.42159
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch7.pth ...
Done in 4.039s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch7.pth ...
Done in 7.730s
removing stale ckpt [epoch 6] [took 0.00s]
epoch : 7
loss : 0.00796148681640625
quant_reg : 0.13999895709753035
quant_err : 0.13999895709753035
learning_rate : 3.675459453124999e-05
n_samples : 224000
n_steps : 1750
MSRVTT_jsfusion_test/t2v_metrics/R1: 9.4
MSRVTT_jsfusion_test/t2v_metrics/R5: 31.5
MSRVTT_jsfusion_test/t2v_metrics/R10: 46.2
MSRVTT_jsfusion_test/t2v_metrics/R50: 81.7
MSRVTT_jsfusion_test/t2v_metrics/MedR: 12.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 40.184
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 23.91627073176257
MSRVTT_jsfusion_test/v2t_metrics/R1: 10.1
MSRVTT_jsfusion_test/v2t_metrics/R5: 32.0
MSRVTT_jsfusion_test/v2t_metrics/R10: 47.2
MSRVTT_jsfusion_test/v2t_metrics/R50: 81.1
MSRVTT_jsfusion_test/v2t_metrics/MedR: 12.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 38.631
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 24.801109905234377
mnt_best : 23.91627073176257
not_improved_count: 0
Train Epoch: 8 [1/250 128/32000 (0%)] Loss: 0.00819 (QuantReg: 0.14261) QuantErr: 0.14261 batch_time=27.57566
Train Epoch: 8 [12/250 1536/32000 (5%)] Loss: 0.00717 (QuantReg: 0.14114) QuantErr: 0.14114 batch_time=0.47840
Train Epoch: 8 [23/250 2944/32000 (9%)] Loss: 0.01064 (QuantReg: 0.13883) QuantErr: 0.13883 batch_time=0.42663
Train Epoch: 8 [34/250 4352/32000 (14%)] Loss: 0.00720 (QuantReg: 0.14003) QuantErr: 0.14003 batch_time=0.42633
Train Epoch: 8 [45/250 5760/32000 (18%)] Loss: 0.01009 (QuantReg: 0.14098) QuantErr: 0.14098 batch_time=0.41863
Train Epoch: 8 [56/250 7168/32000 (22%)] Loss: 0.00655 (QuantReg: 0.14093) QuantErr: 0.14093 batch_time=0.45754
Train Epoch: 8 [67/250 8576/32000 (27%)] Loss: 0.00610 (QuantReg: 0.14098) QuantErr: 0.14098 batch_time=0.42550
Train Epoch: 8 [78/250 9984/32000 (31%)] Loss: 0.00691 (QuantReg: 0.13965) QuantErr: 0.13965 batch_time=0.41646
Train Epoch: 8 [89/250 11392/32000 (36%)] Loss: 0.00574 (QuantReg: 0.14106) QuantErr: 0.14106 batch_time=0.42336
Train Epoch: 8 [100/250 12800/32000 (40%)] Loss: 0.00546 (QuantReg: 0.13896) QuantErr: 0.13896 batch_time=0.42202
Train Epoch: 8 [111/250 14208/32000 (44%)] Loss: 0.00793 (QuantReg: 0.13952) QuantErr: 0.13952 batch_time=0.43178
Train Epoch: 8 [122/250 15616/32000 (49%)] Loss: 0.00839 (QuantReg: 0.14263) QuantErr: 0.14263 batch_time=0.42575
Train Epoch: 8 [133/250 17024/32000 (53%)] Loss: 0.00896 (QuantReg: 0.14274) QuantErr: 0.14274 batch_time=0.41911
Train Epoch: 8 [144/250 18432/32000 (58%)] Loss: 0.00642 (QuantReg: 0.13914) QuantErr: 0.13914 batch_time=1.90061
Train Epoch: 8 [155/250 19840/32000 (62%)] Loss: 0.00852 (QuantReg: 0.14286) QuantErr: 0.14286 batch_time=0.41276
Train Epoch: 8 [166/250 21248/32000 (66%)] Loss: 0.00657 (QuantReg: 0.13875) QuantErr: 0.13875 batch_time=0.42512
Train Epoch: 8 [177/250 22656/32000 (71%)] Loss: 0.00816 (QuantReg: 0.13830) QuantErr: 0.13830 batch_time=0.43174
Train Epoch: 8 [188/250 24064/32000 (75%)] Loss: 0.00578 (QuantReg: 0.14055) QuantErr: 0.14055 batch_time=0.42400
Train Epoch: 8 [199/250 25472/32000 (80%)] Loss: 0.00877 (QuantReg: 0.13909) QuantErr: 0.13909 batch_time=0.42167
Train Epoch: 8 [210/250 26880/32000 (84%)] Loss: 0.00660 (QuantReg: 0.13874) QuantErr: 0.13874 batch_time=0.44047
Train Epoch: 8 [221/250 28288/32000 (88%)] Loss: 0.00657 (QuantReg: 0.13940) QuantErr: 0.13940 batch_time=0.42400
Train Epoch: 8 [232/250 29696/32000 (93%)] Loss: 0.00923 (QuantReg: 0.13900) QuantErr: 0.13900 batch_time=0.42561
Train Epoch: 8 [243/250 31104/32000 (97%)] Loss: 0.00568 (QuantReg: 0.14098) QuantErr: 0.14098 batch_time=0.42807
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch8.pth ...
Done in 3.857s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch8.pth ...
Done in 7.831s
removing stale ckpt [epoch 7] [took 0.00s]
epoch : 8
loss : 0.00748321533203125
quant_reg : 0.14013711959123612
quant_err : 0.14013711959123612
learning_rate : 3.4916864804687486e-05
n_samples : 256000
n_steps : 2000
MSRVTT_jsfusion_test/t2v_metrics/R1: 10.2
MSRVTT_jsfusion_test/t2v_metrics/R5: 31.5
MSRVTT_jsfusion_test/t2v_metrics/R10: 47.1
MSRVTT_jsfusion_test/t2v_metrics/R50: 82.0
MSRVTT_jsfusion_test/t2v_metrics/MedR: 12.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 36.218
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 24.734921945575273
MSRVTT_jsfusion_test/v2t_metrics/R1: 8.7
MSRVTT_jsfusion_test/v2t_metrics/R5: 31.5
MSRVTT_jsfusion_test/v2t_metrics/R10: 47.1
MSRVTT_jsfusion_test/v2t_metrics/R50: 82.6
MSRVTT_jsfusion_test/v2t_metrics/MedR: 12.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 35.9545
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 23.457599717796533
mnt_best : 24.734921945575273
not_improved_count: 0
Train Epoch: 9 [1/250 128/32000 (0%)] Loss: 0.00729 (QuantReg: 0.14152) QuantErr: 0.14152 batch_time=28.47999
Train Epoch: 9 [12/250 1536/32000 (5%)] Loss: 0.00451 (QuantReg: 0.13989) QuantErr: 0.13989 batch_time=0.42950
Train Epoch: 9 [23/250 2944/32000 (9%)] Loss: 0.00786 (QuantReg: 0.14287) QuantErr: 0.14287 batch_time=0.42503
Train Epoch: 9 [34/250 4352/32000 (14%)] Loss: 0.00698 (QuantReg: 0.14080) QuantErr: 0.14080 batch_time=0.42774
Train Epoch: 9 [45/250 5760/32000 (18%)] Loss: 0.00673 (QuantReg: 0.14132) QuantErr: 0.14132 batch_time=0.42694
Train Epoch: 9 [56/250 7168/32000 (22%)] Loss: 0.00600 (QuantReg: 0.13784) QuantErr: 0.13784 batch_time=0.42893
Train Epoch: 9 [67/250 8576/32000 (27%)] Loss: 0.00673 (QuantReg: 0.14122) QuantErr: 0.14122 batch_time=1.42401
Train Epoch: 9 [78/250 9984/32000 (31%)] Loss: 0.00606 (QuantReg: 0.13957) QuantErr: 0.13957 batch_time=0.45137
Train Epoch: 9 [89/250 11392/32000 (36%)] Loss: 0.00658 (QuantReg: 0.13911) QuantErr: 0.13911 batch_time=0.41389
Train Epoch: 9 [100/250 12800/32000 (40%)] Loss: 0.00562 (QuantReg: 0.13916) QuantErr: 0.13916 batch_time=0.42445
Train Epoch: 9 [111/250 14208/32000 (44%)] Loss: 0.00649 (QuantReg: 0.14238) QuantErr: 0.14238 batch_time=0.42501
Train Epoch: 9 [122/250 15616/32000 (49%)] Loss: 0.00742 (QuantReg: 0.14138) QuantErr: 0.14138 batch_time=0.44122
Train Epoch: 9 [133/250 17024/32000 (53%)] Loss: 0.00515 (QuantReg: 0.14320) QuantErr: 0.14320 batch_time=0.47956
Train Epoch: 9 [144/250 18432/32000 (58%)] Loss: 0.00504 (QuantReg: 0.14155) QuantErr: 0.14155 batch_time=0.42582
Train Epoch: 9 [155/250 19840/32000 (62%)] Loss: 0.00574 (QuantReg: 0.14224) QuantErr: 0.14224 batch_time=0.44578
Train Epoch: 9 [166/250 21248/32000 (66%)] Loss: 0.00742 (QuantReg: 0.13973) QuantErr: 0.13973 batch_time=0.43099
Train Epoch: 9 [177/250 22656/32000 (71%)] Loss: 0.00494 (QuantReg: 0.14322) QuantErr: 0.14322 batch_time=0.42803
Train Epoch: 9 [188/250 24064/32000 (75%)] Loss: 0.01048 (QuantReg: 0.14122) QuantErr: 0.14122 batch_time=0.44049
Train Epoch: 9 [199/250 25472/32000 (80%)] Loss: 0.00844 (QuantReg: 0.14101) QuantErr: 0.14101 batch_time=0.45208
Train Epoch: 9 [210/250 26880/32000 (84%)] Loss: 0.00548 (QuantReg: 0.14133) QuantErr: 0.14133 batch_time=0.42778
Train Epoch: 9 [221/250 28288/32000 (88%)] Loss: 0.00445 (QuantReg: 0.13920) QuantErr: 0.13920 batch_time=0.46817
Train Epoch: 9 [232/250 29696/32000 (93%)] Loss: 0.00524 (QuantReg: 0.13974) QuantErr: 0.13974 batch_time=0.42974
Train Epoch: 9 [243/250 31104/32000 (97%)] Loss: 0.00695 (QuantReg: 0.14189) QuantErr: 0.14189 batch_time=0.42055
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch9.pth ...
Done in 3.848s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch9.pth ...
Done in 7.722s
removing stale ckpt [epoch 8] [took 0.00s]
epoch : 9
loss : 0.006872406005859375
quant_reg : 0.14095720207691192
quant_err : 0.14095720207691192
learning_rate : 3.317102156445311e-05
n_samples : 288000
n_steps : 2250
MSRVTT_jsfusion_test/t2v_metrics/R1: 11.0
MSRVTT_jsfusion_test/t2v_metrics/R5: 33.7
MSRVTT_jsfusion_test/t2v_metrics/R10: 48.7
MSRVTT_jsfusion_test/t2v_metrics/R50: 82.3
MSRVTT_jsfusion_test/t2v_metrics/MedR: 11.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 35.856
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 26.233154422430726
MSRVTT_jsfusion_test/v2t_metrics/R1: 9.5
MSRVTT_jsfusion_test/v2t_metrics/R5: 34.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 51.0
MSRVTT_jsfusion_test/v2t_metrics/R50: 82.7
MSRVTT_jsfusion_test/v2t_metrics/MedR: 10.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 34.045
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 25.46924396522724
mnt_best : 26.233154422430726
not_improved_count: 0
Train Epoch: 10 [1/250 128/32000 (0%)] Loss: 0.00565 (QuantReg: 0.14271) QuantErr: 0.14271 batch_time=31.10418
Train Epoch: 10 [12/250 1536/32000 (5%)] Loss: 0.00710 (QuantReg: 0.13985) QuantErr: 0.13985 batch_time=0.42708
Train Epoch: 10 [23/250 2944/32000 (9%)] Loss: 0.00650 (QuantReg: 0.13865) QuantErr: 0.13865 batch_time=0.43894
Train Epoch: 10 [34/250 4352/32000 (14%)] Loss: 0.00693 (QuantReg: 0.14018) QuantErr: 0.14018 batch_time=0.41709
Train Epoch: 10 [45/250 5760/32000 (18%)] Loss: 0.00999 (QuantReg: 0.13912) QuantErr: 0.13912 batch_time=0.44724
Train Epoch: 10 [56/250 7168/32000 (22%)] Loss: 0.01051 (QuantReg: 0.14367) QuantErr: 0.14367 batch_time=0.43916
Train Epoch: 10 [67/250 8576/32000 (27%)] Loss: 0.00874 (QuantReg: 0.13807) QuantErr: 0.13807 batch_time=1.69454
Train Epoch: 10 [78/250 9984/32000 (31%)] Loss: 0.00818 (QuantReg: 0.13820) QuantErr: 0.13820 batch_time=1.81101
Train Epoch: 10 [89/250 11392/32000 (36%)] Loss: 0.00510 (QuantReg: 0.13596) QuantErr: 0.13596 batch_time=0.42013
Train Epoch: 10 [100/250 12800/32000 (40%)] Loss: 0.00686 (QuantReg: 0.13901) QuantErr: 0.13901 batch_time=0.43689
Train Epoch: 10 [111/250 14208/32000 (44%)] Loss: 0.00621 (QuantReg: 0.13913) QuantErr: 0.13913 batch_time=0.42268
Train Epoch: 10 [122/250 15616/32000 (49%)] Loss: 0.00671 (QuantReg: 0.13935) QuantErr: 0.13935 batch_time=0.43353
Train Epoch: 10 [133/250 17024/32000 (53%)] Loss: 0.00457 (QuantReg: 0.14004) QuantErr: 0.14004 batch_time=0.41991
Train Epoch: 10 [144/250 18432/32000 (58%)] Loss: 0.00789 (QuantReg: 0.13814) QuantErr: 0.13814 batch_time=0.42234
Train Epoch: 10 [155/250 19840/32000 (62%)] Loss: 0.00703 (QuantReg: 0.13763) QuantErr: 0.13763 batch_time=0.53195
Train Epoch: 10 [166/250 21248/32000 (66%)] Loss: 0.00604 (QuantReg: 0.13889) QuantErr: 0.13889 batch_time=0.43724
Train Epoch: 10 [177/250 22656/32000 (71%)] Loss: 0.00735 (QuantReg: 0.13882) QuantErr: 0.13882 batch_time=1.12516
Train Epoch: 10 [188/250 24064/32000 (75%)] Loss: 0.00669 (QuantReg: 0.13475) QuantErr: 0.13475 batch_time=0.42035
Train Epoch: 10 [199/250 25472/32000 (80%)] Loss: 0.00585 (QuantReg: 0.13865) QuantErr: 0.13865 batch_time=0.42006
Train Epoch: 10 [210/250 26880/32000 (84%)] Loss: 0.00694 (QuantReg: 0.13920) QuantErr: 0.13920 batch_time=0.80456
Train Epoch: 10 [221/250 28288/32000 (88%)] Loss: 0.00470 (QuantReg: 0.14026) QuantErr: 0.14026 batch_time=0.54888
Train Epoch: 10 [232/250 29696/32000 (93%)] Loss: 0.00545 (QuantReg: 0.13992) QuantErr: 0.13992 batch_time=0.45792
Train Epoch: 10 [243/250 31104/32000 (97%)] Loss: 0.00780 (QuantReg: 0.14108) QuantErr: 0.14108 batch_time=0.41824
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch10.pth ...
Done in 17.924s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch10.pth ...
Done in 21.784s
removing stale ckpt [epoch 9] [took 0.00s]
epoch : 10
loss : 0.00723614501953125
quant_reg : 0.13948549807071686
quant_err : 0.13948549807071686
learning_rate : 3.151247048623045e-05
n_samples : 320000
n_steps : 2500
MSRVTT_jsfusion_test/t2v_metrics/R1: 13.1
MSRVTT_jsfusion_test/t2v_metrics/R5: 34.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 50.2
MSRVTT_jsfusion_test/t2v_metrics/R50: 83.3
MSRVTT_jsfusion_test/t2v_metrics/MedR: 10.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 34.456
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 28.227150552823815
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.3
MSRVTT_jsfusion_test/v2t_metrics/R5: 36.3
MSRVTT_jsfusion_test/v2t_metrics/R10: 51.2
MSRVTT_jsfusion_test/v2t_metrics/R50: 83.9
MSRVTT_jsfusion_test/v2t_metrics/MedR: 10.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 32.650999999999996
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 28.380969860491728
mnt_best : 28.227150552823815
not_improved_count: 0
Train Epoch: 11 [1/250 128/32000 (0%)] Loss: 0.00795 (QuantReg: 0.13721) QuantErr: 0.13721 batch_time=30.75900
Train Epoch: 11 [12/250 1536/32000 (5%)] Loss: 0.00647 (QuantReg: 0.14137) QuantErr: 0.14137 batch_time=0.43768
Train Epoch: 11 [23/250 2944/32000 (9%)] Loss: 0.00578 (QuantReg: 0.14068) QuantErr: 0.14068 batch_time=0.42710
Train Epoch: 11 [34/250 4352/32000 (14%)] Loss: 0.00619 (QuantReg: 0.13616) QuantErr: 0.13616 batch_time=0.41791
Train Epoch: 11 [45/250 5760/32000 (18%)] Loss: 0.00708 (QuantReg: 0.13800) QuantErr: 0.13800 batch_time=0.42240
Train Epoch: 11 [56/250 7168/32000 (22%)] Loss: 0.00592 (QuantReg: 0.13765) QuantErr: 0.13765 batch_time=0.42921
Train Epoch: 11 [67/250 8576/32000 (27%)] Loss: 0.00658 (QuantReg: 0.14012) QuantErr: 0.14012 batch_time=0.44418
Train Epoch: 11 [78/250 9984/32000 (31%)] Loss: 0.00659 (QuantReg: 0.13858) QuantErr: 0.13858 batch_time=0.42043
Train Epoch: 11 [89/250 11392/32000 (36%)] Loss: 0.00559 (QuantReg: 0.13786) QuantErr: 0.13786 batch_time=0.45968
Train Epoch: 11 [100/250 12800/32000 (40%)] Loss: 0.00649 (QuantReg: 0.13910) QuantErr: 0.13910 batch_time=0.43071
Train Epoch: 11 [111/250 14208/32000 (44%)] Loss: 0.00864 (QuantReg: 0.13944) QuantErr: 0.13944 batch_time=0.42660
Train Epoch: 11 [122/250 15616/32000 (49%)] Loss: 0.00421 (QuantReg: 0.13970) QuantErr: 0.13970 batch_time=0.41833
Train Epoch: 11 [133/250 17024/32000 (53%)] Loss: 0.00619 (QuantReg: 0.13691) QuantErr: 0.13691 batch_time=1.11108
Train Epoch: 11 [144/250 18432/32000 (58%)] Loss: 0.00457 (QuantReg: 0.13888) QuantErr: 0.13888 batch_time=2.57734
Train Epoch: 11 [155/250 19840/32000 (62%)] Loss: 0.00501 (QuantReg: 0.13905) QuantErr: 0.13905 batch_time=0.44157
Train Epoch: 11 [166/250 21248/32000 (66%)] Loss: 0.00624 (QuantReg: 0.14072) QuantErr: 0.14072 batch_time=0.42406
Train Epoch: 11 [177/250 22656/32000 (71%)] Loss: 0.00621 (QuantReg: 0.13918) QuantErr: 0.13918 batch_time=0.72057
Train Epoch: 11 [188/250 24064/32000 (75%)] Loss: 0.00665 (QuantReg: 0.14093) QuantErr: 0.14093 batch_time=0.42705
Train Epoch: 11 [199/250 25472/32000 (80%)] Loss: 0.00675 (QuantReg: 0.14219) QuantErr: 0.14219 batch_time=0.98569
Train Epoch: 11 [210/250 26880/32000 (84%)] Loss: 0.00632 (QuantReg: 0.14000) QuantErr: 0.14000 batch_time=0.43242
Train Epoch: 11 [221/250 28288/32000 (88%)] Loss: 0.00340 (QuantReg: 0.14112) QuantErr: 0.14112 batch_time=0.42720
Train Epoch: 11 [232/250 29696/32000 (93%)] Loss: 0.00653 (QuantReg: 0.14083) QuantErr: 0.14083 batch_time=0.41251
Train Epoch: 11 [243/250 31104/32000 (97%)] Loss: 0.00700 (QuantReg: 0.14130) QuantErr: 0.14130 batch_time=0.41792
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch11.pth ...
Done in 3.839s
removing stale ckpt [epoch 10] [took 0.00s]
epoch : 11
loss : 0.0062576675415039066
quant_reg : 0.13938977295160293
quant_err : 0.13938977295160293
learning_rate : 2.993684696191893e-05
n_samples : 352000
n_steps : 2750
MSRVTT_jsfusion_test/t2v_metrics/R1: 12.8
MSRVTT_jsfusion_test/t2v_metrics/R5: 34.1
MSRVTT_jsfusion_test/t2v_metrics/R10: 49.5
MSRVTT_jsfusion_test/t2v_metrics/R50: 83.8
MSRVTT_jsfusion_test/t2v_metrics/MedR: 11.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 35.128
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 27.852008295708163
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.5
MSRVTT_jsfusion_test/v2t_metrics/R5: 36.2
MSRVTT_jsfusion_test/v2t_metrics/R10: 51.5
MSRVTT_jsfusion_test/v2t_metrics/R50: 83.7
MSRVTT_jsfusion_test/v2t_metrics/MedR: 10.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 32.951
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 28.56331466025944
mnt_best : 28.227150552823815
not_improved_count: 1
Train Epoch: 12 [1/250 128/32000 (0%)] Loss: 0.00643 (QuantReg: 0.14274) QuantErr: 0.14274 batch_time=26.19226
Train Epoch: 12 [12/250 1536/32000 (5%)] Loss: 0.00838 (QuantReg: 0.14045) QuantErr: 0.14045 batch_time=0.41443
Train Epoch: 12 [23/250 2944/32000 (9%)] Loss: 0.00674 (QuantReg: 0.13986) QuantErr: 0.13986 batch_time=0.43913
Train Epoch: 12 [34/250 4352/32000 (14%)] Loss: 0.00434 (QuantReg: 0.13911) QuantErr: 0.13911 batch_time=0.40892
Train Epoch: 12 [45/250 5760/32000 (18%)] Loss: 0.00601 (QuantReg: 0.14138) QuantErr: 0.14138 batch_time=0.42833
Train Epoch: 12 [56/250 7168/32000 (22%)] Loss: 0.00724 (QuantReg: 0.14398) QuantErr: 0.14398 batch_time=0.44459
Train Epoch: 12 [67/250 8576/32000 (27%)] Loss: 0.01012 (QuantReg: 0.13979) QuantErr: 0.13979 batch_time=1.67860
Train Epoch: 12 [78/250 9984/32000 (31%)] Loss: 0.00571 (QuantReg: 0.14108) QuantErr: 0.14108 batch_time=0.43800
Train Epoch: 12 [89/250 11392/32000 (36%)] Loss: 0.00552 (QuantReg: 0.14158) QuantErr: 0.14158 batch_time=0.64567
Train Epoch: 12 [100/250 12800/32000 (40%)] Loss: 0.00531 (QuantReg: 0.14168) QuantErr: 0.14168 batch_time=0.42346
Train Epoch: 12 [111/250 14208/32000 (44%)] Loss: 0.00626 (QuantReg: 0.14051) QuantErr: 0.14051 batch_time=0.41434
Train Epoch: 12 [122/250 15616/32000 (49%)] Loss: 0.00726 (QuantReg: 0.14094) QuantErr: 0.14094 batch_time=0.41612
Train Epoch: 12 [133/250 17024/32000 (53%)] Loss: 0.00376 (QuantReg: 0.14417) QuantErr: 0.14417 batch_time=0.43354
Train Epoch: 12 [144/250 18432/32000 (58%)] Loss: 0.00501 (QuantReg: 0.13938) QuantErr: 0.13938 batch_time=1.51720
Train Epoch: 12 [155/250 19840/32000 (62%)] Loss: 0.00433 (QuantReg: 0.14256) QuantErr: 0.14256 batch_time=0.41228
Train Epoch: 12 [166/250 21248/32000 (66%)] Loss: 0.00458 (QuantReg: 0.14071) QuantErr: 0.14071 batch_time=0.46702
Train Epoch: 12 [177/250 22656/32000 (71%)] Loss: 0.00703 (QuantReg: 0.14329) QuantErr: 0.14329 batch_time=0.41704
Train Epoch: 12 [188/250 24064/32000 (75%)] Loss: 0.00718 (QuantReg: 0.14126) QuantErr: 0.14126 batch_time=0.44337
Train Epoch: 12 [199/250 25472/32000 (80%)] Loss: 0.00452 (QuantReg: 0.13826) QuantErr: 0.13826 batch_time=0.49832
Train Epoch: 12 [210/250 26880/32000 (84%)] Loss: 0.00413 (QuantReg: 0.14156) QuantErr: 0.14156 batch_time=0.45845
Train Epoch: 12 [221/250 28288/32000 (88%)] Loss: 0.00615 (QuantReg: 0.14287) QuantErr: 0.14287 batch_time=0.44790
Train Epoch: 12 [232/250 29696/32000 (93%)] Loss: 0.00681 (QuantReg: 0.14310) QuantErr: 0.14310 batch_time=0.41555
Train Epoch: 12 [243/250 31104/32000 (97%)] Loss: 0.00434 (QuantReg: 0.13859) QuantErr: 0.13859 batch_time=0.44427
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch12.pth ...
Done in 3.898s
removing stale ckpt [epoch 11] [took 0.00s]
epoch : 12
loss : 0.006017578125
quant_reg : 0.14072130954265594
quant_err : 0.14072130954265594
learning_rate : 2.844000461382298e-05
n_samples : 384000
n_steps : 3000
MSRVTT_jsfusion_test/t2v_metrics/R1: 9.3
MSRVTT_jsfusion_test/t2v_metrics/R5: 33.9
MSRVTT_jsfusion_test/t2v_metrics/R10: 49.6
MSRVTT_jsfusion_test/t2v_metrics/R50: 83.5
MSRVTT_jsfusion_test/t2v_metrics/MedR: 11.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 36.215
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 25.00660732024559
MSRVTT_jsfusion_test/v2t_metrics/R1: 11.0
MSRVTT_jsfusion_test/v2t_metrics/R5: 33.2
MSRVTT_jsfusion_test/v2t_metrics/R10: 49.7
MSRVTT_jsfusion_test/v2t_metrics/R50: 83.2
MSRVTT_jsfusion_test/v2t_metrics/MedR: 11.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 35.176
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 26.280223389483137
mnt_best : 28.227150552823815
not_improved_count: 2
Train Epoch: 13 [1/250 128/32000 (0%)] Loss: 0.00573 (QuantReg: 0.14119) QuantErr: 0.14119 batch_time=26.89130
Train Epoch: 13 [12/250 1536/32000 (5%)] Loss: 0.00454 (QuantReg: 0.13972) QuantErr: 0.13972 batch_time=0.41437
Train Epoch: 13 [23/250 2944/32000 (9%)] Loss: 0.00521 (QuantReg: 0.14143) QuantErr: 0.14143 batch_time=0.43518
Train Epoch: 13 [34/250 4352/32000 (14%)] Loss: 0.00523 (QuantReg: 0.14103) QuantErr: 0.14103 batch_time=0.41399
Train Epoch: 13 [45/250 5760/32000 (18%)] Loss: 0.00444 (QuantReg: 0.14064) QuantErr: 0.14064 batch_time=0.52518
Train Epoch: 13 [56/250 7168/32000 (22%)] Loss: 0.00493 (QuantReg: 0.14009) QuantErr: 0.14009 batch_time=0.41593
Train Epoch: 13 [67/250 8576/32000 (27%)] Loss: 0.00702 (QuantReg: 0.14170) QuantErr: 0.14170 batch_time=2.18463
Train Epoch: 13 [78/250 9984/32000 (31%)] Loss: 0.00597 (QuantReg: 0.14086) QuantErr: 0.14086 batch_time=0.42258
Train Epoch: 13 [89/250 11392/32000 (36%)] Loss: 0.00755 (QuantReg: 0.13917) QuantErr: 0.13917 batch_time=0.41182
Train Epoch: 13 [100/250 12800/32000 (40%)] Loss: 0.00626 (QuantReg: 0.13922) QuantErr: 0.13922 batch_time=0.41623
Train Epoch: 13 [111/250 14208/32000 (44%)] Loss: 0.00792 (QuantReg: 0.13827) QuantErr: 0.13827 batch_time=0.42185
Train Epoch: 13 [122/250 15616/32000 (49%)] Loss: 0.00484 (QuantReg: 0.14050) QuantErr: 0.14050 batch_time=0.41422
Train Epoch: 13 [133/250 17024/32000 (53%)] Loss: 0.00555 (QuantReg: 0.13996) QuantErr: 0.13996 batch_time=0.45437
Train Epoch: 13 [144/250 18432/32000 (58%)] Loss: 0.00541 (QuantReg: 0.14225) QuantErr: 0.14225 batch_time=0.46525
Train Epoch: 13 [155/250 19840/32000 (62%)] Loss: 0.00517 (QuantReg: 0.14012) QuantErr: 0.14012 batch_time=0.41035
Train Epoch: 13 [166/250 21248/32000 (66%)] Loss: 0.00593 (QuantReg: 0.14118) QuantErr: 0.14118 batch_time=0.45287
Train Epoch: 13 [177/250 22656/32000 (71%)] Loss: 0.00626 (QuantReg: 0.14278) QuantErr: 0.14278 batch_time=0.41810
Train Epoch: 13 [188/250 24064/32000 (75%)] Loss: 0.00591 (QuantReg: 0.14079) QuantErr: 0.14079 batch_time=0.41705
Train Epoch: 13 [199/250 25472/32000 (80%)] Loss: 0.00563 (QuantReg: 0.14152) QuantErr: 0.14152 batch_time=0.41642
Train Epoch: 13 [210/250 26880/32000 (84%)] Loss: 0.00490 (QuantReg: 0.14046) QuantErr: 0.14046 batch_time=3.78422
Train Epoch: 13 [221/250 28288/32000 (88%)] Loss: 0.00468 (QuantReg: 0.14042) QuantErr: 0.14042 batch_time=0.75572
Train Epoch: 13 [232/250 29696/32000 (93%)] Loss: 0.00443 (QuantReg: 0.13951) QuantErr: 0.13951 batch_time=0.41961
Train Epoch: 13 [243/250 31104/32000 (97%)] Loss: 0.00557 (QuantReg: 0.14030) QuantErr: 0.14030 batch_time=0.42218
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch13.pth ...
Done in 3.800s
removing stale ckpt [epoch 12] [took 0.00s]
epoch : 13
loss : 0.00570269775390625
quant_reg : 0.14067046117782592
quant_err : 0.14067046117782592
learning_rate : 2.7018004383131832e-05
n_samples : 416000
n_steps : 3250
MSRVTT_jsfusion_test/t2v_metrics/R1: 11.6
MSRVTT_jsfusion_test/t2v_metrics/R5: 36.6
MSRVTT_jsfusion_test/t2v_metrics/R10: 51.7
MSRVTT_jsfusion_test/t2v_metrics/R50: 85.5
MSRVTT_jsfusion_test/t2v_metrics/MedR: 10.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 32.769999999999996
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 27.99904418505951
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.6
MSRVTT_jsfusion_test/v2t_metrics/R5: 37.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 53.0
MSRVTT_jsfusion_test/v2t_metrics/R50: 84.9
MSRVTT_jsfusion_test/v2t_metrics/MedR: 9.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 31.309
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 29.152341409722514
mnt_best : 28.227150552823815
not_improved_count: 3
Train Epoch: 14 [1/250 128/32000 (0%)] Loss: 0.00644 (QuantReg: 0.13706) QuantErr: 0.13706 batch_time=27.49305
Train Epoch: 14 [12/250 1536/32000 (5%)] Loss: 0.00557 (QuantReg: 0.14165) QuantErr: 0.14165 batch_time=0.42060
Train Epoch: 14 [23/250 2944/32000 (9%)] Loss: 0.00406 (QuantReg: 0.14158) QuantErr: 0.14158 batch_time=0.42536
Train Epoch: 14 [34/250 4352/32000 (14%)] Loss: 0.00610 (QuantReg: 0.13914) QuantErr: 0.13914 batch_time=0.42123
Train Epoch: 14 [45/250 5760/32000 (18%)] Loss: 0.00502 (QuantReg: 0.13911) QuantErr: 0.13911 batch_time=0.41775
Train Epoch: 14 [56/250 7168/32000 (22%)] Loss: 0.00365 (QuantReg: 0.14066) QuantErr: 0.14066 batch_time=0.70253
Train Epoch: 14 [67/250 8576/32000 (27%)] Loss: 0.00591 (QuantReg: 0.14085) QuantErr: 0.14085 batch_time=0.46541
Train Epoch: 14 [78/250 9984/32000 (31%)] Loss: 0.00562 (QuantReg: 0.14034) QuantErr: 0.14034 batch_time=0.42500
Train Epoch: 14 [89/250 11392/32000 (36%)] Loss: 0.00554 (QuantReg: 0.14129) QuantErr: 0.14129 batch_time=0.48293
Train Epoch: 14 [100/250 12800/32000 (40%)] Loss: 0.00646 (QuantReg: 0.13780) QuantErr: 0.13780 batch_time=0.42557
Train Epoch: 14 [111/250 14208/32000 (44%)] Loss: 0.00630 (QuantReg: 0.13909) QuantErr: 0.13909 batch_time=0.42736
Train Epoch: 14 [122/250 15616/32000 (49%)] Loss: 0.00466 (QuantReg: 0.14053) QuantErr: 0.14053 batch_time=0.54229
Train Epoch: 14 [133/250 17024/32000 (53%)] Loss: 0.00339 (QuantReg: 0.13871) QuantErr: 0.13871 batch_time=0.48036
Train Epoch: 14 [144/250 18432/32000 (58%)] Loss: 0.00512 (QuantReg: 0.13995) QuantErr: 0.13995 batch_time=0.41272
Train Epoch: 14 [155/250 19840/32000 (62%)] Loss: 0.00573 (QuantReg: 0.13841) QuantErr: 0.13841 batch_time=1.18785
Train Epoch: 14 [166/250 21248/32000 (66%)] Loss: 0.00549 (QuantReg: 0.13893) QuantErr: 0.13893 batch_time=0.46741
Train Epoch: 14 [177/250 22656/32000 (71%)] Loss: 0.00504 (QuantReg: 0.13875) QuantErr: 0.13875 batch_time=0.49805
Train Epoch: 14 [188/250 24064/32000 (75%)] Loss: 0.00552 (QuantReg: 0.13932) QuantErr: 0.13932 batch_time=0.42758
Train Epoch: 14 [199/250 25472/32000 (80%)] Loss: 0.00546 (QuantReg: 0.14257) QuantErr: 0.14257 batch_time=0.42969
Train Epoch: 14 [210/250 26880/32000 (84%)] Loss: 0.00462 (QuantReg: 0.14168) QuantErr: 0.14168 batch_time=0.42218
Train Epoch: 14 [221/250 28288/32000 (88%)] Loss: 0.00588 (QuantReg: 0.13866) QuantErr: 0.13866 batch_time=0.44033
Train Epoch: 14 [232/250 29696/32000 (93%)] Loss: 0.00357 (QuantReg: 0.13961) QuantErr: 0.13961 batch_time=0.42063
Train Epoch: 14 [243/250 31104/32000 (97%)] Loss: 0.00436 (QuantReg: 0.14091) QuantErr: 0.14091 batch_time=0.42999
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch14.pth ...
Done in 4.071s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch14.pth ...
Done in 8.004s
removing stale ckpt [epoch 13] [took 0.00s]
epoch : 14
loss : 0.0052602005004882815
quant_reg : 0.13983992159366607
quant_err : 0.13983992159366607
learning_rate : 2.566710416397524e-05
n_samples : 448000
n_steps : 3500
MSRVTT_jsfusion_test/t2v_metrics/R1: 12.0
MSRVTT_jsfusion_test/t2v_metrics/R5: 37.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 54.0
MSRVTT_jsfusion_test/t2v_metrics/R50: 86.5
MSRVTT_jsfusion_test/t2v_metrics/MedR: 9.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 30.135
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 28.887235495993664
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.2
MSRVTT_jsfusion_test/v2t_metrics/R5: 38.9
MSRVTT_jsfusion_test/v2t_metrics/R10: 54.7
MSRVTT_jsfusion_test/v2t_metrics/R50: 86.5
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 29.265
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 29.609580384375125
mnt_best : 28.887235495993664
not_improved_count: 0
Train Epoch: 15 [1/250 128/32000 (0%)] Loss: 0.00475 (QuantReg: 0.13782) QuantErr: 0.13782 batch_time=26.66417
Train Epoch: 15 [12/250 1536/32000 (5%)] Loss: 0.00572 (QuantReg: 0.13857) QuantErr: 0.13857 batch_time=0.44100
Train Epoch: 15 [23/250 2944/32000 (9%)] Loss: 0.00374 (QuantReg: 0.13738) QuantErr: 0.13738 batch_time=0.41598
Train Epoch: 15 [34/250 4352/32000 (14%)] Loss: 0.00699 (QuantReg: 0.13960) QuantErr: 0.13960 batch_time=0.47925
Train Epoch: 15 [45/250 5760/32000 (18%)] Loss: 0.00606 (QuantReg: 0.14007) QuantErr: 0.14007 batch_time=0.43890
Train Epoch: 15 [56/250 7168/32000 (22%)] Loss: 0.00531 (QuantReg: 0.13880) QuantErr: 0.13880 batch_time=0.41302
Train Epoch: 15 [67/250 8576/32000 (27%)] Loss: 0.00449 (QuantReg: 0.14015) QuantErr: 0.14015 batch_time=1.82449
Train Epoch: 15 [78/250 9984/32000 (31%)] Loss: 0.00445 (QuantReg: 0.14110) QuantErr: 0.14110 batch_time=0.43123
Train Epoch: 15 [89/250 11392/32000 (36%)] Loss: 0.00719 (QuantReg: 0.13887) QuantErr: 0.13887 batch_time=0.42158
Train Epoch: 15 [100/250 12800/32000 (40%)] Loss: 0.00463 (QuantReg: 0.13991) QuantErr: 0.13991 batch_time=0.42218
Train Epoch: 15 [111/250 14208/32000 (44%)] Loss: 0.00969 (QuantReg: 0.14006) QuantErr: 0.14006 batch_time=0.43343
Train Epoch: 15 [122/250 15616/32000 (49%)] Loss: 0.00699 (QuantReg: 0.13780) QuantErr: 0.13780 batch_time=0.43340
Train Epoch: 15 [133/250 17024/32000 (53%)] Loss: 0.00533 (QuantReg: 0.13807) QuantErr: 0.13807 batch_time=0.42138
Train Epoch: 15 [144/250 18432/32000 (58%)] Loss: 0.00468 (QuantReg: 0.13784) QuantErr: 0.13784 batch_time=0.65655
Train Epoch: 15 [155/250 19840/32000 (62%)] Loss: 0.00407 (QuantReg: 0.13916) QuantErr: 0.13916 batch_time=0.64198
Train Epoch: 15 [166/250 21248/32000 (66%)] Loss: 0.00470 (QuantReg: 0.14090) QuantErr: 0.14090 batch_time=0.41993
Train Epoch: 15 [177/250 22656/32000 (71%)] Loss: 0.00544 (QuantReg: 0.13822) QuantErr: 0.13822 batch_time=0.42368
Train Epoch: 15 [188/250 24064/32000 (75%)] Loss: 0.00576 (QuantReg: 0.13967) QuantErr: 0.13967 batch_time=0.43446
Train Epoch: 15 [199/250 25472/32000 (80%)] Loss: 0.00519 (QuantReg: 0.13878) QuantErr: 0.13878 batch_time=2.08424
Train Epoch: 15 [210/250 26880/32000 (84%)] Loss: 0.00503 (QuantReg: 0.14192) QuantErr: 0.14192 batch_time=2.69890
Train Epoch: 15 [221/250 28288/32000 (88%)] Loss: 0.00575 (QuantReg: 0.14227) QuantErr: 0.14227 batch_time=0.45158
Train Epoch: 15 [232/250 29696/32000 (93%)] Loss: 0.00629 (QuantReg: 0.14129) QuantErr: 0.14129 batch_time=0.42324
Train Epoch: 15 [243/250 31104/32000 (97%)] Loss: 0.00459 (QuantReg: 0.14213) QuantErr: 0.14213 batch_time=0.42042
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch15.pth ...
Done in 3.765s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch15.pth ...
Done in 12.667s
removing stale ckpt [epoch 14] [took 0.00s]
epoch : 15
loss : 0.005177894592285156
quant_reg : 0.13989657413959503
quant_err : 0.13989657413959503
learning_rate : 2.4383748955776477e-05
n_samples : 480000
n_steps : 3750
MSRVTT_jsfusion_test/t2v_metrics/R1: 13.4
MSRVTT_jsfusion_test/t2v_metrics/R5: 39.4
MSRVTT_jsfusion_test/t2v_metrics/R10: 55.2
MSRVTT_jsfusion_test/t2v_metrics/R50: 85.2
MSRVTT_jsfusion_test/t2v_metrics/MedR: 9.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 30.662
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 30.773722457092664
MSRVTT_jsfusion_test/v2t_metrics/R1: 13.3
MSRVTT_jsfusion_test/v2t_metrics/R5: 40.3
MSRVTT_jsfusion_test/v2t_metrics/R10: 55.6
MSRVTT_jsfusion_test/v2t_metrics/R50: 85.1
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 29.644
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 31.003483479513427
mnt_best : 30.773722457092664
not_improved_count: 0
Train Epoch: 16 [1/250 128/32000 (0%)] Loss: 0.00548 (QuantReg: 0.13935) QuantErr: 0.13935 batch_time=29.40927
Train Epoch: 16 [12/250 1536/32000 (5%)] Loss: 0.00836 (QuantReg: 0.13987) QuantErr: 0.13987 batch_time=0.41768
Train Epoch: 16 [23/250 2944/32000 (9%)] Loss: 0.00433 (QuantReg: 0.13746) QuantErr: 0.13746 batch_time=0.43576
Train Epoch: 16 [34/250 4352/32000 (14%)] Loss: 0.00563 (QuantReg: 0.14029) QuantErr: 0.14029 batch_time=0.42266
Train Epoch: 16 [45/250 5760/32000 (18%)] Loss: 0.00535 (QuantReg: 0.13836) QuantErr: 0.13836 batch_time=0.42589
Train Epoch: 16 [56/250 7168/32000 (22%)] Loss: 0.00413 (QuantReg: 0.13737) QuantErr: 0.13737 batch_time=0.43247
Train Epoch: 16 [67/250 8576/32000 (27%)] Loss: 0.00555 (QuantReg: 0.13750) QuantErr: 0.13750 batch_time=0.98762
Train Epoch: 16 [78/250 9984/32000 (31%)] Loss: 0.00475 (QuantReg: 0.13799) QuantErr: 0.13799 batch_time=0.42100
Train Epoch: 16 [89/250 11392/32000 (36%)] Loss: 0.00486 (QuantReg: 0.13753) QuantErr: 0.13753 batch_time=0.42545
Train Epoch: 16 [100/250 12800/32000 (40%)] Loss: 0.00784 (QuantReg: 0.14048) QuantErr: 0.14048 batch_time=0.46415
Train Epoch: 16 [111/250 14208/32000 (44%)] Loss: 0.00616 (QuantReg: 0.13634) QuantErr: 0.13634 batch_time=0.41996
Train Epoch: 16 [122/250 15616/32000 (49%)] Loss: 0.00568 (QuantReg: 0.13778) QuantErr: 0.13778 batch_time=0.41446
Train Epoch: 16 [133/250 17024/32000 (53%)] Loss: 0.00420 (QuantReg: 0.13964) QuantErr: 0.13964 batch_time=2.07257
Train Epoch: 16 [144/250 18432/32000 (58%)] Loss: 0.00407 (QuantReg: 0.13583) QuantErr: 0.13583 batch_time=0.41899
Train Epoch: 16 [155/250 19840/32000 (62%)] Loss: 0.00470 (QuantReg: 0.14165) QuantErr: 0.14165 batch_time=0.42604
Train Epoch: 16 [166/250 21248/32000 (66%)] Loss: 0.00378 (QuantReg: 0.14087) QuantErr: 0.14087 batch_time=0.42241
Train Epoch: 16 [177/250 22656/32000 (71%)] Loss: 0.00587 (QuantReg: 0.13705) QuantErr: 0.13705 batch_time=0.41921
Train Epoch: 16 [188/250 24064/32000 (75%)] Loss: 0.00346 (QuantReg: 0.14190) QuantErr: 0.14190 batch_time=0.41882
Train Epoch: 16 [199/250 25472/32000 (80%)] Loss: 0.00436 (QuantReg: 0.14323) QuantErr: 0.14323 batch_time=0.42482
Train Epoch: 16 [210/250 26880/32000 (84%)] Loss: 0.00383 (QuantReg: 0.13798) QuantErr: 0.13798 batch_time=1.67223
Train Epoch: 16 [221/250 28288/32000 (88%)] Loss: 0.00411 (QuantReg: 0.13850) QuantErr: 0.13850 batch_time=0.43246
Train Epoch: 16 [232/250 29696/32000 (93%)] Loss: 0.00436 (QuantReg: 0.14011) QuantErr: 0.14011 batch_time=0.43402
Train Epoch: 16 [243/250 31104/32000 (97%)] Loss: 0.00396 (QuantReg: 0.14005) QuantErr: 0.14005 batch_time=0.45933
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch16.pth ...
Done in 15.410s
removing stale ckpt [epoch 15] [took 0.00s]
epoch : 16
loss : 0.004848968505859375
quant_reg : 0.13924625903367996
quant_err : 0.13924625903367996
learning_rate : 2.3164561507987653e-05
n_samples : 512000
n_steps : 4000
MSRVTT_jsfusion_test/t2v_metrics/R1: 13.0
MSRVTT_jsfusion_test/t2v_metrics/R5: 38.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 54.5
MSRVTT_jsfusion_test/t2v_metrics/R50: 85.0
MSRVTT_jsfusion_test/t2v_metrics/MedR: 9.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 31.197
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 30.023943847617524
MSRVTT_jsfusion_test/v2t_metrics/R1: 13.9
MSRVTT_jsfusion_test/v2t_metrics/R5: 40.4
MSRVTT_jsfusion_test/v2t_metrics/R10: 55.8
MSRVTT_jsfusion_test/v2t_metrics/R50: 85.2
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 30.465
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 31.526574701918435
mnt_best : 30.773722457092664
not_improved_count: 1
Train Epoch: 17 [1/250 128/32000 (0%)] Loss: 0.00345 (QuantReg: 0.13740) QuantErr: 0.13740 batch_time=26.55193
Train Epoch: 17 [12/250 1536/32000 (5%)] Loss: 0.00432 (QuantReg: 0.14018) QuantErr: 0.14018 batch_time=0.43994
Train Epoch: 17 [23/250 2944/32000 (9%)] Loss: 0.00340 (QuantReg: 0.13908) QuantErr: 0.13908 batch_time=0.44485
Train Epoch: 17 [34/250 4352/32000 (14%)] Loss: 0.00351 (QuantReg: 0.13848) QuantErr: 0.13848 batch_time=0.44574
Train Epoch: 17 [45/250 5760/32000 (18%)] Loss: 0.00359 (QuantReg: 0.14118) QuantErr: 0.14118 batch_time=0.42470
Train Epoch: 17 [56/250 7168/32000 (22%)] Loss: 0.00559 (QuantReg: 0.14113) QuantErr: 0.14113 batch_time=0.65325
Train Epoch: 17 [67/250 8576/32000 (27%)] Loss: 0.00323 (QuantReg: 0.13792) QuantErr: 0.13792 batch_time=1.47987
Train Epoch: 17 [78/250 9984/32000 (31%)] Loss: 0.00658 (QuantReg: 0.13919) QuantErr: 0.13919 batch_time=0.42075
Train Epoch: 17 [89/250 11392/32000 (36%)] Loss: 0.00562 (QuantReg: 0.14136) QuantErr: 0.14136 batch_time=0.42213
Train Epoch: 17 [100/250 12800/32000 (40%)] Loss: 0.00331 (QuantReg: 0.14319) QuantErr: 0.14319 batch_time=0.43239
Train Epoch: 17 [111/250 14208/32000 (44%)] Loss: 0.00540 (QuantReg: 0.13826) QuantErr: 0.13826 batch_time=0.43028
Train Epoch: 17 [122/250 15616/32000 (49%)] Loss: 0.00436 (QuantReg: 0.13983) QuantErr: 0.13983 batch_time=0.44433
Train Epoch: 17 [133/250 17024/32000 (53%)] Loss: 0.00422 (QuantReg: 0.13997) QuantErr: 0.13997 batch_time=5.18399
Train Epoch: 17 [144/250 18432/32000 (58%)] Loss: 0.00566 (QuantReg: 0.13948) QuantErr: 0.13948 batch_time=0.41639
Train Epoch: 17 [155/250 19840/32000 (62%)] Loss: 0.00313 (QuantReg: 0.13938) QuantErr: 0.13938 batch_time=0.42994
Train Epoch: 17 [166/250 21248/32000 (66%)] Loss: 0.00538 (QuantReg: 0.13977) QuantErr: 0.13977 batch_time=0.42445
Train Epoch: 17 [177/250 22656/32000 (71%)] Loss: 0.00376 (QuantReg: 0.13628) QuantErr: 0.13628 batch_time=0.41693
Train Epoch: 17 [188/250 24064/32000 (75%)] Loss: 0.00506 (QuantReg: 0.13930) QuantErr: 0.13930 batch_time=0.43143
Train Epoch: 17 [199/250 25472/32000 (80%)] Loss: 0.00444 (QuantReg: 0.14097) QuantErr: 0.14097 batch_time=0.45575
Train Epoch: 17 [210/250 26880/32000 (84%)] Loss: 0.00634 (QuantReg: 0.13657) QuantErr: 0.13657 batch_time=0.41982
Train Epoch: 17 [221/250 28288/32000 (88%)] Loss: 0.00251 (QuantReg: 0.14023) QuantErr: 0.14023 batch_time=0.44171
Train Epoch: 17 [232/250 29696/32000 (93%)] Loss: 0.00437 (QuantReg: 0.14047) QuantErr: 0.14047 batch_time=0.44690
Train Epoch: 17 [243/250 31104/32000 (97%)] Loss: 0.00402 (QuantReg: 0.14004) QuantErr: 0.14004 batch_time=0.42745
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch17.pth ...
Done in 3.991s
removing stale ckpt [epoch 16] [took 0.00s]
epoch : 17
loss : 0.004515228271484375
quant_reg : 0.13968290811777115
quant_err : 0.13968290811777115
learning_rate : 2.2006333432588268e-05
n_samples : 544000
n_steps : 4250
MSRVTT_jsfusion_test/t2v_metrics/R1: 12.9
MSRVTT_jsfusion_test/t2v_metrics/R5: 37.9
MSRVTT_jsfusion_test/t2v_metrics/R10: 55.6
MSRVTT_jsfusion_test/t2v_metrics/R50: 85.0
MSRVTT_jsfusion_test/t2v_metrics/MedR: 9.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 32.007000000000005
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 30.067771231167104
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.7
MSRVTT_jsfusion_test/v2t_metrics/R5: 41.9
MSRVTT_jsfusion_test/v2t_metrics/R10: 57.0
MSRVTT_jsfusion_test/v2t_metrics/R50: 85.7
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 29.661
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 31.186324957100933
mnt_best : 30.773722457092664
not_improved_count: 2
Train Epoch: 18 [1/250 128/32000 (0%)] Loss: 0.00304 (QuantReg: 0.13979) QuantErr: 0.13979 batch_time=32.09628
Train Epoch: 18 [12/250 1536/32000 (5%)] Loss: 0.00514 (QuantReg: 0.13777) QuantErr: 0.13777 batch_time=0.42658
Train Epoch: 18 [23/250 2944/32000 (9%)] Loss: 0.00623 (QuantReg: 0.14103) QuantErr: 0.14103 batch_time=0.43136
Train Epoch: 18 [34/250 4352/32000 (14%)] Loss: 0.00361 (QuantReg: 0.14139) QuantErr: 0.14139 batch_time=0.43933
Train Epoch: 18 [45/250 5760/32000 (18%)] Loss: 0.00345 (QuantReg: 0.13933) QuantErr: 0.13933 batch_time=0.45242
Train Epoch: 18 [56/250 7168/32000 (22%)] Loss: 0.00520 (QuantReg: 0.14110) QuantErr: 0.14110 batch_time=0.43591
Train Epoch: 18 [67/250 8576/32000 (27%)] Loss: 0.00430 (QuantReg: 0.14019) QuantErr: 0.14019 batch_time=0.45944
Train Epoch: 18 [78/250 9984/32000 (31%)] Loss: 0.00437 (QuantReg: 0.14238) QuantErr: 0.14238 batch_time=0.44723
Train Epoch: 18 [89/250 11392/32000 (36%)] Loss: 0.00414 (QuantReg: 0.13976) QuantErr: 0.13976 batch_time=0.43262
Train Epoch: 18 [100/250 12800/32000 (40%)] Loss: 0.00670 (QuantReg: 0.14000) QuantErr: 0.14000 batch_time=0.43130
Train Epoch: 18 [111/250 14208/32000 (44%)] Loss: 0.00439 (QuantReg: 0.13936) QuantErr: 0.13936 batch_time=0.42613
Train Epoch: 18 [122/250 15616/32000 (49%)] Loss: 0.00233 (QuantReg: 0.14014) QuantErr: 0.14014 batch_time=0.50082
Train Epoch: 18 [133/250 17024/32000 (53%)] Loss: 0.00490 (QuantReg: 0.13966) QuantErr: 0.13966 batch_time=0.42805
Train Epoch: 18 [144/250 18432/32000 (58%)] Loss: 0.00539 (QuantReg: 0.13905) QuantErr: 0.13905 batch_time=0.79641
Train Epoch: 18 [155/250 19840/32000 (62%)] Loss: 0.00334 (QuantReg: 0.14093) QuantErr: 0.14093 batch_time=0.43172
Train Epoch: 18 [166/250 21248/32000 (66%)] Loss: 0.00541 (QuantReg: 0.14094) QuantErr: 0.14094 batch_time=0.42627
Train Epoch: 18 [177/250 22656/32000 (71%)] Loss: 0.00452 (QuantReg: 0.13779) QuantErr: 0.13779 batch_time=0.41654
Train Epoch: 18 [188/250 24064/32000 (75%)] Loss: 0.00319 (QuantReg: 0.13991) QuantErr: 0.13991 batch_time=0.42476
Train Epoch: 18 [199/250 25472/32000 (80%)] Loss: 0.00639 (QuantReg: 0.13934) QuantErr: 0.13934 batch_time=0.42459
Train Epoch: 18 [210/250 26880/32000 (84%)] Loss: 0.00383 (QuantReg: 0.14025) QuantErr: 0.14025 batch_time=0.43332
Train Epoch: 18 [221/250 28288/32000 (88%)] Loss: 0.00414 (QuantReg: 0.13852) QuantErr: 0.13852 batch_time=0.42591
Train Epoch: 18 [232/250 29696/32000 (93%)] Loss: 0.00277 (QuantReg: 0.13812) QuantErr: 0.13812 batch_time=0.44014
Train Epoch: 18 [243/250 31104/32000 (97%)] Loss: 0.00367 (QuantReg: 0.13927) QuantErr: 0.13927 batch_time=0.42510
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch18.pth ...
Done in 3.968s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch18.pth ...
Done in 7.728s
removing stale ckpt [epoch 17] [took 0.00s]
epoch : 18
loss : 0.004371391296386719
quant_reg : 0.1397896457314491
quant_err : 0.1397896457314491
learning_rate : 2.0906016760958855e-05
n_samples : 576000
n_steps : 4500
MSRVTT_jsfusion_test/t2v_metrics/R1: 14.2
MSRVTT_jsfusion_test/t2v_metrics/R5: 41.2
MSRVTT_jsfusion_test/t2v_metrics/R10: 56.5
MSRVTT_jsfusion_test/t2v_metrics/R50: 86.3
MSRVTT_jsfusion_test/t2v_metrics/MedR: 8.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 30.643
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 32.09307537216633
MSRVTT_jsfusion_test/v2t_metrics/R1: 12.9
MSRVTT_jsfusion_test/v2t_metrics/R5: 42.1
MSRVTT_jsfusion_test/v2t_metrics/R10: 56.0
MSRVTT_jsfusion_test/v2t_metrics/R50: 86.5
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0
MSRVTT_jsfusion_test/v2t_metrics/MeanR: 29.135
MSRVTT_jsfusion_test/v2t_metrics/geometric_mean_R1-R5-R10: 31.2142768322632
mnt_best : 32.09307537216633
not_improved_count: 0
Train Epoch: 19 [1/250 128/32000 (0%)] Loss: 0.00529 (QuantReg: 0.13724) QuantErr: 0.13724 batch_time=29.81985
Train Epoch: 19 [12/250 1536/32000 (5%)] Loss: 0.00514 (QuantReg: 0.14043) QuantErr: 0.14043 batch_time=0.43638
Train Epoch: 19 [23/250 2944/32000 (9%)] Loss: 0.00486 (QuantReg: 0.13918) QuantErr: 0.13918 batch_time=0.43271
Train Epoch: 19 [34/250 4352/32000 (14%)] Loss: 0.00358 (QuantReg: 0.13909) QuantErr: 0.13909 batch_time=0.64884
Train Epoch: 19 [45/250 5760/32000 (18%)] Loss: 0.00361 (QuantReg: 0.14032) QuantErr: 0.14032 batch_time=0.74055
Train Epoch: 19 [56/250 7168/32000 (22%)] Loss: 0.00393 (QuantReg: 0.13718) QuantErr: 0.13718 batch_time=0.42623
Train Epoch: 19 [67/250 8576/32000 (27%)] Loss: 0.00312 (QuantReg: 0.13906) QuantErr: 0.13906 batch_time=0.41960
Train Epoch: 19 [78/250 9984/32000 (31%)] Loss: 0.00397 (QuantReg: 0.13884) QuantErr: 0.13884 batch_time=0.43258
Train Epoch: 19 [89/250 11392/32000 (36%)] Loss: 0.00319 (QuantReg: 0.13745) QuantErr: 0.13745 batch_time=0.42275
Train Epoch: 19 [100/250 12800/32000 (40%)] Loss: 0.00565 (QuantReg: 0.13855) QuantErr: 0.13855 batch_time=0.41502
Train Epoch: 19 [111/250 14208/32000 (44%)] Loss: 0.00434 (QuantReg: 0.14065) QuantErr: 0.14065 batch_time=0.41567
Train Epoch: 19 [122/250 15616/32000 (49%)] Loss: 0.00330 (QuantReg: 0.14028) QuantErr: 0.14028 batch_time=0.45512
Train Epoch: 19 [133/250 17024/32000 (53%)] Loss: 0.00361 (QuantReg: 0.13903) QuantErr: 0.13903 batch_time=0.43780
Train Epoch: 19 [144/250 18432/32000 (58%)] Loss: 0.00649 (QuantReg: 0.13694) QuantErr: 0.13694 batch_time=1.14480
Train Epoch: 19 [155/250 19840/32000 (62%)] Loss: 0.00303 (QuantReg: 0.13749) QuantErr: 0.13749 batch_time=0.41611
Train Epoch: 19 [166/250 21248/32000 (66%)] Loss: 0.00422 (QuantReg: 0.13714) QuantErr: 0.13714 batch_time=0.42216
Train Epoch: 19 [177/250 22656/32000 (71%)] Loss: 0.00391 (QuantReg: 0.13833) QuantErr: 0.13833 batch_time=0.43857
Train Epoch: 19 [188/250 24064/32000 (75%)] Loss: 0.00492 (QuantReg: 0.14136) QuantErr: 0.14136 batch_time=0.43687
Train Epoch: 19 [199/250 25472/32000 (80%)] Loss: 0.00362 (QuantReg: 0.13601) QuantErr: 0.13601 batch_time=0.43075
Train Epoch: 19 [210/250 26880/32000 (84%)] Loss: 0.00301 (QuantReg: 0.13910) QuantErr: 0.13910 batch_time=0.43122
Train Epoch: 19 [221/250 28288/32000 (88%)] Loss: 0.00440 (QuantReg: 0.13818) QuantErr: 0.13818 batch_time=0.42171
Train Epoch: 19 [232/250 29696/32000 (93%)] Loss: 0.00616 (QuantReg: 0.14068) QuantErr: 0.14068 batch_time=0.43678
Train Epoch: 19 [243/250 31104/32000 (97%)] Loss: 0.00484 (QuantReg: 0.13977) QuantErr: 0.13977 batch_time=0.48380
Saving checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch19.pth ...
Done in 4.300s
Updating 'best' checkpoint: /apdcephfs/share_47076/gimwang/HCQ/exps/JPQ_MSRVTT_1kA/checkpoint-epoch19.pth ...
Done in 8.173s
removing stale ckpt [epoch 18] [took 0.00s]
epoch : 19
loss : 0.004342544555664063
quant_reg : 0.1390343315601349
quant_err : 0.1390343315601349
learning_rate : 1.986071592291091e-05
n_samples : 608000
n_steps : 4750
MSRVTT_jsfusion_test/t2v_metrics/R1: 15.5
MSRVTT_jsfusion_test/t2v_metrics/R5: 40.1
MSRVTT_jsfusion_test/t2v_metrics/R10: 55.6
MSRVTT_jsfusion_test/t2v_metrics/R50: 85.0
MSRVTT_jsfusion_test/t2v_metrics/MedR: 8.0
MSRVTT_jsfusion_test/t2v_metrics/MeanR: 31.544
MSRVTT_jsfusion_test/t2v_metrics/geometric_mean_R1-R5-R10: 32.572439602057194
MSRVTT_jsfusion_test/v2t_metrics/R1: 14.0
MSRVTT_jsfusion_test/v2t_metrics/R5: 41.2
MSRVTT_jsfusion_test/v2t_metrics/R10: 55.4
MSRVTT_jsfusion_test/v2t_metrics/R50: 85.7
MSRVTT_jsfusion_test/v2t_metrics/MedR: 8.0