File tree Expand file tree Collapse file tree 3 files changed +3
-199
lines changed Expand file tree Collapse file tree 3 files changed +3
-199
lines changed Original file line number Diff line number Diff line change @@ -9,7 +9,7 @@ pip install -r requirements.txt
9
9
10
10
## Training
11
11
12
- To fine-tune BERT on a specific dataset, run the following command (we are using the ` SST2 ` dataset in this example):
12
+ To fine-tune BERT on a specific dataset, run the following command (we are using the SST2 dataset in this example):
13
13
14
14
``` bash
15
15
python train.py --dataset_name sst2 \
@@ -36,7 +36,7 @@ python analyze.py --dataset_name sst2 \
36
36
--factor_strategy ekfac
37
37
```
38
38
39
- On an A100 (80GB), it takes roughly 95 minutes to compute the pairwise scores for ` SST2 ` (including computing EKFAC factors):
39
+ On an A100 (80GB), it takes roughly 90 minutes to compute the pairwise scores for SST2 (including computing EKFAC factors):
40
40
41
41
```
42
42
----------------------------------------------------------------------------------------------------------------------------------
Load Diff This file was deleted.
Original file line number Diff line number Diff line change @@ -36,7 +36,7 @@ python analyze.py --factor_batch_size 128 \
36
36
```
37
37
38
38
Alternative options for ` factor_strategy ` include ` identity ` , ` diagonal ` , and ` kfac ` .
39
- On an A100 (80GB), computing the pairwise scores (including EKFAC factors) takes approximately 3 hours:
39
+ On an A100 (80GB), computing the pairwise scores (including EKFAC factors) takes approximately 10 hours:
40
40
41
41
```
42
42
----------------------------------------------------------------------------------------------------------------------------------
You can’t perform that action at this time.
0 commit comments