File tree Expand file tree Collapse file tree 1 file changed +3
-2
lines changed Expand file tree Collapse file tree 1 file changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -4,10 +4,10 @@ Welcome to Basemath, an open-source implementation of the statistical test beari
4
4
AB experiments.
5
5
6
6
Basemath employs a one-sided testing approach, where the null hypothesis posits that the treatment performs either
7
- equally or worse than the control concerning the target metric. The test has a predetermined maximum runtime determined
7
+ equally or worse than the control concerning the target metric. The test has a predetermined maximum sample size determined
8
8
by the input parameters. Additionally, it ensures that both type I and type II errors remain below specified error
9
9
thresholds, denoted as α and β, respectively. Basemath assesses the experiment in batches and terminates prematurely
10
- if it can reject the null hypothesis. The β-spending function employed is is O’Brien-Fleming-like.
10
+ if it can not reject the null hypothesis. The β-spending function employed is O’Brien-Fleming-like.
11
11
Given that the majority of experiments yield either flat or negative results, stopping early in this scenario saves more
12
12
running time compared to stopping in the less common case of a significant uplift.
13
13
@@ -61,6 +61,7 @@ bm_test.evaluate_experiment(
61
61
customer_delta_since_yesterday,
62
62
previous_visitor_number,
63
63
visitors_since_yesterday
64
+ )
64
65
```
65
66
66
67
The parameters for this method are:
You can’t perform that action at this time.
0 commit comments