diff options
| -rw-r--r-- | README.md | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -16,7 +16,7 @@ While the velocity for each dimension in our system (x, y, z) has a normal distr Chi^2 is used to test the null hypothesis of "no difference" among categorical variables in AB testing because it measures generalized, non-directional chaos among all dimensions of the system. If your distrubtions from the dimensions are similar, it should converge to be highly-chaotic & high-energy, as stated by the second law of thermodynamics. By contrast, if your underlying distrubtions create an immensely low-chaotic (i.e. low-energy state), then it's highly likely these underlying distrubtions are different. -Relating to AB testing, when you argue that, for chi^2, "if the p-value is less than 0.05, then the null hypothesis is rejected", you are saying that "if the probability of finding these distriubtions with such low choas and I found it (in your sampleA vs sampleB calculations), then it's highly unlinkely this state is a coincidence (violates the second law of thermodynamics) and the null hypothesis can be rejected (i.e. these distributions are not the same)." +Relating to AB testing, when you argue that, for chi^2, "if the p-value is less than 0.05, then the null hypothesis is rejected", you are saying that "if the probability of finding these distriubtions with such small choas is so low and I found it, then it's highly unlikely this state is a coincidence (violates the second law of thermodynamics) and the null hypothesis can be rejected (i.e. these distributions are not the same)." In theory, for performing a hypothesis test with categorical variables, we take each dimension to be the difference between the normal distrubtions (of differences in observed-expected) of the samples. This encapsulates the difference between the distrubtions into a normal curve, which we combine into the chi^2 curve (visuals helps this explanation, see video). |