I second this question. Intuitively, your argument makes sense and you have something here.
But I would have more confidence in the conclusion if a False Discovery Rate correction was applied. This is also called a Benjamini-Hochberg procedure (https://en.wikipedia.org/wiki/False_discovery_rate#Controlling_procedures).
In R, the stats package makes it very easy to apply the false discovery rate correction to your statistics—see https://stat.ethz.ch/R-manual/R-devel/library/stats/html/p.adjust.html. You would do something like
p.adjust(p, method = “fdr”, n = length(p))
where p is a vector/list of all 55 of your uncorrected p-values from your t-tests.
Current theme: default
Less Wrong (text)
Less Wrong (link)
Arrow keys: Next/previous image
Escape or click: Hide zoomed image
Space bar: Reset image size & position
Scroll to zoom in/out
(When zoomed in, drag to pan; double-click to close)
Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).
]
Keys shown in grey (e.g., ?) do not require any modifier keys.
?
Esc
h
f
a
m
v
c
r
q
t
u
o
,
.
/
s
n
e
;
Enter
[
\
k
i
l
=
-
0
′
1
2
3
4
5
6
7
8
9
→
↓
←
↑
Space
x
z
`
g
I second this question. Intuitively, your argument makes sense and you have something here.
But I would have more confidence in the conclusion if a False Discovery Rate correction was applied. This is also called a Benjamini-Hochberg procedure (https://en.wikipedia.org/wiki/False_discovery_rate#Controlling_procedures).
In R, the stats package makes it very easy to apply the false discovery rate correction to your statistics—see https://stat.ethz.ch/R-manual/R-devel/library/stats/html/p.adjust.html. You would do something like
where p is a vector/list of all 55 of your uncorrected p-values from your t-tests.