With “variables are simulated freshly for each model”, do you mean that certain probability distributions are re-sampled when performing cause comparisons?
Yeah. If I understand correctly, everything is resampled rather than cached, so comparing results between two models is only done on aggregate rather than on a sample-by-sample basis
With “variables are simulated freshly for each model”, do you mean that certain probability distributions are re-sampled when performing cause comparisons?
Yeah. If I understand correctly, everything is resampled rather than cached, so comparing results between two models is only done on aggregate rather than on a sample-by-sample basis
We used to have a caching layer meant to fix this, but the objective is for there not to be too much inter-run variability.