RSS

Shen Zhou Hong

Karma: 11

Hello! I’m Shen, Data Scientist and AI Safety Researcher. I design large-scale randomized controlled trials (RCTs) and other human uplift studies to evaluate the biological capabilities of frontier AI. With an interdisciplinary background in clinical trials, computer science, applied mathematics and human subject research, I help ground AI capability evaluations in realistic experiments under field conditions.

At Active Site, I work across the entire research pipeline: from IRB review, pre-registration, trial operations, blinded statistical analysis plan (SAP), to final results. I care very strongly about rigorous evidentiary practices in human uplift studies. I design our RCTs using the same standards as clinical trials (SPIRIT, CONSORT, ICH). Blinding, randomization, the use of ICH E9 (R1) addendum estimands, we do it all!

In our most recent work, we conducted a large-scale (n=153) RCT to evaluate whether AI improves novice performance on a set of laboratory tasks that collectively model an influenza viral reverse-genetics workflow. That work is now available as “Measuring Mid-2025 LLM-Assistance on Novice Performance in Biology” (arXiv:2602.16703), and was cited by the New York Times, the Economist, and in the model cards of frontier AI labs.

I was previously a researcher at the Johns Hopkins Bloomberg School of Public Health, where I worked on SKOAP – one of the largest clinical trials in osteoarthritis in North America. It was at Hopkins where I learned how to use REDCap, the importance of outcome adjudication, registered SAPs, and the best practices of a gold-standard, confirmatory trial.

On the technical side, I was a member of Columbia University’s PRAISE lab, an AI research group dedicated to the interpretability of ML models in medicine. Led by Dr. Ansaf Salleb-Aouissi, I worked on using influence functions to improve the interpretability of SVM models in predicting pre-eclampsia. I have some experience with PyTorch, and familiarity with the Python ML ecosystem.

I have a BA in Philosophy, Literature, and the Natural Sciences from St. John’s College, a BSc. in Computer Science (1st Class Honors) from the University of London, and I studied mathematics at Columbia University. I am currently pursuing a (part-time) MSc. in Applied and Computational Mathematics at Johns Hopkins University, with a focus on causal inference and the design of experiments.