if I read footnote 2 right, the implication is that by end of 2025, you’d aim to be able to detect a pathogen that sheds like Influenza A in cities you monitor before 2% of the population is infected?
Yes, that’s right. Though sensitivity in practice could be higher or lower:
As we gather more data we’ll get a better understanding of how easy or hard it is to detect Influenza A, along with other pathogens. Our influenza estimates are based on ~300 observations, but we now have the data to estimate for the 2024-2025 flu season with a lot more data. This is mostly a matter of someone taking the time to dig into it and put out an updated estimate.
We’re still trying to increase sensitivity:
Testing better wet lab methods
Getting pooled airplane lavatory samples again, which have a ~20x higher human contribution
Figuring out which municipal sewersheds have the highest human contribution and focusing there
The projection is based on an assumption of 9d end to end time, and is relatively sensitive to timing: if your pathogen doubles every 3d then the difference between a 9d and 12d turnaround time is 2x sensitivity. We’re currently well above 9d, but we’re on a track to get to ~7d via agreements with sequencing machine operators to reserve capacity and streamlining our processes. And then there are more expensive ways to get down to ~4d with serious investment in logistics (buy your own sequencer, run it daily, use the 10B flow cell for faster turnarounds, lab runs around the clock).
I assume one weakness of this approach is in the geographic restrictions. Although I’ve vaguely heard of wastewater monitoring in a network of airports / aircrafts as a way to get around this (I can’t tell if that’s just an idea right now or if it’s already being implemented, though.)
Yes, that’s a real issue. Cosmopolitan US cities are not terrible from this perspective, especially if you have a bunch with different international connections, but they’re still not good enough. Airplane lavatory sampling would be much better, not just because of this issue but also because (as I mentioned briefly above) they’re much higher quality samples. We’re working on this, but it’s much more difficult than bringing on municipal treatment plant partners.
Was the 2% threshold chosen for a particular reason?
No, it’s that 3x 25B is about the most we’re able to scale to at this stage. If we thought we could manage the scale 1% would have probably been our target, though 1% is still pretty arbitrary. Lower is better, since that means mitigations are more effective when deployed, but cost goes up dramatically as you lower your target.
Do you think 1% is very useful in practise? That seems very high to me and I would have thought by that stage we would know through other means already? Or is the plan to lower the threshold as the tech improves and aim for something lower?
I agree 1% high, and I wish it were lower. On the other hand, we’re specifically targeting stealth pathogens: ones where any distinctive symptoms come well after someone becomes contagious. Absent a monitoring system, you could be in a situation most people had been infected before anyone noticed there was something spreading. Flagging this sort of pathogen at 1% cumulative incidence still gives some time for rapid mitigations, though it’s definitely too late to nip it in the bud.
Yes, that’s right. Though sensitivity in practice could be higher or lower:
As we gather more data we’ll get a better understanding of how easy or hard it is to detect Influenza A, along with other pathogens. Our influenza estimates are based on ~300 observations, but we now have the data to estimate for the 2024-2025 flu season with a lot more data. This is mostly a matter of someone taking the time to dig into it and put out an updated estimate.
We’re still trying to increase sensitivity:
Testing better wet lab methods
Getting pooled airplane lavatory samples again, which have a ~20x higher human contribution
Figuring out which municipal sewersheds have the highest human contribution and focusing there
The projection is based on an assumption of 9d end to end time, and is relatively sensitive to timing: if your pathogen doubles every 3d then the difference between a 9d and 12d turnaround time is 2x sensitivity. We’re currently well above 9d, but we’re on a track to get to ~7d via agreements with sequencing machine operators to reserve capacity and streamlining our processes. And then there are more expensive ways to get down to ~4d with serious investment in logistics (buy your own sequencer, run it daily, use the 10B flow cell for faster turnarounds, lab runs around the clock).
Chicago IL, Riverside CA, and several others we hope to be able to name publicly soon.
Yes, that’s a real issue. Cosmopolitan US cities are not terrible from this perspective, especially if you have a bunch with different international connections, but they’re still not good enough. Airplane lavatory sampling would be much better, not just because of this issue but also because (as I mentioned briefly above) they’re much higher quality samples. We’re working on this, but it’s much more difficult than bringing on municipal treatment plant partners.
No, it’s that 3x 25B is about the most we’re able to scale to at this stage. If we thought we could manage the scale 1% would have probably been our target, though 1% is still pretty arbitrary. Lower is better, since that means mitigations are more effective when deployed, but cost goes up dramatically as you lower your target.
Do you think 1% is very useful in practise? That seems very high to me and I would have thought by that stage we would know through other means already? Or is the plan to lower the threshold as the tech improves and aim for something lower?
I agree 1% high, and I wish it were lower. On the other hand, we’re specifically targeting stealth pathogens: ones where any distinctive symptoms come well after someone becomes contagious. Absent a monitoring system, you could be in a situation most people had been infected before anyone noticed there was something spreading. Flagging this sort of pathogen at 1% cumulative incidence still gives some time for rapid mitigations, though it’s definitely too late to nip it in the bud.