coo @ ought.org
jungofthewon
Karma: 230
Working with Andreas (Ought cofounder)
Users can give feedback (thumbs up / down) when they see a wrong answer (image below). We also run evaluation with contractors and test Elicit for our own research.
Yea once we’re done here we might go back over there and write some comments :P I agree that it’s an interesting perspective. I also liked the comments!
Thanks for your question!
I found your factored cognition project really interesting, is anyone still researching this? (besides the implementation in Elicit)
Outside of Elicit, not sure. johnwentworth implied there are new researchers interested in this space.
Are you currently collaborating with other EA orgs doing research?
Nothing formal at the moment but we study a lot of independent EA researchers closely. Researchers at GiveWell and Happier Lives Institute have been particularly helpful recently. In the past, we’ve also worked closely with organizations like CSET, READI, and Effective Thesis.
What are the biggest success stories of people using Elicit?
Unfortunately I don’t have explicit permission to share details about them right now but will try to gesture.
We have many everyday success stories—Elicit saving people a ton of time, helping people ramp up in new domains, showing them research they didn’t find anywhere else (including on Google Scholar).
Elicit helped one researcher refine their PhD dissertation proposal questions, another respond to a last-minute peer review request, another prep an investor presentation, and another find a bunch of different parameters to determine carbon metrics for a forest restoration grant proposal.
You can see some of the success measures & testimonials linked here.
Ought is a team of people, each of whom have their own worldviews, values, and communities. For some Oughters, being an EA is an important part of their identity. Others have only heard about it recently!
I think everyone at Ought cares about being effective and altruistic though :)
This is a live product—not just a demo! You can use it at elicit.org.
More than 45K users have tried it and ~ 10K use it each month. Users say that Elicit saves them ~ 1-2 hours / week. They proactively share positive feedback on places like Twitter and with their colleagues or friends: Elicit’s growth is entirely by word of mouth.
I agree that having people pay for it is one of the greatest indicators of value. We’ll have to balance financial sustainability with the desire to make high-quality accessible.
At some point, we probably will do a more formal evaluation e.g. RCT type study.
We’re experimenting with collecting donations from the individual researchers who use it. We might launch spin-off products in the future that are more commercial or enable Elicit overall to be financially sustainable e.g. an API that lets research orgs run Elicit on their own documents.
Thanks for thinking through this. Did you give this feedback directly to the people and teams you interacted with? If so and if possible to share without identifying too much—how did that go?
I have been ruminating about this issue within EA for ages
You spent too much time in Phase 1 :P
+1, generally excited about recent EA momentum towards doing the thing.
Unsurprisingly, I see Elicit as Phase 2 work and am excited for more Phase 2 work.
Update after reading the rest of it: I actually agree with this so much that I think this can replace large parts of the “user guide” that I aspired to write one day. Thanks for saving me so much time!
This was great, thanks for taking the time to write this up.
This was really helpful, thank you!
https://elicit.ought.org/builder/RT9kxWoF9 My distribution! Good question Linch; it had a fun mix of investigative LinkedIn sleuthing + decomposition + reasoning about Linch + thoughts that I could sense others might disagree with.
I’ll make a distribution. Do you want to make a distribution too and then we can compare?
Non-forecasting question: have you ever felt like an outsider in any of the communities you consider yourself to be a part of?
Which types of forecasting questions do you like / dislike more?
I will forecast a personal question for you e.g. “How many new friends will I make this year?” What do you want to ask me?
Thanks so much for doing this work! I’m pretty excited about making progress on this. If others want to collaborate, please ping jungwon@ought.org.
Highly recommend Insights as well! Pricey though.