I’m Jeff Caruso, an author and researcher focusing on Cyber Warfare and AI. The third edition of my book “Inside Cyber Warfare” (O’Reilly, 2009, 2011, 2024) will be out this fall. I was a Russia Subject Matter Expert contracted with the CIA’s Open Source Center, provided numerous cyber briefings to U.S. government agencies, and I’ve been a frequent lecturer at the U.S. Air Force Institute of Technology and the U.S. Army War College.
Caruso
Karma: 4
This is an interesting #OpenPhil grant. $230K for a cyber threat intelligence researcher to create a database that tracks instances of users attempting to misuse large language models.
https://www.openphilanthropy.org/grants/lee-foster-llm-misuse-database/
Will user data be shared with the user’s permission? How will an LLM determine the intent of the user when it comes to differentiating between purposeful harmful entries versus user error, safety testing, independent red-teaming, playful entries, etc. If a user is placed on the database, is she notified? How long do you stay in LLM prison?
I did send an email to OpenPhil asking about this grant, but so far I haven’t heard anything back.
Caruso’s Quick takes
I love this series and I’m sorry to see that you haven’t continued it. The rapid growth of AI Safety organizations and the amount of insider information and conflicts of interest is kind of mind boggling. There should be more of this type of informed reporting, not less.
Thanks for the link to Open Asteroid Impact. That’s some really funny satire. :-D