Thank you both!
We are planning to keep spreadsheets as the primary format for our models (for transparency/âsimplicity reasons like you both noted). However, some way to convert spreadsheets to code for LLM digestion and potentially building web apps or running more complex uncertainty analyses would be valuable to us.
Definitely not asking anyone to spend time on this for us! I was just wondering if anyone was aware of a good way to do the conversion.
Hi, Todd! Thank you for engaging with our work and writing up what you found.
Since that original post, weâve also built a multi-agent system for red teaming that performs better than the one we described in our post. We made some different decisions around model architecture (most of our agents represent different red teaming âpersonasâ as well as a few quality control stages) and Iâd be curious to hear more about how you approach these architecture decisions.
Iâll reach out about a quick call!