Dan Siwiec

How we made evals 100× cheaper with multi-agent architecture

When our evals became too expensive and slow to run, we rearchitected our single investigation agent into a team of ~40 loosely coupled agents. While there are some tradeoffs, it’s made evals run 5x faster for cents on the dollar, and we can experiment much more rapidly to evolve our product.