Originally published on thomaskalnik.comhttps://www.thomaskalnik.com/posts/agent-evals-online-offline-braintrust-langsmith-datadog.
I have set up evals for two very different systems. The first was the chat agent in Spotter Studio, a now-retired too...