Recent posts tagged evals

Recently, TypeSafe launched Jev, the first of what people are calling System One or decision models: your app sends state plus a query, and Jev sends back typed decisions with probabilities instead of prose. All with a sub-second response time, $0.04...

Originally published on thomaskalnik.comhttps://www.thomaskalnik.com/posts/agent-evals-online-offline-braintrust-langsmith-datadog. I have set up evals for two very different systems. The first was the chat agent in Spotter Studio, a now-retired too...

Part 2: https://dev.to/lbobylev/baseline-for-spring-ai-evals-catching-silent-degradation-4ll6 When building an AI agent, there is usually a moment when the prompt seems to work. But as development continues, this can quickly get out of control. Toda...

Test-Driven Development (TDD) has been a cornerstone of quality software engineering for decades. But as we enter the age of AI-assisted development and large language models, does TDD still hold relevance? The answer is a resounding yes—and perhaps...