DEV Community

AI Agent Evaluation Series' Articles

Back to shashank agarwal's Series
How to use System prompts as Ground Truth for Evaluation
Cover image for How to use System prompts as Ground Truth for Evaluation
imshashank profile

How to use System prompts as Ground Truth for Evaluation

#testing #agents #llm #ai
1
Comments
1 min read
Stop Evaluating AI Agents Like ML Models: A Paradigm Shift for Developers
Cover image for Stop Evaluating AI Agents Like ML Models: A Paradigm Shift for Developers
imshashank profile

Stop Evaluating AI Agents Like ML Models: A Paradigm Shift for Developers

#ai #llm #agents #machinelearning
1
Comments
3 min read
Your System Prompt is Your Ground Truth: Ditch Manual Labeling for AI Agent Evaluation
Cover image for Your System Prompt is Your Ground Truth: Ditch Manual Labeling for AI Agent Evaluation
imshashank profile

Your System Prompt is Your Ground Truth: Ditch Manual Labeling for AI Agent Evaluation

#ai #programming #tutorial #agents
1
Comments
3 min read
Beyond Accuracy: The 73+ Dimensions of AI Agent Quality
Cover image for Beyond Accuracy: The 73+ Dimensions of AI Agent Quality
imshashank profile

Beyond Accuracy: The 73+ Dimensions of AI Agent Quality

#ai #agents #machinelearning #programming
Comments
3 min read
How to Analyze AI Agent Traces Like a Detective
Cover image for How to Analyze AI Agent Traces Like a Detective
imshashank profile

How to Analyze AI Agent Traces Like a Detective

#ai #testing #agents #webdev
Comments
3 min read
5 Types of AI Hallucinations (And How to Detect Them)
Cover image for 5 Types of AI Hallucinations (And How to Detect Them)
imshashank profile

5 Types of AI Hallucinations (And How to Detect Them)

#discuss #ai #machinelearning #agents
1
Comments
3 min read
The Hidden Costs of Inefficient AI Agents (And How to Fix Them)
Cover image for The Hidden Costs of Inefficient AI Agents (And How to Fix Them)
imshashank profile

The Hidden Costs of Inefficient AI Agents (And How to Fix Them)

#webdev #ai #programming #devops
Comments 1
2 min read
Is Your AI Agent a Compliance Risk? How to Find Violations Hidden in Traces
Cover image for Is Your AI Agent a Compliance Risk? How to Find Violations Hidden in Traces
imshashank profile

Is Your AI Agent a Compliance Risk? How to Find Violations Hidden in Traces

#privacy #agents #security #ai
Comments
2 min read
How to Build an AI Agent Evaluation Framework That Scales
Cover image for How to Build an AI Agent Evaluation Framework That Scales
imshashank profile

How to Build an AI Agent Evaluation Framework That Scales

#ai #webdev #programming #devops
Comments
3 min read
Monitoring vs. Evaluation: The Critical Distinction Most AI Devs Miss
Cover image for Monitoring vs. Evaluation: The Critical Distinction Most AI Devs Miss
imshashank profile

Monitoring vs. Evaluation: The Critical Distinction Most AI Devs Miss

#ai #webdev #programming #devops
Comments
2 min read
The AI Agent Feedback Loop: From Evaluation to Continuous Improvement
Cover image for The AI Agent Feedback Loop: From Evaluation to Continuous Improvement
imshashank profile

The AI Agent Feedback Loop: From Evaluation to Continuous Improvement

#webdev #ai #programming #devops
Comments
3 min read