ArtificialAnalysis /
aa-agentperf-local
Benchmark local LLM serving by replaying real agent trajectories
Updated 35 min ago
+15 stars gained this week
Stars gained each day, last 30 days
Usual pace · 3 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
A Python tool that benchmarks how fast a local LLM server handles AI agent workloads, by replaying recorded agent conversations against an OpenAI-compatible endpoint. It reports throughput and latency, not output quality.
Summary written by AI from the repository’s description and README.
ArtificialAnalysis / aa-agentperf-local
View on GitHub(opens in new tab)