A scorecard is a shareable summary of how well an agent is doing — the kind of one-page view you'd send to a stakeholder who asks "is it ready?" or "how's it performing?". It takes the results from your evals and presents them as clear metrics anyone can read, without needing access to the studio.
What the metrics mean
A scorecard centers on three numbers that together tell you whether an agent is good, fast, and affordable:
| Metric | What it tells you |
|---|---|
| Accuracy % | The share of test cases the agent got right. Higher is better — this is your headline quality number. |
| Cost per turn | The average cost of one back-and-forth with the agent. Lower means the agent is cheaper to run at scale. |
| Latency | How long the agent takes to respond, on average. Lower means a snappier experience for your customers. |
Read them together: a high accuracy with a high cost or slow latency may be worth tuning, and a fast, cheap agent that scores low on accuracy isn't ready yet. The scorecard puts all three side by side so the trade-offs are obvious.
Where the numbers come from
Scorecards summarize the eval runs you've already set up for an agent. Run your evals first, then build the scorecard from those results.
Create a scorecard
- Open the agent and go to its evals.
- Run the eval set you want to report on so the results are current.
- Choose Create scorecard — Convoship summarizes the run into accuracy, cost per turn, and latency.
- Give it a clear name (for example, the agent name and the date) so it's easy to recognize later.
Create a share link
A share link lets anyone view the scorecard in their browser — no Convoship account required. It's the quickest way to send results to a manager, a client, or a colleague outside your workspace.
- Open the scorecard and choose Share.
- Turn on the share link and copy it.
- Send the link to whoever needs to see the results.
Anyone with the link can view it
A share link is viewable by anyone who has it, so only send it to people who should see the results. You can turn the link off at any time to revoke access immediately.
Export a PDF
When you need a static copy — to attach to an email, drop into a report, or keep as a record — export the scorecard as a PDF.
- Open the scorecard and choose Export PDF.
- Convoship generates a clean, one-page PDF with the headline metrics and the run details.
- Save or share the file like any other document.
The PDF is a snapshot of the results at the moment you exported it — handy for keeping a dated record of how an agent performed before and after a change.