Agent Effectiveness: Measure the ROI of AI
Tracks autonomy ratio, token economics, tool usage, adoption metrics, and per-user productivity. Answers the ROI question with data, not vibes.
Agent EffectivenessUnderstand the velocity of your software factory.
FiltersLast 90 days
- FSC / PR
- 208down 18%
- FSC / Issue
- 241down 12%
- FSC / Project
- 9.4Kdown 7%
- Cycle Time
- 2.6ddown 21%
- FSC / Point
- 97down 9%
- Points / Project
- 41up 6%
Throughput over time
FSC (left axis)Merged PRs (right axis)
Marker shows when the organization onboarded to Factory.
Completed issues by user
- Priya Raman184
- Marcus Lee162
- Ana Duarte141
- Jonah Weiss127
- Sofia Okafor109
- Theo Nakamura96
- Lena Fischer74
Completed issues by project
- Checkout v2212
- Billing migration176
- Search relevance149
- Mobile onboarding118
- Kubernetes upgrade97
- Design system tokens81
- Data pipeline hardening63
Illustrative sample data from the Agent Effectiveness dashboard in the Factory app.
Autonomy ratio
Measures how much independent work Droids do between human interactions. The core metric for understanding AI leverage across your engineering team.
Token economics
Track cost per PR, tokens per commit, and model usage across your organization. Understand and optimize your AI spend with granular breakdowns.
Productivity output
PRs shipped, commits generated, lines of code, and files touched. Connect AI usage directly to shipped code with prompt-to-commit tracing.
Adoption and stickiness
DAU, WAU, and stickiness metrics show how deeply your team has adopted AI-native workflows. Track skill usage and surface growth opportunities.
Per-user breakdowns
See how individual engineers and teams leverage Droids. Identify power users, find adoption gaps, and tailor onboarding.
OTEL export
Export all telemetry via OpenTelemetry for integration with your existing observability stack. MCP telemetry, tool usage, and session data included.
One platform. Every workflow.
Consistent memory, no switching
Droids keep their knowledge across tools and platforms. They can follow you through your workflow without losing context.
Droids where you need them
Terminal and IDE to collaborate. Browser, Slack, Jira to delegate. CLI to automate.
Start small, scale fast
Begin within the IDE, and expand into your full workflow, from design docs to review automation.
“Factory is the future of software engineering—where AI handles the heavy lifting, and humans guide the vision, gaining extraordinary leverage with every line of code. ”
Justin Ammerlaan
CTO, Tilt
