Engineering Measurement
Published engineering metrics so far: velocity, quality, cost, CI/CD, reliability, survey data, agent effectiveness, agent readiness, project management, and team performance.
Velocity
- Engineering Output What do Total Output, Output/week, Output/week/eng, and AI Output Share show in the Velocity tab, and how do they relate to other Velocity metrics?
- Output Breakdown How is engineering output split between AI-Assisted, Human-Only, and Agent Output, and how is that split trending over time?
- Quality & Work Mix How is engineering output distributed across Hard, Medium, and Easy PR difficulty tiers, and is AI coding changing that distribution?
- Team Level Breakdown How do we see each engineer's Total, Average, and weekly Output score in the Velocity tab?
Quality
- Quality Metric Tabs Which code quality metrics are available in the Larridin Quality tab, and what do each of the sixteen metric views cover?
- Innovation Rate Chart How does the Innovation Rate chart in the Quality tab differ from the By Output and By PR views, and what does the category breakdown show?
- Team Level Breakdown How do we see each engineer's code quality fields at the individual level per week, including review behavior as both author and reviewer?
Cost
- Total Cost What do the Total Cost figure, trend %, Gross basis, and Actual/Observed toggle show in the Engineering Cost tab?
- Spend by Source Chart How is engineering AI spend distributed across sources week by week, and which platforms are driving the most spend?
- Team Level Breakdown How do we see each engineer's AI tool cost broken down by week and filterable by source in the Cost tab?
CI/CD
- Deployment Frequency What does the Deployment Frequency count show in the CI/CD tab, and how does it relate to the other CI/CD metrics?
- Change Failure Rate What percentage of deployments result in a production failure, and how is that rate trending as AI coding agents increase deployment frequency?
- Deploy MTTR How does Deploy MTTR measure recovery time from deployment failures in the CI/CD tab, and how does it relate to Change Failure Rate?
- Change Lead Time Where in the delivery pipeline is time accumulating, and how does Change Lead Time's stage breakdown show the specific constraint?
- CI Success Rate / Cancellation Rate / Median CI Duration How are CI Success Rate, Cancellation Rate, and Median CI Duration trending as AI coding tools increase pipeline volume?
- CI Run Outcomes Chart Which CI workflows are generating the most failures or cancellations, and when did those patterns emerge?
- Deploy Outcomes Chart How many production deployments are succeeding versus failing over time, and how does that volume relate to the Change Failure Rate?
- Deployment Log Where can we see a per-deployment record showing Status, Environment, Repository, SHA, Author, and Duration for every production deployment?
Survey Data
- Survey Summary What does the Survey summary card show for each engineering survey in the Survey Data tab?
- Survey Results What dimensions does the Survey Results table cover for each engineering survey respondent, and how do the per-respondent scores relate to ORG and TEAM averages?
Agent Effectiveness
- Agent Effectiveness Score What seven dimensions make up the Agent Effectiveness Score breakdown, and what does the score show about AI coding agent use?
- Outcome Success What percentage of AI coding agent sessions produce a merged pull request in the selected period?
- Cost per Outcome What does the Cost per Outcome figure show for AI coding agent activity, and how does it relate to Outcome Success?
- Session Depth What is the average number of prompts or turns per AI coding agent session in the selected period?
- Spend How does the amount we're billed for AI coding agents compare to what our telemetry shows we actually consumed, and what does the gap tell us about our agent cost governance?
- App Adoption How do we compare the cost-efficiency of every AI coding agent we're running, across adoption, sessions, spend, and outcomes, in a single view?
- Model Spend Breakdown Which foundation models are our AI coding agents calling, how much is each one costing, and are we routing to expensive frontier models for tasks that cheaper models handle equally well?
- AI Fluency Score Summary What specific engineering behaviors and infrastructure elements make up our AI Fluency Score, and which ones should we invest in developing to improve agent effectiveness?
- Team Breakdown How do we see each engineer's AI coding agent proficiency and cost efficiency side by side, so we can identify who to learn from and who needs development support?
Team Performance
- Output per Engineer How do we measure whether AI coding tools are actually increasing the engineering output our team produces, rather than just increasing the number of commits or PRs?
- Output by Category What proportion of our engineering team's AI-assisted output is going toward new features versus maintenance work, and is AI investment changing that mix over time?
- AI Output Share / AI PR Share Is AI coding producing a proportionate share of our engineering team's most complex and valuable work, or is it handling the simpler tasks while humans carry the heavier PRs?
- Prompt Quality How good are our engineers at prompting AI coding tools, and how much productivity are we leaving on the table because of gaps in prompting skill rather than gaps in tool capability?
- Cost per Output Is our AI coding tool investment making our engineering team more cost-efficient over time, or are costs rising as fast as, or faster than, the productivity gains?
Reliability
- Total Incidents Has the total count of production incidents changed alongside AI coding adoption, and how does the trend compare to CI/CD metrics?
- Mean Time to Acknowledge (MTTA) How is incident acknowledgment time trending in the Reliability tab, and how does MTTA relate to on-call burden?
- Mean Time to Resolve (MTTR) How is incident resolution time trending in the Reliability tab, and how does MTTR relate to the Incident volume breakdown?
- P1 Incidents How is the count of P1 production incidents trending, and how does it relate to the Total Incidents count and CI/CD metrics?
- Off-Hours Pages How many incident pages are firing outside standard working hours, and how is that count trending?
- Transient Alerts How is the count of transient alerts trending in the Reliability tab, and how does it relate to Total Incidents and MTTA?
- Incident Volume Breakdown How is total incident volume split across Unresolved, Auto resolved, and Manually resolved categories, and how are those categories trending?
- MTTA Trend Chart How has MTTA changed week by week over the selected period, and what does the trend chart show beyond the current-period average?
- On-call Burden How many engineers are classified as overloaded, and what percentage of pages are firing off-hours?
- Highest by Department (Pages) Which engineers are receiving the most incident pages, and how does that rank compare across departments?
- Team Level Breakdown How do we see each engineer's Incidents acked, MTTA, MTTR, Off-Hours Pages, and Pages per week in the Reliability tab?
Agent Readiness
- Org Readiness Level What is our organization's current Org Readiness Level for autonomous AI agents, and how is that score calculated across repos?
- Category Grades How does the Category Grades card show readiness across Code Quality, Build, Testing, Docs, Observability, and Security?
- Next Steps (Readiness Checks) Which readiness checks are failing across the most repos, and what does each check represent in terms of agent deployment readiness?
- Repos Table How do we see each repository's Readiness Level and Next milestone check in the Agent Readiness tab?