Engineering Productivity and KPIs

Measuring engineering effectiveness with DORA metrics, SPACE and DevEx, flow metrics and business outcomes, avoiding vanity metrics and Goodhart's law.

Executive explanation

Engineering productivity is the ability to deliver valuable, reliable software quickly and sustainably. No single number captures it; use a balanced set of delivery, quality, developer experience and outcome metrics, and use them to improve the system, not to rank individuals.

Frameworks

Framework Metrics
DORA (DevOps Research and Assessment) Deployment frequency, lead time for changes, change failure rate, failed deployment recovery time (formerly MTTR); plus reliability
SPACE (Forsgren et al., 2021) Satisfaction and well-being, Performance, Activity, Communication and collaboration, Efficiency and flow
DevEx Feedback loops, cognitive load, flow state (surveys + system data)
Flow metrics Flow time, flow efficiency, WIP, throughput
Area KPI Example target
Speed Lead time for changes (median) < 1 day for high performers
Speed Deployment frequency On demand / daily
Stability Change failure rate < 15%
Stability Failed deployment recovery time < 1 hour
Reliability SLO attainment for key journeys 99.9%+
Developer experience Survey score, onboarding time to first deploy Improving trend
Efficiency Cloud cost per unit (transaction/user) Decreasing trend
Outcomes Feature adoption, revenue/cost impact of initiatives Tied to OKRs

Business scenario

A board asks "are our 300 engineers productive?". The CTO introduces DORA metrics from CI/CD data, quarterly developer surveys, and outcome tracking per product team. Findings: lead time is 12 days due to a manual release train and flaky tests; investment in pipeline automation cut it to 2 days within two quarters.

Pitfalls

  • Measuring lines of code, story points or commits (Goodhart's law: when a measure becomes a target, it stops being a good measure).
  • Using team metrics to compare individuals.
  • Metrics without action: every metric should prompt a decision.

CTO interview questions and model answers

How would you measure developer productivity without harming culture?

Measure the system (DORA, flow, DevEx surveys), share data transparently with teams, use it to remove bottlenecks (tooling, process, dependencies), and pair it with outcome metrics. Never use activity metrics for performance reviews.