GitHub Copilot Baseline

DEFINITION

When measuring the productivity impact of GitHub Copilot, we compare developers using GitHub Copilot to a baseline. 

HOW IT’S MEASURED

There are three options for Copilot baseline cohorts.

By default, the baseline is all developers in your organization before adopting GitHub Copilot. This cohort helps you answer the question, “Are Copilot developers more productive than the average developer in my organization?”

You can also compare to GitHub Copilot developers to themselves before adoption. This cohort helps answer the question, “Are Copilot developers becoming more productive using Copilot than they were before?”

And last, you can compare to developers not using GitHub Copilot over the last 6 months. This helps answer the question, “Are Copilot developers more productive than developers not using Copilot?”

Each baseline cohort requires at least 6 months of data to remove fluctuations in the data (e.g. due to seasonality). If you adopted Copilot less than 6 months before your oldest pull request synced to our platform, that cohort may be disabled.