GitHub Copilot Metrics

Important Notes:

  • Average metrics are presented as a daily average over the selected time period (e.g., the daily average for the last month).
  • Per GitHub Copilot's documentation, data is available only for teams with five or more active Copilot licenses on a given day.

High-Level Ratios

These metrics provide a top-level view of how effectively your organization is leveraging its Copilot investment.

Metric Definition How to Interpret
Adoption Rate The percentage of developers who were active in any capacity on a given day. (Daily Active Users / Daily Active Developers) A high adoption rate indicates that licenses are being utilized and developers are at least seeing suggestions. A low rate may signal issues with installation, awareness, or perceived value.
Engagement Rate The percentage of active users who took a specific action, such as accepting a suggestion or using chat. (Daily Engaged Users / Daily Active Users) This measures deeper value than adoption. A high engagement rate means developers are not just seeing suggestions, but actively using suggestions as well as other features, like IDE chat.
Code Acceptance Rate The percentage of code suggestions that were accepted by a developer. (Total Code Acceptances / Total Code Suggestions) This is a direct measure of the quality and relevance of Copilot's code suggestions. A high rate indicates that Copilot is generating useful, high-quality code that aligns with your team's needs.

User Activity (Daily Averages)

These metrics break down the user base into different activity levels and feature usage.

Metric Definition How to Interpret
Daily Avg Licensed Users The average number of users with an active Copilot license on any given day in the period. Only available for the entire organization. The baseline for measuring the potential user pool and calculating license utilization.
Daily Avg Active Users The average number of licensed users who had any Copilot activity, including passive actions like seeing a suggestion. Measures the overall reach of Copilot within your licensed user base.
Daily Avg Engaged Users The average number of licensed users who performed an intentional action, such as accepting a suggestion or asking a chat question. This is a key metric for understanding how many developers are deriving value from Copilot, beyond installing an extension.
Daily Avg Passive Users The average number of users who were active but not engaged (i.e., they received suggestions but did not accept any or use other features). (Daily Active Users - Daily Engaged Users) A high number of passive users may indicate that suggestions are not relevant, that developers are not trained on how to use the tool effectively.
Daily Avg Engaged Users - IDE Chat The average number of users who sent at least one prompt to Copilot Chat within their IDE. Measures adoption of the conversational AI feature for coding, debugging, and learning directly in the editor.
Daily Avg Engaged Users - IDE Code Completions The average number of users who accepted at least one code suggestion within their IDE. This is the core metric for code generation usage.
Daily Avg Engaged Users - Web Chat The average number of users who sent at least one prompt to Copilot Chat on github.com. Indicates usage of Copilot for tasks outside the IDE, such as general research or code explanation on the GitHub website.
Daily Avg Engaged Users - PR Summaries The average number of users who generated at least one pull request summary. Measures the adoption of Copilot's features for streamlining the code review and documentation process.

Per-User Averages

These metrics normalize total activity by the number of active users to show the average behavior of an individual.

Metric Definition How to Interpret
Daily Avg IDE Chats per Active User The total number of IDE chats divided by the number of daily active users. A high number indicates that active users are heavily relying on the chat feature for problem-solving, research, and planning, making it a core part of their workflow.
Daily Avg Web Chats per Active User The total number of web chats divided by the number of daily active users. Measures the average engagement with Copilot on github.com per user.
Daily Avg Code Acceptances per Active User The total number of code acceptances divided by the number of daily active users. This shows, on average, how many useful suggestions each active developer is getting per day.
Daily Avg PR Summaries per Active User The total number of PR summaries created divided by the number of daily active users. Indicates how frequently the average developer is using Copilot to automate documentation and code review of their pull requests.

Volume Metrics

These are the raw counts of events and are useful for understanding the overall scale of Copilot's activity.

Metric Definition How to Interpret
Total IDE Chats The total number of chat sessions initiated by users in their IDE. A raw measure of conversational AI usage.
Total Web Chats The total number of chat sessions initiated on github.com. Volume of chat usage outside the IDE.
Total Code Suggestions The total number of times Copilot generated a code suggestion. The denominator for calculating the overall acceptance rate.
Total Code Acceptances The total number of times a developer accepted a code suggestion. The numerator for acceptance rate.
Total Code Lines Suggested The total number of lines of code that Copilot proposed. A raw measure of the volume of code being suggested by AI.
Total Code Lines Accepted The total number of lines of code from suggestions that developers accepted. Illustrates the volume of code that developers are accepting and then refining.
Total PR Summaries Created The total number of pull request summaries generated. A raw measure of how much documentation and code review work is being automated.

Still need help? Contact Us Contact Us