Connect to the Agent Dashboard (preview)

The Agent Dashboard provides leaders and analysts with actionable insights into agent adoption and associated Copilot Credit usage, which measures how agents are used. Learn more about Copilot Credits. The Agent Dashboard also helps organizations identify opportunities for optimization and track adoption over time.

The dashboard currently covers adoption metrics, which are aggregated at the user level, for agents that are used within Microsoft 365 Copilot. These might be:

• Built in Microsoft Copilot Studio, SharePoint, and Microsoft 365 Agents Toolkit

• Built by end users, formally published by your organization, and created by Microsoft or Microsoft partners

Access the dashboard in the Viva Insights web app

Applies to: Employee users

If you have access to the Agent Dashboard, you can find it in the Viva Insights web app. On the left, select Agent Dashboard. Your admin can set users' access to the Viva Insights web app using these steps.

Delegate access to the dashboard

If you have access to the Agent Dashboard, you can also delegate access to the dashboard to other people in your company. Learn how.

How automatic access to the Agent Dashboard is determined

Using Entra ID data

For customers who use Microsoft Entra ID (formerly known as Azure Active Directory) to manage user profile data like organization or manager data, the Agent Dashboard is automatically available to a limited number of users. Access is based on Microsoft Entra ID Data, specifically the manager hierarchy attribute. Microsoft 365 Global Administrators can disable access at any time.

Users who are senior leaders within large teams as determined by their Entra ID data manager attribute can automatically view the report. Tenants must meet both of the following criteria to qualify:

1. The majority of users in the tenant are part of a single reporting line; for example, they report to the same CEO

2. The tenant has at least 2,500 users with an Entra ID

For those qualifying tenants, only users who meet all of the following criteria are enabled by default:

1. The user's in the top three levels in the organization.

2. The user has a significant portion of the organization in their reporting line.

3. Users who are assigned the Global administrator role also have access to the Agent Dashboard.

   Note

   If you're a Privileged Identity Management (PIM) enabled tenant, global admins might not have access to the Agent Dashboard. If you want to give global admins access to the Agent Dashboard, add them explicitly using these steps.

The criteria above are analyzed on a weekly basis to capture any major organization changes. Each week, any new users who meet the above criteria gain access to the dashboard. The Microsoft 365 Global Administrator can revoke access to those users through the Microsoft 365 admin center and they're not added back unless the admin re-enables them. In addition, admins can disable access to the Copilot Dashboard for their entire organization.

Global admins can also enable or disable automatic access to the dashboard using PowerShell. If you're a Microsoft 365 global admin, learn more about how to manage access to the dashboard.

Using assigned access

The following types of users also have automatic access to the Agent Dashboard:

• Viva Insights Analysts with global partition access

• Users with delegate access

Manage settings for the Agent Dashboard

As an admin, you can configure several features of the Agent Dashboard. Learn how.

Data availability

Data in the dashboard represents data over the previous 28 days. There's up to a six-day data delay from the current date.

Adoption

The adoption page measures employees who have had agent activity in the last 28 days – this includes both those who have a Microsoft 365 license and those who don't. You can access a comprehensive adoption page, as well as focused pages to deep dive into specific individual agents.

Select the filters for your analysis in the dashboard

License type

At the top left of the adoption page, next to License, select the type of Copilot license to filter the insights: Microsoft 365 Copilot or Copilot Chat. The Copilot Chat filter appears only if your tenant has Copilot Chat reporting enabled. The Microsoft 365 Copilot filter shows insights only for employees who have a Microsoft 365 Copilot license. The Copilot Chat filter shows insights only for employees who are active users of the free, web-based Copilot Chat app.

Scope, organization, and job function

At the top left of the page, next to Scope, select the dropdown to choose between viewing insights for individual teams within your entire company, teams just within your group, or both. You can select multiple teams for group comparisons. You can also filter by team or license type by selecting View by above the various metric reports.

By default, the Scope and Organization filters are determined by your Microsoft Entra ID. The Agent Dashboard can get organizational data in one of three ways:

• Through Microsoft Entra ID, which is the default setting 

• Through an organizational data file in Microsoft 365 that your Global admin uploads 

• Through an organizational data file that your Insights admin uploads

The Scope filter is based on the Microsoft Entra ID attribute "ManagerID" to populate "Your company" data and "Your group" data by default.

• When you select "Your company," the dashboard metrics include all data based on the Microsoft Entra ID "Person ID" by default.

• When you select the groups listed within "Your company," the dashboard metrics include all employees who report directly or indirectly to this leader. This senior leader list is determined by the top second levels in the company based on manager hierarchy for the largest organization hierarchy tree in the company. If there are other organization hierarchy trees in the company, the top leader of those organization hierarchy trees is also identified as a senior leader (if the tree comprises at least 4 percent of the overall size of the company). By default, the manager hierarchy is based on the Microsoft Entra ID attribute "ManagerID."

• When you select "Your group," the dashboard metrics include everyone who reports to you directly or indirectly. The manager hierarchy is identified based on the Microsoft Entra ID attribute "ManagerID" by default. Different logged in users will see different data for "Your group."

• When you select the groups listed within "Your group," the dashboard metrics include everyone who reports directly or indirectly to a person who reports to you. These groups are based on your reporting hierarchy and can be updated if your admin uploads more recent organizational data.

If the default data is inaccurate, your admin can upload updated organizational data through the following two ways:

• If your Insights admin uploads a .csv file with the attribute of ManagerID, the "Your Group" data in the filter will update.

• If your Global admin uploads a .csv file with the attribute of Microsoft_ManagerEmail, the "Your Group" data in the filter will update.

  

The Organization filter corresponds to the Microsoft Entra ID data source field named "Department." If your Insights or Global admin uploads a .csv file with an organizational data attribute of "Organization," it will replace the Microsoft Entra ID data source.

• If your Insights admin uploads a .csv file with the attribute of Organization, the "Organization" data in the filter will update.

• If your Global admin uploads a .csv file with the attribute of Microsoft_Organization, the "Organization" data in the filter will update.

The Job function filter only appears if your Insights admin uploads a .csv file with the organizational data attribute of FunctionType or your Global admin uploads a .csv file with the organizational data attribute of JobDiscipline.

• If your Insights admin uploads the file in the Viva Insights web app, they need to upload FunctionType attributes for you to see the Job function dropdowns.

• If your Global admin uploads the file in the Microsoft 365 admin center, they need to upload Microsoft_JobDiscipline attributes for you to see the Job function dropdown.

Agent filters

The Agent creator type filter is based on who created an agent. To filter insights, the following options are available:

• User: Agents built by users and optionally shareable with others

• Your org: Admin-approved agents built by and for your organization

• Microsoft: Agents built by Microsoft

• Microsoft partner: Admin-approved agents built by a third-party Microsoft partner

The Agent source filter is based on where an agent was built. To filter insights, the following options are available:

• Agent Builder: A quick and easy interface for end users to build Copilot agents for themselves or small teams. Learn more.

• Microsoft Copilot Studio: The full agent building experience with advanced capabilities for building and publishing agents to broader audiences. Learn more.

• Microsoft SharePoint: An experience for end users to build agents accessible SharePoint directly. Learn more.

• Microsoft 365 Agents Toolkit: A pro-code suite of tools to build enterprise-ready agents that can be published across multiple channels. Learn more.

• Other Microsoft: Used for agents built on Microsoft platforms when the exact source can't be identified.

Visit the Microsoft Adoption AI Agents Hub to learn more about different options to build and deploy agents in your organization.

Insights

With this dashboard, three main insights are covered. To see insights on this page, there must be enough users with agent activity to meet the minimum group size threshold.

At the top of the page, you'll see totals for Active agents, Active users, and Agent responses. Let's define these terms.

• Active agents: The number of agents with at least one active user over the last 28 days.

• Active users: The number of unique users with at least one agent response over the last 28 days.

• Agent responses: The number of times an agent responded to a user over the last 28 days.

Now let's look at the insights provided by this page.

Insight #1: High-level overview of Agent usage across the organization

Under Adoption by group, a graph shows the change in agent adoption over the prior months, viewable either as a weekly or monthly aggregate. Select Metric to see the adoption trends for a specific group. Metrics include:

• Active agents
• Active users
• Agent responses
• Copilot Credits, which are only visible when you select Copilot Chat in the License filter at the top of the page and if your organization has enabled Pay-As-You-Go and used Copilot Credits.
• Active users using Copilot Credits, which is only visible when you select Copilot Chat in the License filter at the top of the page and if your organization has enabled Pay-As-You-Go and used Copilot Credits.
• % of Copilot users using agents

You can select any data point on the graph to see more details for that point in time. Below the graph you'll find adoption trends for specific groups.

• All users: By default, the trendline displays the historical trend for all users in your company. You can adjust the filters on the top of the page for specific groups.

• View by groups, organization, or job function: Select View by to drill down into different groups. To add more groups, select the eye icon under Show trend. To protect individual privacy, metrics aren't shown for groups that are smaller than the minimum group size.

• Data aggregated by: Select the dropdown to see trends on a Monthly or Weekly basis.

You can sort the table by the headers. For example, to sort by the metric value, select Metric. To sort by the group names alphabetically, select View by.

Insight #2: Returning users

This insight lets you analyze which groups are using agents on a recurring basis. On the Returning users card, select Explore more to dive deeper into the insight using filters.

You can view either the number of returning users or percentage of returning users over time, along with a group-by-group breakdown. Then, just like the other insights mentioned above, select View by to filter by group and Data aggregated by to view trends either monthly or weekly.

Those who received at least one agent response in both the current and preceding time periods are counted as returning users.

Insight #3: Agent highlights

This set of insights helps you understand which agents are resonating the most with your organization in the most recent time period. This includes:

• Most popular: The agent with the highest number of active users within the last 28 days.

• Most versatile: The agent used across the highest number of different job functions in an organization within the last 28 days. This card only appears when job function data is uploaded.

• Most shared: The end-user-built agent with the most active users within the last 28 days. This card appears when you select All or User under the Agent creator type filter at the top of the page.

You can navigate directly to the agent's deep dive page to learn more. In scenarios when there are multiple agents – for example, when you have three agents all with the same high number of users – you can view a list of those agents and then navigate to their individual pages.

Insight #4: Agent snapshot

You can view and search the list of the top agents used in your organization, and use the headers to sort based on either the agent name, or the corresponding metrics for each agent, including: the number of active users; the change in active users; agent responses; and Copilot Credits. The default ordering for these agents is based on the number of active users. You can also select to view details for each agent, which takes you to the deep dive page for that particular agent.

Key metrics in this report

Key actions users can take in the report

The organizational attributes described above are generated from either Microsoft Entra ID or the attributes uploaded by your Viva Insights Administrator or Microsoft 365 Global Administrator. If the attributes are generated from Microsoft Entra ID, only the "Organization" attribute is populated. If you want to use other attributes like Job function, the Viva Insights admin or Global admin needs to upload this data.

The default attributes available in the dashboard are Organization and Job function.

Agent deep dive pages

These pages let you focus on specific agents to understand how each one is used in your organization.

At the top of the page, you can view the agent name, as well as details on the agent's creator type and source. Below this, you can view totals for Active users and Agent responses for the selected agent.

Agent usage

Under Adoption by group, a graph shows the change in agent adoption over the prior months. Select Metric to see the adoption trends for a specific group. Metrics include:

• Active users
• Agent responses
• Copilot Credits, which are only visible when you select Copilot Chat in the License filter at the top of the page and if your organization has enabled Pay-As-You-Go and used Copilot Credits.
• Active users using Copilot Credits, which are only visible when you select Copilot Chat in the License filter at the top of the page and if your organization has enabled Pay-As-You-Go and used Copilot Credits.
• Returning users

You can select any data point on the graph to see more details for that point in time. Below the graph you'll find adoption trends for specific groups.

• All users: By default, the trendline displays the historical trend for all users in your company. You can adjust the filters on the top of the page for specific groups.

• View by groups, organization, or job function: Select View by to drill down into different groups. To add more groups, select the eye icon under Show trend. To protect individual privacy, metrics aren't shown for groups that are smaller than the minimum group size.

• Data aggregated by: Select the dropdown to see trends on a Monthly or Weekly basis.

You can sort the table by the headers. For example, to sort by the metric value, select Metric. To sort by the group names alphabetically, select View by.

Glossary of terms

Related topics

• Copilot Analytics introduction
• Manage settings for the Agent Dashboard
• Delegate access to the Agent Dashboard