Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
The Agent details view in Application Insights provides a unified experience for monitoring AI agents across multiple sources, including Microsoft Foundry, Copilot Studio, and third-party agents.
This feature consolidates telemetry and diagnostics, enabling customers to track agent performance, analyze token usage and costs, troubleshoot errors, and optimize your agent's behavior.
Note
Azure Monitor Agent Observability is based on OpenTelemetry Generative AI Semantics.
Prerequisites
Before you can use the Agents details view, you need to implement AI agent data collection.
Monitor your AI agents
Access the Agent details view
Once telemetry is flowing to Application Insights:
In the Azure portal, go to your Application Insights resource.
In the navigation menu, select Agents (Preview).
Note
You can also get to the Agent details view from Foundry. From your agent, go to the Monitoring tab, then select View in Azure Monitor.
Investigate traces
To drill into specific agent runs:
Select one from the Agent details view:
- View Traces with Agent Runs - See all agent executions
- View Traces with Gen AI Errors - Focus on failed or problematic runs
- Any individual tool call or model in the Tool Calls or Models tiles
The Search overlay displays filtered traces matching your selection.
Use the search capabilities to:
- Sort traces by metrics like Most tokens used to identify expensive operations
- Filter by time range to isolate specific incidents
- Search through prompt content (if sensitive data logging is enabled)
Select any trace to get to the End-to-end transaction details view for comprehensive analysis.
End-to-end transaction details view
The end-to-end transaction details now offer a simple view. This view shows agent steps in a clear, story-like fashion, including the invoked agent, underlying large language model (LLM), executed tools, and more.
Simple view allows you to quickly find the relevant telemetry and transition to Foundry or other tools to make the necessary changes.
Note
To return to the traditional view, select Leave simple view in the top action bar.
In our example, we were researching high token use. Transaction details allow you to identify that large prompt context and/or an expensive model is driving up token use and costs.
Customize monitoring views with Grafana
The Agent details view in Application Insights provides an opinionated, out-of-the-box experience for monitoring your AI agents. For more advanced customization and visualization needs, you can select Explore in Grafana from the top navigation bar on the Agent details view.
Azure Monitor includes prebuilt Grafana dashboards designed for Gen AI monitoring to help you get started:
- Agent Framework - Monitor agent execution and performance
- Agent Framework workflow - Track agent workflow patterns and dependencies
- Foundry - Visualize Foundry-specific metrics and telemetry
These dashboards serve as a starting point for your monitoring strategy. You can customize them by:
- Using different visualization panels to match your preferences
- Editing or creating new queries to surface specific metrics
- Using Save as to create tailored dashboards for your specific environment and use cases
To learn more about using Grafana with Application Insights, see Dashboards with Grafana in Application Insights and Use Azure Monitor Dashboards with Grafana.
Next steps
- Learn how correlation works in Application Insights with Telemetry correlation.
- Explore the end-to-end transaction diagnostic experience that correlates server-side telemetry from across all your Application Insights-monitored components into a single view.