Observation Dashboard

The Observation dashboard is where you monitor your agents in production. It shows conversation quality, volume and cost for a time window you choose, either across all agents or for one agent, and ends with a filterable conversation table that opens each session in Conversation Review.

Opening the Dashboard

Open the Observation tab of the AI Data Fusion web application. The dashboard opens with the scope and time range you used last (the first time: All Agents and Last 7 Days). Your last scope, time range and table filter are remembered in the browser.

The selected agent is also kept in the page URL as ?agent=<LU>/<agent>, so you can bookmark or share a link to one agent's dashboard, for example .../static/aifusion/observation?agent=customer_bank/banking. See Opening Observation for the full list of deep links.

Dashboard Layout

From top to bottom:

  1. Header bar — the title, the summary items for the period, the agent selector and the time range
  2. Number cards — single-value widgets (type box)
  3. Chart widgets — bar, stacked bar, pie, line and area charts
  4. Conversation Details — the conversation table, always last

Which cards and charts appear depends on the scope: the overall widgets for All Agents, or the selected agent's own widgets.

Header Bar

The header title shows the current scope: Agent Analytics | All Agents, or Agent Analytics | () when an agent is selected.

Summary items

Next to the title, the header shows a row of summary items for the selected period. They come from the scope's summary widget — one item per row its query returns. For All Agents the shipped items are:

  • Total — the number of analyzed conversations in the period
  • Not Resolved — the percentage of analyzed conversations whose Resolution Status is Pending or Escalated

An agent's widgets.yaml can add its own headline items. For example, the banking sample agent adds Follow-ups (conversations tagged with the Follow-up signal) and At Risk (the percentage with a Medium or High Customer Lifetime Value Risk). A scope without a summary widget shows no summary items.

Agent selector

The agent selector lists All Agents followed by every deployed agent, shown as () and sorted by agent name. Selecting an agent:

  • Replaces the widgets with that agent's own widgets (see Agent Scope below)
  • Limits the conversation table to the agent's conversations, and hides the table's Agent column and Agent filter
  • Updates the ?agent= parameter in the URL

If a remembered agent is no longer deployed, the dashboard falls back to All Agents.

Time range

The time range applies to all widgets and to the conversation table:

Option Typical use
Last 24 Hours Checking activity since the last deployment, or investigating a recent spike
Last 7 Days Weekly review; emerging patterns (default)
Last 30 Days Monthly performance and trend tracking
Last 90 Days Quarterly analysis and long-term quality trends

Time-series charts use 4-hour buckets for Last 24 Hours and daily buckets for the longer ranges.

All Agents Widgets

With All Agents selected, the dashboard shows the overall widgets defined in the widgets MTable of the aifusion LU (widgets.csv). The shipped set is:

Widget Type What it shows
Conversation Tag Summary summary The header bar items: Total and Not Resolved
Avg. Resolution Rate box Percentage of analyzed conversations with Resolution Status = Resolved
Avg. Tokens/Conversation box Mean tokens per session, with a breakdown into input, cached and output tokens
Avg. Steps/Conversation box Mean number of user–assistant turns per session
Avg. Response Time box Mean response time per turn, in seconds
User Sentiment pie Sentiment tags grouped into Positive, Neutral and Negative
Conversation Volume Over Time area Number of conversations per time bucket
Satisfaction Trend (%) line A satisfaction score derived from the Sentiment tags, over time
Conversations by Agent bar Number of conversations per agent
Resolution Rate by Agent (%) bar Resolution rate per agent
Token Consumption by Agent stacked bar Input (without cache), cached and output tokens per agent

There is no topics chart in the All Agents view: each agent has its own Topic values, so topics are shown per agent.

Token and step figures are filled in by the analysis process, so sessions that have not been analyzed yet do not contribute to them.

Agent Scope

When you select an agent, the dashboard shows only the widgets defined in that agent's Observation/widgets.yaml — its header summary, number cards and charts. The overall widgets are not shown. An agent without a widgets.yaml shows no widgets, just the conversation table.

Agent widgets read the agent's sessions only. If a widget's query is not written to filter on the agent's sessions, its card is marked Not filtered to this agent and shows data for all agents. See Configuring Observation for how to write agent widgets.

A new agent created in AI Fusion Studio comes with a starter widgets.yaml that includes the header summary, the four number cards, Top Conversation Topics and Token Consumption. The banking sample agent (customer_bank/AI/Agents/banking) adds customer-service views such as Urgency Level, Upsell Opportunity and Resolution Pathway.

Conversation Details Table

The Conversation Details table lists the sessions created in the selected period, newest first, for the current scope and filter. Click a row to open it in Conversation Review.

Columns

Column Description
Date When the session started, shown as date and time
Topics The session's Topic tags; up to two are shown, hover for the full list
Resolution The Resolution Status tag (Resolved, Pending or Escalated) as a colored badge; Unknown when the session has not been analyzed
Risk The Customer Lifetime Value Risk tag (Low, Medium or High) as a colored badge. Empty for agents that do not define this signal
Avg Response Mean response time per turn in this session, in seconds
Submitted By The user who ran the session
Agent The agent that handled the session (hidden when an agent is selected)
Feedback Counters for thumbs up, thumbs down and notes, each shown only when non-zero; a dash when there is no feedback
Summary The LLM-generated conversation summary; hover for the full text

Topics, Resolution, Risk, Avg Response, Feedback and Summary are filled in by the analysis process. Feedback counters reflect the feedback that existed when the session was last analyzed.

Filters

Select a filter from the drop-down list next to the table title:

Filter What it shows
All Every conversation in the period (default)
High Risk Conversations Conversations whose Customer Lifetime Value Risk is High
Unresolved Conversations Conversations whose Resolution Status is Pending or Escalated
Instance (LU / IID) Conversations that ran against a specific LU instance. Enter the LU name and the IID (both are required, because an IID is unique only within its LU), then click Filter
Submitted By Conversations run by a specific user. Enter the user name and click Filter
Agent Conversations of a specific agent. Enter the agent name and click Filter. Not available when an agent is selected in the header
Feedback Conversations by the feedback they received. A second list offers Any feedback, No feedback, Has positive, Has negative, Has notes, Positive only, Negative only and Mixed (positive + negative)

The High Risk Conversations filter relies on the Customer Lifetime Value Risk signal; it returns nothing for agents that do not define it.

Exporting the list

Click Export List to download the current list — the selected scope, time range and filter — as a CSV file. The file contains all the fields returned for each session, including fields that are not shown as columns. Use it for reporting or to load into an external analytics tool.

Next article: Conversation Review

Observation Dashboard

The Observation dashboard is where you monitor your agents in production. It shows conversation quality, volume and cost for a time window you choose, either across all agents or for one agent, and ends with a filterable conversation table that opens each session in Conversation Review.

Opening the Dashboard

Open the Observation tab of the AI Data Fusion web application. The dashboard opens with the scope and time range you used last (the first time: All Agents and Last 7 Days). Your last scope, time range and table filter are remembered in the browser.

The selected agent is also kept in the page URL as ?agent=<LU>/<agent>, so you can bookmark or share a link to one agent's dashboard, for example .../static/aifusion/observation?agent=customer_bank/banking. See Opening Observation for the full list of deep links.

Dashboard Layout

From top to bottom:

  1. Header bar — the title, the summary items for the period, the agent selector and the time range
  2. Number cards — single-value widgets (type box)
  3. Chart widgets — bar, stacked bar, pie, line and area charts
  4. Conversation Details — the conversation table, always last

Which cards and charts appear depends on the scope: the overall widgets for All Agents, or the selected agent's own widgets.

Header Bar

The header title shows the current scope: Agent Analytics | All Agents, or Agent Analytics | () when an agent is selected.

Summary items

Next to the title, the header shows a row of summary items for the selected period. They come from the scope's summary widget — one item per row its query returns. For All Agents the shipped items are:

  • Total — the number of analyzed conversations in the period
  • Not Resolved — the percentage of analyzed conversations whose Resolution Status is Pending or Escalated

An agent's widgets.yaml can add its own headline items. For example, the banking sample agent adds Follow-ups (conversations tagged with the Follow-up signal) and At Risk (the percentage with a Medium or High Customer Lifetime Value Risk). A scope without a summary widget shows no summary items.

Agent selector

The agent selector lists All Agents followed by every deployed agent, shown as () and sorted by agent name. Selecting an agent:

  • Replaces the widgets with that agent's own widgets (see Agent Scope below)
  • Limits the conversation table to the agent's conversations, and hides the table's Agent column and Agent filter
  • Updates the ?agent= parameter in the URL

If a remembered agent is no longer deployed, the dashboard falls back to All Agents.

Time range

The time range applies to all widgets and to the conversation table:

Option Typical use
Last 24 Hours Checking activity since the last deployment, or investigating a recent spike
Last 7 Days Weekly review; emerging patterns (default)
Last 30 Days Monthly performance and trend tracking
Last 90 Days Quarterly analysis and long-term quality trends

Time-series charts use 4-hour buckets for Last 24 Hours and daily buckets for the longer ranges.

All Agents Widgets

With All Agents selected, the dashboard shows the overall widgets defined in the widgets MTable of the aifusion LU (widgets.csv). The shipped set is:

Widget Type What it shows
Conversation Tag Summary summary The header bar items: Total and Not Resolved
Avg. Resolution Rate box Percentage of analyzed conversations with Resolution Status = Resolved
Avg. Tokens/Conversation box Mean tokens per session, with a breakdown into input, cached and output tokens
Avg. Steps/Conversation box Mean number of user–assistant turns per session
Avg. Response Time box Mean response time per turn, in seconds
User Sentiment pie Sentiment tags grouped into Positive, Neutral and Negative
Conversation Volume Over Time area Number of conversations per time bucket
Satisfaction Trend (%) line A satisfaction score derived from the Sentiment tags, over time
Conversations by Agent bar Number of conversations per agent
Resolution Rate by Agent (%) bar Resolution rate per agent
Token Consumption by Agent stacked bar Input (without cache), cached and output tokens per agent

There is no topics chart in the All Agents view: each agent has its own Topic values, so topics are shown per agent.

Token and step figures are filled in by the analysis process, so sessions that have not been analyzed yet do not contribute to them.

Agent Scope

When you select an agent, the dashboard shows only the widgets defined in that agent's Observation/widgets.yaml — its header summary, number cards and charts. The overall widgets are not shown. An agent without a widgets.yaml shows no widgets, just the conversation table.

Agent widgets read the agent's sessions only. If a widget's query is not written to filter on the agent's sessions, its card is marked Not filtered to this agent and shows data for all agents. See Configuring Observation for how to write agent widgets.

A new agent created in AI Fusion Studio comes with a starter widgets.yaml that includes the header summary, the four number cards, Top Conversation Topics and Token Consumption. The banking sample agent (customer_bank/AI/Agents/banking) adds customer-service views such as Urgency Level, Upsell Opportunity and Resolution Pathway.

Conversation Details Table

The Conversation Details table lists the sessions created in the selected period, newest first, for the current scope and filter. Click a row to open it in Conversation Review.

Columns

Column Description
Date When the session started, shown as date and time
Topics The session's Topic tags; up to two are shown, hover for the full list
Resolution The Resolution Status tag (Resolved, Pending or Escalated) as a colored badge; Unknown when the session has not been analyzed
Risk The Customer Lifetime Value Risk tag (Low, Medium or High) as a colored badge. Empty for agents that do not define this signal
Avg Response Mean response time per turn in this session, in seconds
Submitted By The user who ran the session
Agent The agent that handled the session (hidden when an agent is selected)
Feedback Counters for thumbs up, thumbs down and notes, each shown only when non-zero; a dash when there is no feedback
Summary The LLM-generated conversation summary; hover for the full text

Topics, Resolution, Risk, Avg Response, Feedback and Summary are filled in by the analysis process. Feedback counters reflect the feedback that existed when the session was last analyzed.

Filters

Select a filter from the drop-down list next to the table title:

Filter What it shows
All Every conversation in the period (default)
High Risk Conversations Conversations whose Customer Lifetime Value Risk is High
Unresolved Conversations Conversations whose Resolution Status is Pending or Escalated
Instance (LU / IID) Conversations that ran against a specific LU instance. Enter the LU name and the IID (both are required, because an IID is unique only within its LU), then click Filter
Submitted By Conversations run by a specific user. Enter the user name and click Filter
Agent Conversations of a specific agent. Enter the agent name and click Filter. Not available when an agent is selected in the header
Feedback Conversations by the feedback they received. A second list offers Any feedback, No feedback, Has positive, Has negative, Has notes, Positive only, Negative only and Mixed (positive + negative)

The High Risk Conversations filter relies on the Customer Lifetime Value Risk signal; it returns nothing for agents that do not define it.

Exporting the list

Click Export List to download the current list — the selected scope, time range and filter — as a CSV file. The file contains all the fields returned for each session, including fields that are not shown as columns. Use it for reporting or to load into an external analytics tool.

Next article: Conversation Review