Monitoring how GenerativeAgent handles customer interactions is critical for ensuring optimal performance and customer satisfaction.

By tracking key metrics around containment and task completion, you can continuously improve GenerativeAgent’s effectiveness and identify areas for optimization.

You can access GenerativeAgent reporting data in two ways:

Reporting OptionCapabilitiesAvailability
Out-of-the-box dashboards
  • Get started quickly with pre-built visualizations
  • View basic performance metrics like task completion and containment
ASAPP Messaging only
Data feeds
  • Export raw data for custom analysis
  • Combine GenerativeAgent data with your own analytics
  • Build custom reports in your BI tools
  • Track end-to-end customer journeys across channels
ASAPP Messaging and Standalone GenerativeAgent
Dashboards are available only once you are in production.

​
Out-of-the-box dashboards

The fastest way to start monitoring GenerativeAgent is through our pre-built dashboards. To access them depends on whether you are using ASAPP Messaging or running GenerativeAgent standalone.

These dashboards show you:

  • Volume and containment over time
  • Containment by task
  • Intent and task breakdowns

We only provide out-of-the-box dashboards for GenerativeAgent running on ASAPP Messaging.

Access GenerativeAgent reporting through the Historical Insights interface:

  1. Navigate to ASAPP Core Digital Dashboards -> Automation & Flow -> GenerativeAgent
  2. Select GenerativeAgent Quality Metrics

​
Data feeds

For deeper analysis, or to integrate GenerativeAgent metrics with your existing analytics infrastructure, you can pipe GenerativeAgent’s data directly into your system using:

This approach is recommended when you need to:

  • Combine GenerativeAgent metrics with other customer journey data
  • Build custom dashboards in your BI tools
  • Perform advanced analytics across channels
  • Track end-to-end customer interactions

Use File Exporter to export data from a standalone GenerativeAgent. When exporting data via the File Exporter APIs, you need to specify a feed of generativeagent.

Reports are generated hourly.

Here is an example to get a list of files in the generativeagent feed for a given day:

curl --request POST \
  --url https://api.sandbox.asapp.com/fileexporter/v1/static/listfeedfiles \
  --header 'Content-Type: application/json' \
  --header 'asapp-api-id: <api-key>' \
  --header 'asapp-api-secret: <api-key>' \
  --data '{
  "feed": "generativeagent",
  "version": "1",
  "format": "jsonl",
  "date": "2024-06-27",
  "interval": "hr=23"
}'

Refer to the File Exporter documentation for more details on the listing and retrieving files.

​
GenerativeAgent data schema

Data Reference

See all available metrics and their definitions in our data reference guide

Was this page helpful?

Example InteractionsHuman in the Loop