Test Scenarios enable more efficient testing of GenerativeAgent configurations through automated simulations of customer interactions. They are an evolution from Test Users, offering not just mock API profiles, but also integrated goals, information customers have on them, and personalities to simulate a customer in a specific scenario.With Test Scenarios, you can:
Automatically generate mock API responses fitting a customer scenario
Add customer goals, information customers have, and personalities to vary how the simulated customer will interact with GenerativeAgent
Run simulated interactions and review how GenerativeAgent handles a customer with that scenario
Test Users have been migrated to Test ScenariosAll workflows involving Test Users will still be accessible through Test Scenarios and all Test Users have been migrated to Test Scenarios.
Configuration Branches enables seamless experimentation with GenerativeAgent configurations through local branching. This new feature allows you to safely test and iterate on changes without affecting your main environments.With Configuration Branches, you can:
Create isolated branches from Draft, Sandbox, or Production environments
Edit tasks, functions, and settings in a protected workspace
Preview changes before promoting them to main environments
Collaborate with team members on configuration improvements
Advanced Syncing and Auto-Deploy for Knowledge Base Content
We’ve launched enhanced controls for syncing and deploying your knowledge base, giving you the flexibility to prioritize critical updates and deliver the most current information through GenerativeAgent—automatically and with less manual overhead.What’s new?
Configurable Sync Modes: Set each content source to update with manual review, auto-deploy updates directly to production, or turn off syncing.
Frequent Article Refresh: Enable high-frequency (every 15 minutes) automatic updates and instant deployment for critical, time-sensitive articles.
We’ve introduced the ability to automatically generate test users by describing test scenarios, making it easier to simulate API interactions for testing purposes.This feature accelerates your testing process by automatically creating realistic test data based on your scenario descriptions, helping you validate GenerativeAgent’s behavior more efficiently.
Pinned Versions allows you to pin specific versions of GenerativeAgent to a deployment, enabling safer and more predictable deployments.This enables you to:
Maintain version stability in production environments
Control the rollout of new features
Test version changes in preview before deployment
Ensure consistent behavior across GenerativeAgent deployments
Scope and Safety Fine Tuning allows customizable guardrails that let you define what’s considered “in-scope” and “safe” for your specific use cases, while maintaining core safety protections.With this feature, you can:
Customize safety boundaries aligned with business policies
Expand permissible topics without compromising default protections
Control input safety and scope definitions with precision
Turn Inspector is an advanced diagnostic feature in Previewer that provides granular visibility into GenerativeAgent’s interaction workflow.It enables you to diagnose unexpected behaviors, fine-tune instructions, and ensure more predictable and reliable interactions with GenerativeAgent.You can inspect:
Knowledge Base Search enables powerful free-text search across article titles, text, and URLs. The search includes metadata filtering capabilities for content source, creation details, and deployment status.This makes it easier to manage and navigate your Knowledge Base.
Users can combine multiple filters with AND operators, maintain search context while navigating, and perform bulk operations on search results.
The Knowledge Base Article API enables programmatic management of Knowledge Base articles, allowing you to programmatically add and modify articles within the GenerativeAgent Knowledge Base.Key use cases include:
Integration with private internal knowledge bases not publicly accessible
Importing content from non-scrapable sources like Content Management Systems (CMS)
Fine-grained programmatic control over knowledge ingestion and management
Trial Mode allows you to safely deploy GenerativeAgent use cases by trialing functions in production. When developing AI applications, it’s critical to validate how your AI system interacts with external functions and APIs before full deployment. Trial mode provides this safety layer.This can allow you to:
Ensure GenerativeAgent called the function properly given the conversation context.
Ensure GenerativeAgent interpreted the function response.
Be protected from unknown API response variations that you might not have accounted for during development and testing.