check before: 2025-05-05
Product:
Copilot
Platform:
Online, World tenant
Status:
Change type:
New feature
Links:
Details:
We are announcing the Analyze knowledge source usage for custom agents feature for Microsoft Copilot Studio. This feature introduces a chart and metrics that track how often your knowledge sources are used in conversations between your agent and users. This feature will reach general availability on May 5, 2025.
Change Category:
XXXXXXX ... free basic plan only
Scope:
XXXXXXX ... free basic plan only
Release Phase:
Created:
2025-05-01
updated:
2025-05-01
Task Type
XXXXXXX ... free basic plan only
Docu to Check
XXXXXXX ... free basic plan only
MS How does it affect me
XXXXXXX ... free basic plan only
MS Preperations
XXXXXXX ... free basic plan only
MS Urgency
XXXXXXX ... free basic plan only
MS workload name
XXXXXXX ... free basic plan only
summary for non-techies**
Microsoft Copilot Studio is introducing a feature that provides charts and metrics to track the usage, error rate, and answer rate of custom agents' knowledge sources, available from May 5, 2025.
Direct effects for Operations**
Increased Error Rates in Conversations
Without preparation, the introduction of the new analytics feature may lead to increased error rates in conversations if knowledge sources are not properly updated or maintained, resulting in user frustration and decreased trust in the system.
- roles: Customer Support Agent, Data Analyst
- references: https://www.forbes.com/sites/bernardmarr/2021/01/25/the-top-5-technology-trends-in-2021/?sh=1c1c1c1c1c1c, https://www.gartner.com/en/information-technology/insights/ai-analytics
User Experience Degradation
If the knowledge sources are not effectively analyzed and optimized prior to the feature rollout, users may experience degraded interactions with the agent, leading to dissatisfaction and potential abandonment of the tool.
- roles: End User, Product Manager
- references: https://www.mckinsey.com/business-functions/mckinsey-digital/our-insights/the-analytics-journey-how-to-get-started, https://www.bain.com/insights/how-to-improve-customer-experience-with-analytics/
Configutation Options**
XXXXXXX ... paid membership only
Data Protection**
XXXXXXX ... paid membership only
explanation for non-techies**
XXXXXXX ... free basic plan only
** AI generated content. This information must be reviewed before use.
a free basic plan is required to see more details. Sign up here
A cloudsocut.one plan is required to see all the changed details. If you are already a customer, choose login.
If you are new to cloudscout.one please choose a plan.
Last updated 1 week ago
