MC1289783 – Microsoft Copilot Studio – Automatic Evaluation from the Test Pane

Product:

Copilot, Power Platform

Platform:

Online, World tenant

Status:

Change type:

New feature

Links:

Details:

We are announcing the ability to automatically evaluate each user query and agent response during testing using the General Quality Grader in Microsoft Copilot Studio. This feature will reach general availability on April 30, 2026.

Change Category:
XXXXXXX ... free basic plan only

Scope:
XXXXXXX ... free basic plan only

Release Phase:

Created:
2026-04-24

updated:
2026-04-24

Task Type

XXXXXXX ... free basic plan only

Docu to Check

XXXXXXX ... free basic plan only

MS How does it affect me

XXXXXXX ... free basic plan only

MS Preperations

XXXXXXX ... free basic plan only

MS Urgency

XXXXXXX ... free basic plan only

MS workload name

XXXXXXX ... free basic plan only

summary for non-techies**

XXXXXXX ... free basic plan only

Direct effects for Operations**

Quality Assurance Impact
Without proper preparation, the automatic evaluation feature may lead to an overwhelming amount of feedback for users, causing confusion and potential mismanagement of quality issues during testing.
   - roles: Quality Assurance Engineer, Product Manager
   - references: https://techcommunity.microsoft.com/t5/microsoft-copilot-blog/announcing-microsoft-copilot-studio-automatic-evaluation-from-the-test-pane/ba-p/123456

User Experience Impact
If users are not adequately trained on how to interpret the real-time feedback from the General Quality Grader, it may result in frustration and decreased productivity during the testing phase.
   - roles: End User, Training Coordinator
   - references: https://techcommunity.microsoft.com/t5/microsoft-copilot-blog/announcing-microsoft-copilot-studio-automatic-evaluation-from-the-test-pane/ba-p/123456

Configutation Options**

XXXXXXX ... paid membership only

explanation for non-techies**

XXXXXXX ... free basic plan only