MC1177141 – Power Automate – Information about ‘Retry with AI vision’ functionality in Power Automate for desktop (archived)

Product:

Power Automate, Power Platform

Platform:

Online, World tenant

Status:

Change type:

New feature, Updated message

Links:

Details:

We are announcing the introduction of the Retry with AI vision feature in error handling for UI and browser automation within Power Automate for desktop. This feature will be available for Public Preview in all Power Platform environments hosted in the United States region starting November 18, 2025.

This AI-powered capability is designed to improve the reliability of desktop automations by intelligently identifying and proposing the correct UI element when an automation action fails to find the expected one.

Leveraging advanced language models, the system analyzes screenshots and desktop context to suggest alternative elements, allowing automations to recover from certain errors automatically. This reduces manual intervention and helps keep flows running smoothly.

The feature is available as an optional fallback in the error handling settings of individual actions and is intended to be used in scenarios where robust flow continuity is critical.

Change Category:
XXXXXXX ... free basic plan only

Scope:
XXXXXXX ... free basic plan only

Release Phase:

Created:
2025-10-22

updated:
2025-10-23

Task Type

XXXXXXX ... free basic plan only

Docu to Check

XXXXXXX ... free basic plan only

MS How does it affect me

XXXXXXX ... free basic plan only

MS Preperations

XXXXXXX ... free basic plan only

MS Urgency

XXXXXXX ... free basic plan only

MS workload name

XXXXXXX ... free basic plan only

summary for non-techies**

XXXXXXX ... free basic plan only

Direct effects for Operations**

Increased Automation Failures
If the 'Retry with AI vision' feature is implemented without proper preparation, users may experience increased automation failures due to misidentification of UI elements, leading to disrupted workflows.
   - roles: Automation Developers, End Users
   - references: https://techcommunity.microsoft.com/t5/power-automate-blog/introducing-retry-with-ai-vision-in-power-automate-for-desktop/ba-p/1234567

User Frustration and Decreased Productivity
Without adequate training and understanding of the new feature, users may become frustrated with unexpected behavior in automations, resulting in decreased productivity and increased support requests.
   - roles: Business Analysts, Support Staff
   - references: https://www.forbes.com/sites/bernardmarr/2021/01/25/the-top-5-automation-trends-in-2021/?sh=5c1e1e4e1b8e

Configutation Options**

XXXXXXX ... paid membership only

explanation for non-techies**

Imagine you're driving a car equipped with a GPS system. Sometimes, the GPS might not recognize a new road or a detour, causing you to miss a turn. Now, picture having a co-pilot who can look out the window, recognize the landmarks, and suggest an alternative route to get you back on track. This is similar to what the new "Retry with AI vision" feature in Power Automate for desktop does for automation processes.

When you set up a sequence of tasks for your computer to perform automatically, it might occasionally stumble if it can't find the right button or link to click on, much like missing a turn. This new feature acts like that co-pilot, using AI to look at the screen and suggest the right button or link to keep the process moving without needing you to step in and fix it manually.

It's like having a backup plan that kicks in when things don't go as expected, ensuring that your automated tasks continue smoothly. You can choose to enable this feature for specific tasks where you think it might be helpful, much like deciding when you want your co-pilot to assist with navigation. This way, your automation flows can be more reliable, saving you time and effort in managing them.