azurecurve

This post is part of the New Functionality In Microsoft Power Automate 2024 Wave 1 series in which I am taking a look at the new functionality introduced in Microsoft Power Automate 2024 Wave 1.

The 10th of the new functionality in the Desktop Flows section is self-heal UI and browser automation actions at execution with AI.

This feature is for Power Automate for desktop users that automate UI and web interaction scenarios. It improves success rates and handles cases where UI elements can’t be found.

Enabled for: Admins, makers, marketers, or analysts, automatically
Public Preview: Jun 2024
Early Access: –
General Availability: Sep 2024

Feature Details

Once enabled by users, the feature uses AI to locate elements in the screen at the execution time. The repaired selector is used in future executions. Plus, it’s optional and can be disabled if you prefer.

Self-healing refers to the case that a UI element cannot be found at the execution time.
Self-healing can be applied only for UI and web automation scenarios, and subsequently for Desktop and web UI elements.
With self-healing, Power Automate for desktop can locate a UI element in the screen.
When UI element and its selector are retrieved, a confirmation is required by the user in order the flow to be healed and saved.
This feature can be disabled by the user.

Click to show/hide the New Functionality In Microsoft Power Automate 2024 Wave 1 Series Index

New Functionality In Microsoft Power Automate 2024 Wave 1
Use Generative AI to Achieve a Process in AI Flows
Receive Intelligent License Recommendations for Admins
Be More Productive with Power Automate and Excel Desktop
View a Power Automate Visual in a Power BI Report
Monitor Performance for Cloud and Desktop Flow Activities
Connect to Other Environments from the Microsoft Dataverse Connector
Push Cloud Flow Execution Data into Application Insights
Use Your Own Encryption Key for Encrypting Data At-Rest for Existing Environments
Create Power Automate Flows in Excel
View Two Action Properties Panes Simultaneously
Use Undo and Redo While You Build Cloud Flows in the Designer
Use Copy-Paste for Container Actions Like Scope, Condition, and Apply to Each
Use a Simplified OData Editor in Actions like Get Items and Get Files
Manage Unpublished Solution-Aware Cloud Flows Using Admin APIs
Cancel all Flow Runs for a Version of a Flow
Create a Flow on a File in Teams
Cloud Flows are Automatically Defined in Dataverse Solutions
Use Workflows on Calendar Events in Teams and Outlook
Create AI Flows in Power Automate
Use Copilot with French Language
Recommendations to Reassign Orphaned Cloud Flows
Generate Descriptions for Cloud Flows using AI
Use Flows with Connections from Users in Copilot Studio
Use Process Mining Microsoft 365 Personal Recommendations
Create and Edit Expressions with Copilot
Get Quick Insights and Recommendations in Copilot for Process Mining
Troubleshoot with Copilot for Cloud Flows Execution
Automate With Ease Using the AI Recorder
Enter into a Conversation-first Copilot Experience to Build Flows
Transform Scripting Using AI-driven Natural Language
Maximize Your Productivity with Generative Answers
Streamline Workflow Creation with the Next Best Action
Generate Flow Description Using AI
Use Natural Language to Create a Flow in Teams
Leverage Desktop Automation with the Power Automate Plugin for Windows Copilot
Set Up Fallback UI Automation Mechanism
Power Fx Integration with Power Automate for Desktop
Use Power Platform Connectors in Power Automate for Desktop Actions
Use CyberArk Credentials in Desktop Flow Connections
Use Azure Key Vault Credentials in Flow Connections
Connect Your Own Virtual Network with Hosted Machine Group
View Attended Desktop Flow Runs Using Picture-in-Picture Execution Mode
Self-heal UI and Browser Automation Actions at Execution with AI
Use the Run Power Fx Expression
Use Python v3 in Power Automate for Desktop
Use Machine to Credential Mapping in Desktop Flow Connections
Create a Reusable Collection of UI Elements
Use Customer-managed Encryption Key for Hosted RPA
Automation Center to Monitor and Manage All Your Automations and Related Assets
Trigger Attended Desktop Flows in Picture-in-Picture
Use Copilot in Automation Center to Analyze Cloud Flow Runs
Trigger Attended Desktop Flows in Picture-in-Picture Mode Through the Power Automate Console
Use Copilot in Automation Center to Analyze Desktop Flow Runs
Use Copilot in Automation Center to Analyze Work Queue Data
Use Copilot in Automation Center to Ask Power Automate Product Questions
Use New Data Table Actions
Use New Excel Actions in Power Automate for Desktop
Use the New Desktop Flow Running Timeout Property
Ingest Process Data from Customers' Data Lake
Scale Faster with Power Automate Process Mining Thin Client App