Mouse The Mouse action group is intended for interacting with user interface using mouse (move, click, drag, scroll). All the Mouse actions are automatically recorded when you manipulate your mouse during recording process. You can add the Mouse Click, Move, Drag, or Scroll actions manually when editing a recording by dragging it from the Actions Library to the Actions Flow. Actions Library Action Description Mouse Action Location Image Location Coordinates Location Mouse Actions Mouse Click Mouse Click by XPath Mouse Move Mouse Drag Mouse Scroll Mouse Action Location Every mouse action needs a specific location place on computer screen where the action is applied to. Currently, the RPA Recorder supports 3 types of action locations: image a graphical image of a user interface element (button, input field, link, etc.) which bot will try to find and click (hover, drag, scroll) while script execution. See Editing Images coordinates X and Y coordinates of a point from the top-left screen corner. XPath an element in an XML or HTML document, which is selected using XPath expressions.the action location is the most reliable one, as it depends on the web document (page) structure, but not from the color scheme or location on a screen that may vary from one machine to another. Image Location By default, robot clicks (hovers, scrolls, drags) directly into the center of the captured image. You can set the crosshair to a custom place by clicking the image.
A pop-up dialog with 100% zoom on image is shown where you have an option to set Offset: click on the image crosshair will be moved to this position OR edit the Offset X and Offset Y fields Anchor: drag the rectangle area (anchor) by its borders OR edit the Left, Top, Right, Bottom fields Purpose of Anchor and Crosshair When executing a script, robot: 1. 2. 3. Useful Tips: In currently open window, searches for an area that looks practically the same as the Anchor area. If this area is found, robot performs action at the Crosshair position (determined by Offset parameter). if this area is not found, an error occurs and the execution stops. The image in the Anchor area should contain static info (input label, icon, heading, table column name) that will not be changed if new data is displayed. Robot will NOT search for image that is outside the Anchor area (grayed-out part). Crosshair can be placed inside or outside of the Anchor area, depending on where the action is applied.
Coordinates Location Clicking on coordinates is not a stable solution, because it requires the same window size, screen resolution and content layout for each bot launch. To make bot click on screen coordinates: 1. 2. select the On coordinates option enter the X and Y coordinates of action point (from the top-left screen corner) Mouse Actions Mouse Click This action represents a mouse click on a given image, XPath or coordinates and supports different number of clicks and buttons: Mouse button: left right middle (wheel) Number of clicks: single double triple hold down release
Mouse Click by XPath Attention You can use the Mouse Click by XPath action only with the Open Website action. 1. Add Click Mouse to Open Website, and select the Click on web element (XPath) option:
2. 3. 4. Choose the mouse button to be used (left or right) and the type of the click (single or double). Enter your XPath in the respective field. For more details see the How to get XPath section. Search in iframe(s) use the option, if the element you need to click on is located in an iframe (or iframes) as shown on the image below: Note The iframe containing the web element can be enclosed in another iframe. In this case you should define each iframe separately. For this purpose click Add and define the iframe, which holds the iframe with the web element. When defining the iframes you should keep the following order: a. b. The first iframe the iframe containing the web element. The second iframe the parent iframe where the previous iframe is enclosed to. If there are more enclosed iframes, you should define all of them one by one so as the root iframe is on the last place. Mouse Move This action represents a mouse move (hover) on a given image or coordinates and is recorded when user stops moving cursor for more than for 1 second.
Use case: automating dynamic menus navigation where you need to hover over an item to select its child. Mouse Drag This action represents a drag and drop operation from one point ( start) to another point ( finish) on the screen and is recorded when user performs a mouse click and moves cursor while holding the mouse button. Use case: dragging an element from one panel and dropping it to another panel, using slider controls
Click here to see demo examples... The Mouse Drag action has no specific parameters and contains the following sub-actions: Start Point place where user started to hold mouse button.
Intermediate Points place(s) where user stopped moving cursor for more than 1 second while still holding mouse button. For example, these actions are needed to drag an element to a nested list. This block can contain Mouse Move actions only. Finish Point place where user released mouse button (drop).
Mouse Scroll This action represents a vertical scroll operation from a defined point on the screen measured in lines (upwards or downwards) and is recorded when user scrolls a page using mouse wheel. Mouse Scroll has 3 properties: Image bot will search for this image, and, if found, bot will put cursor at the crosshair position and scroll a defined number of lines. Number of lines to scroll how many screen lines will be scrolled. Scroll direction up or down.