Skip to main content

Image Search

Please read the Material Usage Rules on this site.

🔗 Original page — Source of this material

Description​

Allows you to click an element using visual search. It’s recommended to use this when it’s not possible to locate the element by other means, or if the element is drawn with Flash or canvas.

Attention

This operation uses a lot of computer resources.

image-20200813-211635

How to add to your project?​

Hover your mouse over the element and call the context menu with the right mouse button.

image-20200813-211831

What is it used for?​

  • Clicking an element that can’t be accessed using the ❗→ Run Event action.

How does the window work?​

image-20200814-180030

  1. Adjustable search area – select a unique part of the element. If you’re selecting a button, you don’t need to select the entire thing, since it may contain a lot of uniform color.
  2. Click target – sets the click location inside the search area, and can be moved.
  3. Match accuracy.
  4. Search – search for the element in the browser window.

image-20210613-082930

Info

After you click the Search button, the found element in the browser window will be highlighted with a red frame.

  1. Yes – if the element is found according to your criteria.

  2. No – the search was incorrect, change the search parameters.

When the element is correctly detected, proceed to click settings.

image-20200814-180412

  1. Choose the click type.
  2. Test execution in the browser window.
  3. Add the configured action to your project.
Example

You need to click a button using image search.

image-20200814-180819

In the browser window, open the search window and set a unique area.

Unique area

image-20200814-181437

Non-unique area

image-20200814-181200

The button contains a lot of solid color.

Set the click type—in this case, left mouse button—and test it in the browser window.

image-20200814-181604

The click was successfully performed in the browser window—add the action to the project canvas.

image-20200814-181704

All done, you can continue working with your project.

image-20200814-181851

Example use case​

This can be useful in Flash games or applications, since there’s no way to access specific elements. For example, if you need to click a button in a Flash application, the algorithm will be as follows:

image-20200814-182208

  1. Go to the page and wait for it to fully load.
  2. Hover your mouse over the element, open the context menu and select “Image Search”.
  3. Set a unique image search area and specify click parameters.
  4. Test in the browser window.
  5. Add the action to your project.