For the complete documentation index, see llms.txt. This page is also available as Markdown.

Example combination for Image

To create a smart automation script that smoothly handles real-world scenarios on the website or software UI, combining these three actions in a tight logical flow is the optimal solution.

Below is a detailed explanation of the common technical parameters and the steps to set up the flow for a practical script.

🎥 Watch the tutorial video: Here.

Core configuration parameters to master:

  • Image: The target image area you cut from the screen to serve as matching data for the system.

  • Timeout: The maximum time limit for the system to search for the image (only applies to Wait to image).

  • Threshold: The accuracy rate when matching pixels (usually set from 0.7 to 0.95). The closer the number is to 1, the more the actual image must resemble the sample image absolutely. You can adjust this value and test until it fits.

  • True color: An option that requires the system to match the original color range accurately. If turned off, the system will convert the image to black and white (Grayscale) for shape recognition, which speeds up scanning but ignores color factors.

  • Output variable: A variable that stores a logical value (True/False) or the coordinates of the point (X, Y) depending on the selected action.

Practical problem: Automatically click "Continue with Google" on Pinterest

Step 1: Synchronize page load flow with the action Wait to image

After you click the Sign up button on the Pinterest homepage, the registration form needs a short time to load data onto the screen.

  • Configuration method: Point the sample image (Image) at the title of the text line or a fixed component (Continue with Google button) that is sure to appear on the registration form. Set the Timeout to 10 (10 seconds) and adjust the Threshold accordingly (for example: 0.7).

  • Operational logic: The script will pause to observe the screen. As soon as the registration form appears, the system immediately activates the next step without wasting time waiting.

🔹 Step 2: Check the existence of the button with the action Image exists

Since Pinterest may display the Email input form overlay or show a different navigation message depending on each Profile, we need to check if the Google button is actually on the screen.

  • Configuration method: Point the sample image at the four-color "G" icon of Google or the text line Continue with Google. Configure the output variable to store the result.

  • Operational logic: The system scans the screen quickly at that moment exactly once. If the Google button appears, the output variable will receive a logical value of True (otherwise False).

🔹 Step 3: Filter processing conditions with the If block

To ensure the script runs smartly and does not experience click misses, we wrap the interaction steps in the conditional block.

  • Configuration method: Add an If block and set the condition: Check if the result variable in Step 2 returns the value True (meaning the Google button is ready on the screen).

🔹 Step 4: Find the exact position in the If block with the action Image search

Inside the If block, when the condition is met, the system starts tracing to get the coordinates of the button (since the position of the registration form may shift flexibly depending on the screen resolution of each Profile).

  • Configuration method: Use the sample image of the "Continue with Google" button or the "G" logo. Set True color to Yes (Must be enabled to accurately recognize the four characteristic colors of Google, avoiding confusion with other letter characters). Set the output variable to store the coordinates as pos.

  • Operational logic: The system scans and calculates the exact position of the Google button on the screen (For example: $pos = 720,540).

🔹 Step 5: Perform a mouse click with the action Mouse click

This is the final step in the If block to complete the processing flow.

  • Configuration method: Select the Mouse click action, and in the coordinate setup box, you directly pass the variable found in the previous step into the corresponding box: $pos.

  • Operational logic: The mouse on the system will automatically move to the exact pixel position of the Google button that has been scanned and execute the click command to continue the login flow smoothly through the Iframe layer.

Last updated

Was this helpful?