Skip to content

Latest commit

 

History

History
94 lines (87 loc) · 4.43 KB

ai_feature.md

File metadata and controls

94 lines (87 loc) · 4.43 KB

Co.meta steps table of contents

Co.meta offers versatile and easy to use steps like "Goto URL {URL}" or "Move mouse to {selector} and click". Below is a list of grouped actions by topic.

  1. AI - actions

AI actions

Action Description Example
Validate current screen to contain "{object_name}" with "{options}" Validates whether the current screen contains a specified object.

Additional options can be provided to refine the validation.
Example 1:
Validate current screen to contain "Car"
Example 2 (refine validation):
Validate current screen to contain "Car" with "color:red"
Get list of visible objects in the current screen and store in "{variable}" with "{options}" Retrieves the list of visible objects on the current screen and stores it in a specified variable.

Additional options can refine the list.
Example 1:
Get list of visible objects in the current screen and store in "myObjects"
Example 2 (refine validation):
Get list of visible objects in the current screen and store in "myObjects" with "visible_only"
Get information based on "{user_message_to_ai}" and store in "{variable}" with "{options}" This step allows you to send a specific request or instruction to the AI, along with images or other data for analysis. The AI's response will be stored in a specified variable.

Optionally, you can modify how the result is processed by using the "Output JSON" option.
Example 1:
Get information based on "[{\"content\": \"Get the visible car color\", \"images\": [\"screenshot1\"]}]" and store in "chart_analysis" with "Output JSON"
Example 2:
Get information based on "[{'content': 'Identify all buttons on the screen', 'images': ['ui_screenshot']}}]" and store in "button_list" with "Output JSON"
Get information from current screen based on "{prompt}" and store in "{variable}" with "{option}" Analyzes the current screen based on the given prompt and stores the result in a specified variable. Optionally, the result can be formatted in JSON using the "Output JSON" option. Example 1:
Get information from current screen based on "[{\"content\": \"Extract visible text\"}]" and store in "extracted_text"
Example 2:
Get information from current screen based on "[{\"content\": \"Identify all input fields\"}]" and store in "input_list" with "Output JSON"
Get screenshot and store in the variable "{variable_name}" This step captures a screenshot of the current screen and stores it in the specified variable. Example 1:
Get screenshot and store in the variable "current_screen"
Show me variable "{variable_name}" value for "{seconds}" seconds Displays the value of a specified variable for a certain number of seconds. Example 1:
Show me variable "myVariable" value for "5" seconds
Assert variable "{variable_name}" using jq_pattern "{jq_pattern}" to "{condition}" "{value}" This step asserts that a value within a stored variable matches or contains a specified value using a JQ pattern. It is useful for validating JSON-like data structures stored in variables. Example 1:
Assert variable "api_response" using jq_pattern ".status" to "match" "success"
Example 2:
Assert variable "api_response" using jq_pattern ".message" to "contain" "completed successfully"
Assert variable "{variable_name}" to "{condition}" "{value}" Asserts the value of a variable directly using a condition (match or contain). Example 1:
Assert variable "status_code" to "match" "200"
Example 2:
Assert variable "response_message" to "contain" "Operation completed"