Brief Summary
This video introduces AskUI, an AI-driven tool designed to automate software testing across multiple platforms. It addresses the challenges of writing brittle tests for Android, iOS, and web applications. AskUI uses AI agents to scan screens, identify elements, and interact with them using natural language commands or SDK tools. The video demonstrates AskUI's capabilities through simple examples and a more complex Android application test, highlighting its platform-agnostic nature and ease of use.
- AskUI automates software testing using AI agents.
- It supports multiple platforms, including Android, iOS, and web.
- Testing can be performed using natural language commands or SDK tools.
Intro
The video starts by highlighting the common problem of writing brittle tests for various platforms like Android, iOS, and web, or skipping testing altogether, which can lead to application crashes in production. The presenter introduces AskUI as a solution, an AI agent that can scan screens, identify elements, and interact with them using plain English commands. The initial setup involves running the command pip install aski.
How it works
The presenter demonstrates how AskUI works through a simple example. A script is executed to click on the text "notepads" on the screen. AskUI scans the screen, identifies the text, and moves the mouse to click it. The tool constantly scans the screen, reads the information, determines the position of elements, and interacts with them. This can be done using natural language or tools provided through the SDK, such as act, click, close, and get. Another example involves using natural language to check if the text "create new notepad" is visible on the screen and asserting that the answer is yes using pytest. The presenter shows that either natural language or SDK methods can be used interchangeably to perform actions.
Android application test
The presenter demonstrates AskUI on an Android application with a subscription screen. The test involves entering a promo code ("save 20"), applying it, and verifying that a 20% discount is applied. The AskUI script clicks on the "enter promo code" text, types in "save 20", clicks the "apply" button, clicks "great" on the modal, and then checks if the text "20% off first month" is visible. The test passes if the text is found. The presenter modifies the script to look for a non-existent piece of text, causing the test to fail, demonstrating AskUI's accuracy. The code is platform-agnostic, allowing it to run on Android, iOS, and other devices, including physical devices.
Outro
The presenter summarizes that AskUI allows for a single test suite to handle multiple platforms without code changes. They encourage viewers to download AskUI from askui.com.
