Lila CLI is a powerful tool for running end-to-end tests written in human-readable plain text using YAML files. It simplifies the testing process by allowing anyone in the team to write tests in a natural, easy-to-understand format.
No coding required.
With pip (Python>=3.11)
pip install lilacli
Install Playwright Chromium web drivers
playwright install chromium
Create your first testcase in a demo.yaml file
steps:
- goto: https://www.google.com/maps
- input: Empire State on the main search bar
verify: a dropdown with suggestions appears
- click: on the first suggestion from the dropdown
verify: the map shows the Empire State Building in NYFetch an API Key from Lila app and add it to an .env file:
LILA_API_KEY=...
Run
lila run demo.yaml
Lila runs your app in a local browser with Playwright and uses an LLM-powered engine to guide the CLI run high level instructions. Lila extracts information from the DOM using the awesome library browser-use
- No coding required.
- Self healing tests, does not rely on low level implementation.
- Anyone in the team can implement tests.
- Integrates natively with Playwright storage states.
- Runs browser locally, making it ideal for localdev or staging environments.
Tests are just YAML files. Here is the same example as the quick start.
steps:
- goto: https://www.google.com/maps
- input: Empire State on the main search bar
verify: a dropdown with suggestions appears
- click: on the first suggestion from the dropdown
verify: the map shows the Empire State Building in NYgoto: navigate to a URL
- goto: https://private.staging.my-app.comclick: perform a click on a described element
- click: on the checkout cart
# or
- click: on the direction item
# or
- click: on button 'Create'input: type text into an input field
- input: foo@bar.com as email
# or
- input: iPad mini in the main search barsubmit: submits a form by clicking a button or pressing enter
- submit: the login form
# or
- submit: the searchwait: just waits N seconds
- wait: 10 # waits 10 secondspick: pick an element from a dropdown
- pick: EST from the timezone dropdownexec: run a bash command
- exec: | # multiline
curl -X POST ...
# or
- exec: psql -c "INSERT ..." # single lineEach step can have one or more verify assertions.
- goto: https://my-app.com/login
verify: there is a login form with username and password # Single verification
- click: the checkout cart
verify: # multi verifications
- 5 items appear in the purchase summary
- the total is 500 USDFor more information on how to build tests, checkout the guides
For test examples, Lila runs daily a suite of tests over public URLs. Check them out here
Lila is free for beta users. Create your free account at https://lila.dev. You will need the account to fetch an API key to run lila CLI.
Lila runs save the browser state in the output folder. To re-use where another test left off, just pass --browser-state parameter.
For example:
login.yaml:
steps:
- goto: https://my-app.com/login
- input: foobar as username
- input: barbaz as password
- submit: the login form
verify: login was successfullila run login.yaml -> This will generate lila-output/login.json
dashboard.yaml (needs a logged in user)
steps:
- goto: https://my-app.com/dashboard
verify: there is a panel displaying metricslila run dashboard.yaml --browser-state lila-output/login.json
--browser-state: Initialize the browser with a Playwright JSON storage session--tags: Filter tests by specified comma-separated tags--exclude-tags: Filter out tests by specified comma-separated tags--output-dir: Specify the output directory for the browser states--config: Point to thelila.tomlconfig file if not using the root location--headless: If present, does not open browser--debug: Displays debug logs
Checkout an example for a daily run using GHA
For comprehensive documentation, visit docs.lila.dev.
Find a variety of test examples in our examples repository, showcasing different testing scenarios and best practices.
Reach out at info@lila.dev
Join our Discord server
Follow us at Twitter - X