Skip to main content

Agentic Testing with Playwright CLI Skill

With the Playwright CLI, goose can navigate websites, click buttons, fill forms, and turn those interactions into Playwright tests, all from natural language. Unlike the Playwright MCP, which sends the full page structure to the LLM on every request, Playwright CLI stores the accessibility tree locally. That means faster responses, lower costs, and no issues with large pages.

Why as a Skill?​

LLMs may not be trained on Playwright's CLI, so when asking an agent to use it, it may hallucinate commands and arguments resulting in errors and wasted tokens. The Playwright CLI Skill teaches goose how to use the CLI and when to invoke specific commands.

Prerequisites​

  • Node.js 18 or later
  • Install Playwright CLI globally: 
    npm install -g @playwright/cli@latest
  • (Optional) Playwright installed if you want to run the generated tests (npm init playwright@latest)

Configuration​

Install Skill​

  1. From the command line, install the Playwright skill in your project directory:
npx skills add https://github.com/microsoft/playwright-cli --skill playwright-cli

  1. Enter y when asked to install the skills package

  2. Choose goose when asked which agent to install to

  3. Choose Global scope to be able to use the skill in any project, or Local to only have access within the current working directory

  4. Choose Symlink to have one copy that all of your agents can reference

  5. You'll get a confirmation of the installation, choose Yes to proceed

Enable Summon Extension​

In goose, enable the Summon extension to load Agent Skills within sessions.

  1. Click the button in the top-left to open the sidebar
  2. Click Extensions in the sidebar
  3. Toggle Summon on

Generate a Test with Video and Traces​

Give goose a single prompt that describes what you want to test:

Using the Playwright CLI skill, open block.github.io/goose, click on the Docs menu, click on Context Engineering, 
then click on Using Skills and generate a test with video and traces

How It Works​

Each playwright-cli command automatically outputs the corresponding Playwright code. For example, this command:

playwright-cli click e11

executes the following Playwright code:

await page.getByRole('link', { name: 'Docs' }).click();

What goose does​

  1. Opens the browser: playwright-cli open block.github.io/goose
  2. Starts recording: playwright-cli video-start and playwright-cli tracing-start
  3. Takes snapshots to find elements: playwright-cli snapshot
  4. Performs clicks: playwright-cli click <ref>
  5. Stops recording: playwright-cli video-stop and playwright-cli tracing-stop
  6. Assembles the generated code into a test file

Generated Files​

FileDescription
tests/using-skills-navigation.spec.tsYour Playwright test
.playwright-cli/video-*.webmVideo recording of the session
.playwright-cli/traces/*.traceTrace file for debugging

Generated Test Code​

The generated test might look like:

import { test, expect } from '@playwright/test';

test('navigate to Using Skills guide via docs menu', async ({ page }) => {
  await page.goto('https://block.github.io/goose');
  await expect(page).toHaveTitle(/goose/);
  
  // Click on Docs in the navigation
  await page.getByRole('link', { name: 'Docs' }).click();
  
  // Expand Context Engineering category
  await page.getByRole('button', { name: 'Expand sidebar category \'Context Engineering\'' }).click();
  
  // Click on Using Skills
  await page.getByRole('link', { name: 'Using Skills' }).click();
  
  // Verify navigation
  await expect(page).toHaveURL(/using-skills/);
  await expect(page.getByRole('heading', { level: 1 })).toContainText('Using Skills');
});

Running the Test​

goose can even run the test for you to make sure it works as expected. If Playwright is already set up, just ask it to run the test. If not, goose can install Playwright for you and then run the test.

Viewing the Video​

To see a video of what happened, prompt goose:

Show me the video

goose will use the CLI to open the recorded video, so you can see exactly what happened during the session.

Viewing the Trace​

To debug or review what happened, prompt goose:

Open the trace

The trace viewer shows:

  • Timeline of all actions
  • Screenshots before/after each action
  • Console logs and errors
  • Network requests
  • Element locators used

Visual Dashboard for Multiple Sessions​

When you have goose running several browser tasks at once, it can be hard to keep track of what's happening. The visual dashboard gives you a bird's eye view of all your active browser sessions, letting you watch progress in real time or jump in and take control when needed.

Show playwright dashboard

From here you can see live previews of every browser goose is controlling. Click into any session to watch it full-size, or take over the mouse and keyboard yourself if goose needs a hand. Press Escape when you're done and goose picks up right where you left off.

Full Capabilities​

Want to know what else the Playwright skill can do? Ask goose:

What else can you do with the Playwright skill?
CategoryCapabilities
Browser Controlopen, goto, click, fill, close
Capture & Debugscreenshot, snapshot, video, trace
Tab ManagementOpen, switch, close tabs
Storage & AuthSave/restore cookies, handle login states
NetworkMock APIs, intercept requests
InputType text, press keys, mouse actions

Example Use Cases​

  • ✅ Test web applications with natural language
  • ✅ Fill out forms automatically
  • ✅ Scrape data from websites
  • ✅ Debug issues with video recordings
  • ✅ Test authentication flows
  • ✅ Record demos for documentation
  • ✅ Mock APIs for isolated testing

Conclusion​

Getting started with the Playwright CLI agent skill is easy and opens up powerful browser automation capabilities directly from natural language prompts. Whether you're generating tests, debugging with videos and traces, or automating complex interactions, the Playwright CLI agent skill provides a token-efficient way to leverage Playwright's full power with goose.

Resources​