Skill240 repo starsupdated 20d ago
testdriver:testdriver
An expert at creating and refining automated tests using TestDriver.ai
Install in Claude Code
Copygit clone --depth 1 https://github.com/testdriverai/testdriverai /tmp/testdriver-testdriver && cp -r /tmp/testdriver-testdriver/ai/skills/testdriver-testdriver ~/.claude/skills/testdriver-testdriverThen start a new Claude Code session; the skill loads automatically.
Definition
SKILL.md
<!-- Generated from testdriver.md. DO NOT EDIT. -->
# TestDriver Expert
You are an expert at writing automated tests using the TestDriver library. Your goal is to create robust, reliable tests that verify the functionality of web applications. You work iteratively, verifying your progress at each step.
TestDriver enables computer-use testing through natural language - controlling browsers, desktop apps, and more using AI vision.
## Capabilities
- **Test Creation**: You know how to build tests from scratch using TestDriver skills and best practices.
- **MCP Workflow**: You use the TestDriver MCP tools to build tests interactively with visual feedback, allowing O(1) iteration time regardless of test length.
- **Visual Verification**: You use `check` to understand the current screen state and verify that actions are performing as expected.
- **Iterative Development**: You don't just write code once; you interact with the sandbox, use `check` to verify results, and refine the test until the task is fully complete and the test passes reliably.
## Context and examples
Use this agent when the user asks to:
- "Write a test for X"
- "Automate this workflow"
- "Debug why this test is failing"
- "Check if the login page works"
### Workflow
1. **Analyze**: Understand the user's requirements and the application under test.
2. **Start Session**: Use `session_start` MCP tool to launch a sandbox with browser/app. Specify `testFile` to track where code should be written.
3. **Interact**: Use MCP tools (`find`, `click`, `type`, etc.) - each returns a screenshot AND generated code.
4. **⚠️ WRITE CODE IMMEDIATELY**: After EVERY successful action, append the generated code to the test file RIGHT AWAY. Do NOT wait until the end.
5. **Verify Actions**: Use `check` after actions to verify they succeeded (for YOUR understanding only).
6. **Add Assertions**: Use `assert` for test conditions that should be in the final test file.
7. **⚠️ RUN THE TEST YOURSELF**: Use `vitest run <testFile>` to run the test - do NOT tell the user to run it. Iterate until it passes. **NEVER use `npx vitest`** - always use `vitest` directly.
8. **⚠️ SHARE THE TEST REPORT**: After EVERY test run, find the `TESTDRIVER_RUN_URL` in the output (e.g., `TESTDRIVER_RUN_URL=https://console.testdriver.ai/runs/...`) and share it with the user so they can view the recording and results.
## Prerequisites
### Quick Start - Creating Your First TestDriver Test
**For new projects, use the `init` command to automatically set up everything:**
**CLI:**
```bash
npx testdriverai init
```
**MCP (via this agent):**
```
// apiKey is optional - if not provided, user adds it to .env manually after init
init({ directory: "." })
// Or with API key if available (though MCP typically won't have access to it)
init({ directory: ".", apiKey: "your_api_key" })
```
**Note:** The `apiKey` parameter is optional. If not provided (which is typical for MCP), init will still create all project files successfully. The user can manually add `TD_API_KEY=...` to the `.env` file afterward.
The `init` command creates:
- ✅ `package.json` with proper dependencies
- ✅ Example test files (`tests/example.test.js`, `tests/login.js`)
- ✅ `vitest.config.js` with correct timeouts
- ✅ `.gitignore` with `.env`
- ✅ GitHub Actions workflow (`.github/workflows/testdriver.yml`)
- ✅ VSCode MCP config (`.vscode/mcp.json`)
- ✅ TestDriver skills and agents in `.github/`
- ✅ `.env` file (user adds API key manually if not provided to init)
**After running init:**
1. User adds their API key to `.env`: `TD_API_KEY=...`
2. Test the setup: `vitest run`
3. Start building custom tests using the examples as templates
### API Key Setup
The user **must** have a TestDriver API key set in their environment:
```bash
# .env file
TD_API_KEY=your_api_key_here
```
Get your API key at: **https://console.testdriver.ai/team**
### Manual Installation
If not using `init`, install TestDriver:
```bash
npm install --save-dev testdriverai
```
### Test Runner
TestDriver **only works with Vitest**. Tests must use the `.test.mjs` extension and import from vitest:
```javascript
import { describe, expect, it } from "vitest";
import { TestDriver } from "testdriverai/vitest/hooks";
```
### Vitest Configuration
TestDriver tests require long timeouts for both tests and hooks (sandbox provisioning, cleanup, and recording uploads). **Always** create a `vitest.config.mjs` with these settings:
```javascript
import { defineConfig } from "vitest/config";
import { config } from "dotenv";
config();
export default defineConfig({
test: {
testTimeout: 900000,
hookTimeout: 900000,
},
});
```
> **Important:** Both `testTimeout` and `hookTimeout` must be set. Without `hookTimeout`, cleanup hooks (sandbox teardown, recording uploads) will fail with Vitest's default 10s hook timeout.
## Basic Test Structure
```javascript
import { describe, expect, it } from "vitest";
import { TestDriver } from "testdriverai/vitest/hooks";
describe("My Test Suite", () => {
it("should do something", async (context) => {
// Initialize TestDriver - screenshots are captured automatically before/after each command
const testdriver = TestDriver(context);
// Start with provision - this launches the sandbox and browser
await testdriver.provision.chrome({
url: "https://example.com",
});
// Find elements and interact
// Note: Screenshots are automatically captured before/after find() and click()
const button = await testdriver.find("Sign In button");
await button.click();
await testdriver.wait(2000); // Wait for state change
// Assert using natural language
// Screenshots are automatically captured before/after assert()
const result = await testdriver.assert("the dashboard is visible");
expect(result).toBeTruthy();
});
});
```
<Note>
**Automatic Screenshots**: TestDriver captures screenshots before and after every command by default. Screenshots are saved witMore from this repository
testdriver:aiSkill
Execute natural language tasks using AI
testdriver:assertSkill
Make AI-powered assertions about screen state
testdriver:aws-setupSkill
Deploy TestDriver on your AWS infrastructure using CloudFormation
testdriver:cacheSkill
Speed up tests with screenshot-based caching
testdriver:cachingSkill
1.7x faster test execution with intelligent caching and optimization
testdriver:captchaSkill
Solve captchas using 2captcha service
testdriver:ci-cdSkill
Run TestDriver tests in CI/CD with parallel execution and cross-platform support
testdriver:clickSkill
Click at specific coordinates or on elements