Engineering TestingPlaywrightTestRail

Playwright Pro — TestRail

Sync Playwright tests with TestRail test management.

$skillfish add ~skills/playwright-pro-testrail

Real Examples Get Started Models & Context

Real Conversations

See how the Playwright Pro — TestRail skill responds to actual requests. These are representative examples of what your AI agent will produce.

You

We just ran our regression suite. Can you push the results to TestRail run ID 1042? TESTRAIL_URL, TESTRAIL_USER, and TESTRAIL_API_KEY are all set.

Agent

Credentials confirmed. Running tests and pushing results to Run #1042. This skill includes executable scripts — I'll need your permission before running them.

Step 1 — Run with JSON reporter:

npx playwright test --reporter=json > test-results.json

Step 2 — Parse annotations: Found 127 tests with type: 'testrail' annotations, 7 without.

Step 3 — Pushing to Run #1042 via testrail_add_result:

  C10041: PASS  (auth/login.spec.ts:14)
  C10042: PASS  (auth/login.spec.ts:28)
  C10055: FAIL  — Expected '/dashboard', Received '/login' (checkout.spec.ts:67)
  C10056: PASS  (checkout.spec.ts:82)
  ... (123 more)

Result:

Pushed: 127 results
  Passed:  124
  Failed:  2
  Skipped: 1

7 tests have no TestRail annotation — not pushed:
  e2e/experimental/new-onboarding.spec.ts (lines 12, 34, 56, 78, 90, 102, 114)

TestRail Run #1042:
  https://acme.testrail.io/index.php?/runs/view/1042

The 7 unannotated tests are in your experimental file. Add test.info().annotations.push({ type: 'testrail', description: 'CXXXXX' }) to link them. Want me to look up matching case names and add the annotations?

You

Our QA team maintains 85 manual test cases in TestRail project 4, suite 12. Can you generate Playwright tests from them?

Agent

Fetching cases from TestRail project 4, suite 12 via testrail_get_cases.

Fetched: 85 cases across 6 sections

Authentication (12) | User Management (18) | Billing (15)
Dashboard (20)      | API Integration (11) | Settings (9)

Sample generated test (C10041: "Verify user can log in with valid credentials"):

test('should log in with valid credentials', async ({ page }) => {
  test.info().annotations.push({ type: 'testrail', description: 'C10041' });

  await page.goto('/login');
  await page.getByLabel('Email address').fill(process.env.TEST_EMAIL!);
  await page.getByLabel('Password').fill(process.env.TEST_PASSWORD!);
  await page.getByRole('button', { name: 'Sign in' }).click();
  await expect(page).toHaveURL(/\/dashboard/);
  await expect(page.getByRole('heading', { name: /welcome/i })).toBeVisible();
});

Generation complete:

Generated: 78/85 cases

7 cases need manual attention:
  C10067, C10071 — "Send test email" (requires email server mock)
  C10079–C10083 — "Export to PDF" (requires visual comparison setup)

Files created:
  e2e/auth.spec.ts            (12 tests)
  e2e/user-management.spec.ts (18 tests)
  e2e/billing.spec.ts         (15 tests)
  e2e/dashboard.spec.ts       (20 tests)
  e2e/api.spec.ts             (13 tests)

Run npx playwright test to validate. Set up an email mock for the 7 remaining cases?

Get Started

How to install and use this skill in your preferred environment.

Skills are designed for AI coding agents (Claude Code, Cursor, Windsurf) and IDE-based workflows where the agent can read files, run scripts, and act on your codebase. Web-based AI can use the knowledge and frameworks, but won't have tool access.

Models & Context

Which AI models and context windows work best with this skill.

Recommended Models

Best

Claude Opus 4 Claude Sonnet 4 GPT-4.1 Gemini 2.5 Pro Grok 3 Kimi K2

Good

Claude Haiku 4.5 GPT-4.1 mini Gemini 2.5 Flash Grok 3 mini

Larger models produce more detailed, production-ready outputs.

Context Window

This skill's SKILL.md is typically 3–10 KB — fits in any modern context window.

8K Skill only

32K+ Skill + conversation

100K+ Skill + references + codebase

All current frontier models (Claude, GPT, Gemini) support 100K+ context. Use the full window for complex multi-service work.

Pro tips for best results

1

Be specific

Include numbers — users, budget, RPS — so the skill can size the architecture.

2

Share constraints

Compliance needs, team size, and existing stack all improve the output.

3

Iterate

Start with a high-level design, then ask follow-ups for IaC, cost analysis, or security review.

4

Combine skills

Pair with companion skills below for end-to-end coverage.

Ready to try Playwright Pro — TestRail?

Install the skill and start getting expert-level guidance in your workflow — any agent, any IDE.

$skillfish add ~skills/playwright-pro-testrail

← Browse all 169 skills