Skip to content
OpenAgentSkill
Browsing is open · Catalog captured 2026-11-21 · Automatic updates and account services are paused.
Design & UI

integration-e2e-testing

Integration and E2E test design principles, ROI calculation, test skeleton specification, and review criteria. Use when designing integration tests, E2E tests, or reviewing test quality.

shinpr · AI review on file

Installation

Read the source and dependencies before running a command. Copying does not install or execute anything.

npx skills add shinpr/claude-code-workflows --skill integration-e2e-testing

About this skill


name: integration-e2e-testing description: Integration and E2E test design principles, ROI calculation, test skeleton specification, and review criteria. Use when designing integration tests, E2E tests, or reviewing test quality.

Integration and E2E Testing Principles

References

E2E test design: See references/e2e-design.md for UI Spec-driven E2E test candidate selection and browser test architecture. The reference uses Playwright as the default browser harness; substitute the project's standard when different.

Test Type Definition and Standard Budgets

Test TypePurposeScopeExternal DepsStandard Budget per Input Design DocImplementation Timing
IntegrationVerify component interactions in-processPartial system integration (in-process modules; for UI components, the framework's in-process renderer e.g., RTL+MSW for React/TS)Mocked or in-processMAX 3Created alongside implementation
fixture-e2eVerify UI behavior in a browser with deterministic fixturesFull UI flow with mocked backend / fixture-driven stateMocked / fixture only — no live servicesMAX 3Created alongside the UI feature
service-integration-e2eVerify critical user journeys against a running local stackFull system across servicesLive local services or stubsMAX 1-2Executed only in the final phase

Lane selection (E2E only):

  • Default lane for user-facing UI journeys is fixture-e2e — it runs a real browser against deterministic fixtures, catches the bugs that unit/integration tests miss (button no-op, state never updates, navigation breaks), and runs in CI without infrastructure setup
  • Add service-integration-e2e only when the journey's correctness depends on real cross-service behavior (data persistence, transactional consistency, external service contracts) that cannot be faked safely

One input Design Doc is one budget scope: apply each lane budget once across all ACs and candidates in that document. The two E2E lanes are budgeted independently — having a fixture-e2e for a journey does not consume the service-integration-e2e budget and vice versa. Treat the numbers above as enforced standard budgets. Exceed a budget only when an accepted requirement or a distinct failure mode cannot be proved by a selected test; annotate that exception and why consolidation cannot cover it.

Behavior-First Principle

Include (High ROI)

  • Business logic correctness (calculations, state transitions, data transformations)
  • Data integrity and persistence behavior
  • User-visible functionality completeness
  • Error handling behavior (what user sees/experiences)

Redirect to Other Test Types

  • External service connections → Verify via contract/interface tests
  • Performance metrics → Verify via dedicated load testing
  • Implementation details → Verify observable behavior instead
  • UI layout specifics → Verify information availability instead

Principle: Test = User-observable behavior verifiable in isolated CI environment

ROI Calculation

ROI is used to rank candidates within the same test type (integration candidates against each other, E2E candidates against each other). Cross-type comparison is unnecessary because integration and E2E budgets are selected independently.

For every candidate, record the governing evidence for each ROI input before assigning a value. Use an approved PRD, confirmed requirement context, accepted contract or legal obligation, user-confirmed test value context, Design Doc boundary, and existing-test evidence as applicable. A missing value is unknown, not 0, and an inference is not observed evidence.

When ROI can change candidate ranking, a lane threshold, or budget selection, return the exact missing product input and its decision effect when test_value_context has not yet supplied it. After that single input round, apply the supplied facts and retain every remaining value as decision-relevant unknown with its numeric score unset. Resolve Defect Detection from repository evidence at the proof boundary and in existing tests. When selection is invariant because the candidate is removed before ROI, is the sole eligible candidate for a reserved journey slot, or all surviving candidates fit an unthresholded budget, record the unknown as not_decision_relevant and keep its numeric score unset.

Unknown-Value Ordering

For candidates with a decision-relevant unknown after the value-input round, use accepted legal or contractual obligation, explicit connection to the confirmed user or business outcome, distinct Defect Detection evidence, lower lane ownership cost, then source AC order. Select the smallest set that proves the accepted obligations and confirmed outcome boundaries, within the normal lane budgets. Numeric lane thresholds apply to fully scored candidates; this evidence ordering supplies the selection decision for affected candidates. Record the unknown input, evidence checked, and selection effect.

For resolved numeric inputs, use exactly 0, 5, or 10. Legal Requirement remains boolean; a governing-source check that finds no accepted legal, regulatory, contractual, or audit obligation supports false and records that checked source.

InputScale
Business Value0 = no user/business outcome; 5 = meaningful but non-critical outcome; 10 = core, revenue, safety, or data-integrity outcome
User Frequency0 = unreachable/obsolete; 5 = regular subset of users or runs; 10 = dominant journey or execution path
Legal Requirementtrue only when an accepted legal, regulatory, contractual, or audit requirement applies; otherwise false
Defect Detection0 = duplicates existing proof; 5 = covers a distinct branch/state; 10 = uniquely detects a critical boundary or cross-service failure
ROI Score = Business Value × User Fr
Read the complete source ↗