Test order dependency detector. Runs the test suite multiple times with different randomized orderings (using jest --randomize, pytest-randomly, or go test -shuffle) to identify tests that only pass when run after specific other tests — a sign of shared global state leakage. Generates an isolation dependency graph and recommends beforeEach/afterEach fixes. Env vars: TEST_ORDER_RUNS, TEST_ORDER_TIMEOUT. (qa-agentic-team)
This listing is imported from SkillsMP metadata and should be treated as untrusted until upstream source review is completed.
Install skill "qa-test-order" with this command: npx skills add vslvslv/skillsmp-vslvslv-vslvslv-qa-test-order
This source entry does not include full markdown content beyond metadata.
This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.
Related by shared tags or category signals.
AI API cost tracking and budget gate. Reads token usage metadata from CTRF output files produced by qa-* skills, computes estimated cost per skill using current Claude model pricing, and can block CI if the total run cost exceeds a configured budget. Provides financial observability alongside functional QA observability. Env vars: QA_COST_BUDGET, QA_COST_MODEL. (qa-agentic-team)
Test coverage delta gate. Runs the project's coverage tooling, computes per-file coverage change between the current branch and the base branch, and blocks CI if changed files drop below a configurable threshold. For files below threshold, generates LLM-suggested test stubs targeting the specific uncovered lines. Env vars: COVERAGE_THRESHOLD, COVERAGE_COMPARE_BRANCH, COVERAGE_GENERATE_STUBS. (qa-agentic-team)
Service dependency smoke test. Spins up all declared service dependencies from test-env.yml or docker-compose.yml using Docker Compose or Testcontainers, runs a lightweight health check against each service (database connection, cache ping, HTTP health endpoint, message queue connectivity), then tears down. Catches infrastructure drift before full integration tests run. Env vars: DEPS_TIMEOUT, DEPS_KEEP_RUNNING. (qa-agentic-team)
Eval-driven CI gate for AI features. Enforces that every AI feature shipped has a passing evaluation harness before the PR merges. Discovers eval files in evals/ or tests/evals/ directories, runs them with the detected eval runner, scores results, and blocks CI if the aggregate pass-rate drops below a configurable threshold. Env vars: EVAL_PASS_THRESHOLD, EVAL_FAIL_FAST, ANTHROPIC_API_KEY. (qa-agentic-team)