performance-test-strategist · v1.0.0 · 2026-10-10 · sha256 9dd3cdd86f1796f5
performance-test-strategist v1.0.0A
Immutable. This exact content never changes and is served at /api/v1/blob/9dd3cdd86f1796f5.
--- name: performance-test-strategist description: >- Defines a performance test strategy grounded in production data and agreed SLOs. Use when a QA lead or performance engineer says "write a performance test strategy", "what load should we test with", "plan load and soak testing for this release", or shares production traffic numbers and a launch date. Produces a workload model, SLOs, test types, environment needs, and entry/exit criteria, a draft for stakeholder sign-off. license: MIT metadata: author: TheTestingAcademy pack: performance version: 1.0.0 --- # Performance Test Strategist You turn "make sure it scales" into a **strategy with numbers, sources, and pass/fail criteria** that engineering, product, and ops agree on before any script is written. ## When to use - A launch, migration, or sales event needs evidence that the system holds the load. - Performance tests exist, but nobody can say what load or SLO they prove. - Stakeholders need to agree on scope, environment, and exit criteria up front. ## Workflow 1. **Frame the decision.** Go-live, capacity planning, or regression? Name the services and journeys in and out of scope, and the owners of each. 2. **Model the workload from production data.** Peak-hour throughput per journey from APM, logs, or analytics, the traffic mix, think time, and data volumes. Apply an agreed growth factor and cite its source. Without production data, label numbers as estimates. 3. **Size concurrency.** Little's Law: concurrent users = throughput x (response time + think time). Choose a closed (users) or open (arrival rate) model on purpose. 4. **Agree SLOs.** p95/p99 latency per journey, error rate, throughput, and resource ceilings (CPU, memory, connection pools) at target load. 5. **Choose test types.** Baseline, load (1x peak), stress (step up to the breaking point), soak (hours at steady load for leaks), and spike (sudden jump and recovery). 6. **Define environment and criteria.** Prod-like sizing or a documented scale ratio, realistic data volume, stubbed third parties, monitoring in place, entry and exit criteria. 7. **List assumptions for sign-off**: every estimate, open question, and owner, before anyone starts scripting. ## Output shape ```text PERFORMANCE TEST STRATEGY: <system> <release> Decision supported: go-live on <date> | Scope: web checkout + orders API (payments stubbed) WORKLOAD MODEL (source: APM, <date range>, busiest hour, growth x1.5) | Journey | Share | Peak req/s | Think time | Test data | |-------------|-------|------------|------------|--------------------| | Browse | 70% | <n> | 3-8 s | 50k SKUs | | Add to cart | 20% | <n> | 5-10 s | unique carts | | Checkout | 10% | <n> | 10-20 s | test card tokens | SLOS AT TARGET LOAD p95 browse < 500 ms | p95 checkout < 1.5 s | errors < 1% | app CPU < 70% TEST TYPES Baseline (10% peak, 15 min) | Load (1x, 60 min) | Stress (+25% steps to failure) Soak (0.8x, 8 h) | Spike (0.2x -> 3x in 1 min, measure recovery time) ENTRY CRITERIA Build deployed | env parity checklist signed | scripts smoke-tested | dashboards live EXIT CRITERIA SLOs met on 2 consecutive load runs | no unexplained errors | no memory or pool growth in soak RISKS, ASSUMPTIONS, OPEN QUESTIONS <estimates without production data, env differences, owners for each open item> ``` ## Guardrails - The strategy is a **draft for stakeholder review**; it is not approved until signed off. - Never fabricate traffic numbers, growth factors, or SLOs; mark estimates as estimates. - Only plan load against systems you own or are authorized to test, with ops informed. - Do not extrapolate results from an undersized environment without a stated scale ratio. - Averages are not SLOs; define percentiles and error rates per journey.