← Home
Sample · Tier 3 Full Suite · anonymized demo
QA Automation Report
Sample showing what a Tier 3 full report looks like. No real client data — fictional Demo Service data — but the same structure: per-module automation rate · execution results · ambiguous / blocked / manual / skip classification.
480
Automated
12
Blocked
4
Manual
80
Skipped
01 · Automation coverage
Automation rate per module
| Module | Description | Total | Automation |
|---|---|---|---|
| AUTH | Auth · Login | 64 | 100% |
| USER | User Profile | 52 | 100% |
| HOME | Homepage | 38 | 100% |
| ORDER | Order Flow | 96 | 100% |
| PAY | Payments | 72 | 100% |
| ADMIN | Admin Console | 84 | 100% |
| NOTIFY | Notifications · Email | 36 | 100% |
| BILLING | Billing · Invoice | 48 | 100% |
| API | Public API | 56 | 100% |
| WEB | Web SSR · SEO | 30 | 100% |
02 · Execution results
PASS / FAIL / SKIP per module
| Module | Pass | Fail | Skip | Total |
|---|---|---|---|---|
| AUTH | 60 | 0 | 4 | 64 |
| USER | 48 | 0 | 4 | 52 |
| HOME | 36 | 0 | 2 | 38 |
| ORDER | 88 | 0 | 8 | 96 |
| PAY | 64 | 0 | 8 | 72 |
| ADMIN | 70 | 0 | 14 | 84 |
| NOTIFY | 30 | 0 | 6 | 36 |
| BILLING | 40 | 0 | 8 | 48 |
| API | 50 | 0 | 6 | 56 |
| WEB | 24 | 0 | 6 | 30 |
03 · Classifications
Ambiguous · Manual · Blocked · Skipped
Ambiguous
Cases needing interpretation or a policy decision
- ORDER-042Stock concurrency — race-case consistency needs defining
- PAY-018Refund prorated vs full — policy TBD
- ADMIN-067Whether role change expires existing sessions
Manual
Not suitable for automation — external dependencies or real verification needed
- PAY-001PG auth page — external iframe, Playwright limits
- AUTH-006OAuth (Google) — respond to provider-side changes
- NOTIFY-014Real email deliverability verification
Blocked
Awaiting UI release or upstream work
- ADMIN-080Awaiting new policy UI release
- BILLING-024Enable after new Stripe webhook implemented
04 · Module detail (example)
AUTH module — per-case status
Each module lays out case ID · status · description in a table. Only one module shown here as example.
| ID | Status | Description |
|---|---|---|
| AUTH-001 | PASS | Email + password sign-in golden path |
| AUTH-002 | PASS | Lock for 5 min after 5 failed password attempts |
| AUTH-003 | PASS | Magic link re-issue after expiry |
| AUTH-004 | PASS | Auto sign-out on session expiry |
| AUTH-005 | PASS | Only company-domain emails may sign up |
| AUTH-006 | SKIP | OAuth (Google) — external dependency, manual |
| AUTH-007 | PASS | Invite token expiry + re-issue |
| AUTH-008 | PASS | Admin role change reflects immediately |
Real reports vary per project — module counts and test-case distribution differ. The 3-tier automation setup (CI/CD · Daily · Full Suite) ships with the delivery.
← Back to home