codeburn/docs/release-acceptance/cases.csv
Aditya Vikram Singh 3432bac335 test(perf): add Phase 0 wait-path harness and pin main baselines
Scripted isolated-HOME measurements for session parse, incremental
append, period switch, CLI cold start, and RSS. Extends the #1164
timings.csv shape without touching parser, cache, or UI hot paths.
2026-08-29 23:45:46 +05:30

8.8 KiB

1idphasepersonasurfacetestmethodautomationevidencethresholdblockingowner
2RA-PROV-001provenancebothallAuthoritative remote SHA and ancestry pinnedscriptfullprovenance.jsonexact matchyesrelease
3RA-PROV-002provenancebothallCLI Desktop Menu Bar manifest versions agreescriptfullprovenance.jsonno unexplained driftyesrelease
4RA-PROV-003provenancebothallArtifact hashes and build inputs recordedscriptfullprovenance.jsonall distributables hashedyesrelease
5RA-PROV-004provenancebothallBuild leaves tracked worktree cleanscriptfullrun.jsonno tracked mutationyesbuild
6RA-INV-001inventorybothallPATH npm bun brew and app-bundle inventoryshellpartialresidue.csvno unintended duplicateyesrelease
7RA-INV-002inventorybothallProcesses helpers mounted images and launch itemsshellpartialresidue.csvno stale active copyyesrelease
8RA-INV-003inventorybothallConfig cache state and reversible backup sizesshellpartialresidue.csvbackup verifiedyesrelease
9RA-BUILD-001buildACLIRoot tests and lock testsscriptfullautomated-results.jsonall non-quarantined passyesengineering
10RA-BUILD-002buildADesktopDesktop tests typecheck and packagescriptpartialautomated-results.jsonpassyesdesktop
11RA-BUILD-003buildAMenu BarSwift tests universal package and deployment targetscriptfullautomated-results.jsonpassyesmenubar
12RA-BUILD-004buildAWebProduction dashboard buildscriptfullautomated-results.jsonpassyesweb
13RA-INSTALL-001installACLIPacked artifact install version and process pathshellpartialinstall.jsonexact candidateyesrelease
14RA-INSTALL-002installADesktopTwo uninstall reinstall cyclescomputer-usemanualclick-through.csvexact candidate twiceyesdesktop
15RA-INSTALL-003installAMenu BarTwo uninstall reinstall cyclescomputer-usemanualclick-through.csvexact candidate twiceyesmenubar
16RA-INSTALL-004installAmacOSSigning entitlements and Gatekeepershellpartialinstall.jsonrelease policy satisfiedyesrelease
17RA-INSTALL-005installAallQuit relaunch logout login persistencecomputer-usemanualclick-through.csvone healthy copyyesrelease
18RA-A-001onboardingADesktopZero-state onboarding every page and choicecomputer-usemanualclick-through.csvall destinations inspectedyesproduct
19RA-A-002onboardingADesktopTelemetry opt-out is clear and honoredcomputer-usemanualscreenshotzero remote transmissionyesprivacy
20RA-A-003onboardingADesktopEmpty overview is honest and non-evaluativecomputer-usemanualscreenshotno false grade or totalsyesproduct
21RA-A-004onboardingACLIHelp invalid options no-data and first outputshellfullautomated-results.jsonactionable bounded outputyescli
22RA-UI-001clickthroughADesktopEvery primary destinationcomputer-usemanualclick-through.csvclicked and inspectedyesdesktop
23RA-UI-002clickthroughADesktopEvery settings page control and disclosurecomputer-usemanualclick-through.csvclicked and inspectedyesdesktop
24RA-UI-003clickthroughADesktopPeriods custom dates providers filters sorts searchcomputer-usemanualclick-through.csvcorrect stateyesdesktop
25RA-UI-004clickthroughADesktopDetail drawer back forward refresh and shortcutscomputer-usemanualclick-through.csvcorrect stateyesdesktop
26RA-UI-005clickthroughADesktopResize zoom light dark system keyboard-onlycomputer-usemanualclick-through.csvno inaccessible contentyesaccessibility
27RA-UI-006clickthroughADesktopAccessibility roles labels focus ordercomputer-usemanualclick-through.csvno critical gapyesaccessibility
28RA-UI-007clickthroughAMenu BarStatus item visible and left-click popovercomputer-usemanualclick-through.csvgenuine click and state inspectionyesmenubar
29RA-UI-008clickthroughAMenu BarRight-click menu settings refresh quitcomputer-usemanualclick-through.csvgenuine click and state inspectionyesmenubar
30RA-UI-009clickthroughAMenu BarAll periods modes providers disclosurescomputer-usemanualclick-through.csvcorrect stateyesmenubar
31RA-UI-010clickthroughAWebFirst paint routes periods modes providersbrowsermanualclick-through.csvclicked and inspectedyesweb
32RA-UI-011clickthroughAWebBack forward reload resize themes device searchbrowsermanualclick-through.csvcorrect stateyesweb
33RA-PERF-001performanceACLIGolden packed cold three trialsshellpartialtimings.csvidentical totals and baseline comparisonyesperformance
34RA-PERF-002performanceACLIGolden packed warm five trialsshellpartialtimings.csvidentical totals and baseline comparisonyesperformance
35RA-PERF-003performanceADesktopVisible and settled launchshell+computer-usemanualtimings.csvprogress and product SLAyesperformance
36RA-PERF-004performanceAWebFirst useful paint and warm actionsbrowsermanualtimings.csvflag feedback over 250ms or navigation over 1snoperformance
37RA-PERF-005performanceBDesktopHeavy cold first useful complete peak CPU RSSshell+computer-usemanualtimings.csvprogress plus product SLAyesperformance
38RA-PERF-006performanceBallWarm navigation and detail actionscomputer-usemanualtimings.csvflag warm action over 1snoperformance
39RA-PERF-007performanceBCLISynthetic fixture session-parse cold three trialsscriptfulltimings.csvidentical totals and baseline comparisonyesperformance
40RA-PERF-008performanceBCLIAppend-only incremental reparsescriptfulltimings.csvsame-inode delta cheaper than cold parseyesperformance
41RA-PERF-009performanceBserveWarm 7D/30D period switch wait-path five trialsscriptfulltimings.csvp50/p95 recorded against 250ms targetyesperformance
42RA-PERF-010performanceBCLIDesktop and Menu Bar wait-path cold startscriptfulltimings.csvwait-path only; UI remains computer-usenoperformance
43RA-ACC-001accuracyAallGolden calls sessions and token familiesindependent-calculationpartialaccuracy.csvexact equalityyescorrectness
44RA-ACC-002accuracyAallGolden cost priced unpriced estimatedindependent-calculationpartialaccuracy.csvexact sub-cent semanticsyescorrectness
45RA-ACC-003accuracyAallUTC local boundaries custom datesindependent-calculationpartialaccuracy.csvexact documented boundaryyescorrectness
46RA-ACC-004accuracyAallDuplicate resume subagent attributionindependent-calculationpartialaccuracy.csvexact invariantyescorrectness
47RA-ACC-005accuracyAallIdentical filters across CLI TUI Desktop Menu Bar Webmixedmanualaccuracy.csvexact equalityyescorrectness
48RA-ACC-006accuracyBallThirty raw sessions over five providers or all availableindependent-samplemanualaccuracy.csvevery mismatch investigatedyescorrectness
49RA-ACC-007accuracyBallPlans quotas cache reasoning delegated casesindependent-samplemanualaccuracy.csvsemantics reconciledyescorrectness
50RA-REC-001recoveryACLIOffline startup and cached datashellpartialrecovery.jsonbounded honest stateyesreliability
51RA-REC-002recoveryACLIUnreadable provider file copyshellpartialrecovery.jsonactionable degraded warningyesreliability
52RA-REC-003recoveryACLIExclusive locked SQLite copyshellpartialrecovery.jsonnever silently emptyyescorrectness
53RA-REC-004recoveryAallCorrupt and interrupted cache copyshellpartialrecovery.jsonself-heal or actionable erroryesreliability
54RA-REC-005recoveryACLIConcurrent runs and identical totalsshellpartialrecovery.jsonno corruption or mismatchyesreliability
55RA-REC-006recoveryACLISIGINT then restartshellpartialrecovery.jsonclean bounded recoveryyesreliability
56RA-REC-007recoveryADesktopQuit removes all owned processescomputer-use+shellmanualrecovery.jsonwithin product SLAyesdesktop
57RA-REC-008recoveryAMenu BarSleep wake display sleep and relaunchcomputer-use+shellmanualrecovery.jsonitem and refresh recoveryesmenubar
58RA-REC-009recoveryAallStale cache and live corpus changemixedmanualrecovery.jsonno stale success claimyescorrectness
59RA-REC-010recoveryAallNo-data and unavailable-provider distinctionmixedmanualrecovery.jsonno false empty resultyescorrectness
60RA-RES-001residuebothallExactly one intended active install per surfaceshellpartialresidue.csvno duplicate path or processyesrelease
61RA-RES-002residuebothallCompatible history config restored and caches rebuiltshellpartialresidue.csvverifiedyesrelease
62RA-RES-003residuebothallBackups inert checksummed and documentedshellpartialresidue.csvnot on PATH or activeyesrelease
63RA-RES-004residuebothallNo mounted image installer helper or stale login itemshellpartialresidue.csvnoneyesrelease
64RA-REV-001reviewbothallIndependent finding reproduction and code reviewreviewmanualrun.jsonsign-off recordedyesquality
65RA-REV-002reviewbothallAffected-machine proof for environment-specific defectexternal-testmanualrun.jsonreporter evidenceconditionalquality