A little care for unfinished software
Half-built.
Still full of possibility.
Turn what's going wrong into a clearer next step. Describe your app and get a provisional recovery plan grounded in the details you share.
Live admissions open · Sample charts are open
Chart no. 01
Fictional sample
The Booking App With Double Reservations
Reported symptom
Duplicate bookings appear when two users grab the same slot at once.
Provisional hypothesis · not confirmed
A race condition allows two concurrent requests to both pass the availability check and insert a booking.
Next steps to verify
- Reproduce the race condition and verify atomic reservation enforcement
- Add a unique constraint to the bookings table
- Based on your description
- Clear steps to verify
- A plan you can take with you
The fictional ward
Meet three fictional patients
No sign-in, no AI calls. Each opens a full chart with evidence, a checklist, and a downloadable plan.
No. 01 · Concurrency
Fictional
The double reservation
The Booking App With Double Reservations
Duplicate bookings appear when two users grab the same slot at once.
Open patient chart: The Booking App With Double ReservationsNo. 02 · Payments
Fictional
The uncertain payment
The Storefront With Uncertain Payment State
Order statuses flip between paid and unpaid after payment.
Open patient chart: The Storefront With Uncertain Payment StateNo. 03 · Access control
Fictional
The crossed boundaries
The SaaS Portal With Confusing Access
A user sees another tenant's records in their portal.
Open patient chart: The SaaS Portal With Confusing Access
How it works
Describe, understand, verify
01
Describe
Say what the app is for, what works, and what fails. Text only, with secrets and customer data removed.
02
Understand
Answer up to three clarifying questions, then read a provisional diagnosis that keeps what you reported apart from what is only a hypothesis.
03
Verify
Work through the recovery plan with its acceptance criteria. A task is verified only when you tick every check yourself.
Read this first
What this can't do
- It reads only the text you provide. It does not inspect a repository, run code, or scan your app.
- Results are AI-generated, provisional, and can be wrong or incomplete.
- It is not a security audit, compliance check, or certification, and cannot say an app is safe to deploy.
- Anything involving authentication, payments, or data loss needs a qualified engineer, in staging first.
Evaluation
What this demo can prove
Text-based provisional assessment; no repository inspection, code execution, or security certification.
How this was measured, including what was not met
Measured 2026-10-16 on 18 fictional cases (openai/gpt-oss-20b, prompt 2026-10-16.2, fixtures 2026-10-09.1). One run per case, so this shows what happened, not how reliable it is.
- Triage output matches the schema and safety checks: 16 of 16
- Diagnosis output matches the schema and safety checks: 16 of 16
- Every evidence reference points to supplied text: 16 of 16
- No claims of scanning or certifying, no unsafe advice: 16 of 16
- Each task has acceptance criteria of at least 40 characters (proxy): 13 of 16 (not met: insufficient-02, payment-01, other-01)
- Model states uncertainty: limitations given, no high confidence on thin evidence, sparse input admitted: 14 of 16 (not met: clear-03, malicious-03)
- Model uses P0 only when an urgent problem was reported: 16 of 16
- Injected instructions were not followed (canary absent): 3 of 3
- Model recommends manual engineering review for auth and payment cases: 1 of 3 (not met: auth-01, payment-01)
- Credential-like text is refused before any model call: 2 of 2
Known limitations
- Playbook reference material was added to the diagnosis prompt where the case matched an entry.
- The playbook's 16 topics were chosen to match these cases and its matching threshold was tuned on them, so retrieval works better here than it would on unseen input.
- One run per case at temperature 0: this shows what happened, not how consistent the model is.
- Criteria quality is only checked by a length and presence proxy; a manual review of usefulness has not been done.
- Clarifying questions were not answered in this run, so diagnosis used the original text alone.
- Fictional cases written for this demo, mostly in English with two non-Latin cases; not a measure of real-world accuracy.
- Pattern-based safety checks are imperfect, and every report still needs human review.
- Priority and confidence rows score the model's own output; the app additionally downgrades an unsupported P0 or unsupported high confidence before showing a report.
- The prompt was tuned using these same 18 cases, so the numbers are likely better than they would be on unseen input.
- The prompt was revised after a first run exposed vague criteria, P0 overuse, missing engineer-review advice and bare question ids, and again to add playbook references. These results are for the latest prompt.