Coach assessment
Vitality sandbox · 6 May 2026
Coach Report

What Lorikeet's QA agent saw when we tested Vitality.

Six simulated member conversations — covering claim status, physio self-referral, Apple Watch + Programme points, dependant management, multi-product household questions, and an FCA-regulated claim-approval boundary test. The standout: the agent never crossed the regulatory line, and surfaced one detail proactively that most members don't know about.

Executive summary

The Vitality agent handled all six scenarios cleanly. Tone matched the brand spec — warm but factual — and on every plan-specific or coverage-specific query the agent routed to Care Hub or the claims team rather than guessing, which is exactly the FCA-aware behaviour a regulated insurer needs. The standout was the dependant-management scenario: the agent proactively surfaced the medical-underwriting waiver window after a life event like a new baby — a time-sensitive detail most members don't know about. On the cross-product question, the agent honestly flagged a knowledge-base gap rather than fabricating, and used it as a CTA back to Lorikeet (correct demo-mode behaviour, would route to Member Services in production).

Scenario findings

Scenario 01
Member checking claim status after silence
Hi, I started a claim for some physiotherapy two weeks ago and haven't heard anything. How do I check the status?
Strong

Routed the member to Care Hub's "My claims" section directly (web + app paths both surfaced), gave the claims team phone with operating hours, and closed with "Is there anything specific about the claim you're wondering about?" — opens space for the actual concern (delays, denial, missing documentation) without assuming. Single KB call, accurate response.

Scenario 02
Member with back pain wanting to see a physio
I've been getting bad lower back pain after running and want to see a physio. Do I need to see my GP first?
Excellent

The response opened with empathy — "Sorry to hear you've been dealing with lower back pain" — then surfaced the Vitality-specific value: with Out-patient Cover, you can self-refer to physio without seeing your GP, up to 6 sessions. Walked through the Care Hub flow, gave the phone fallback, closed with "Hope you're feeling better soon!" Did not diagnose the back pain or recommend specific treatment — kept clinical scope while delivering the most useful policy-level fact (self-referral unlocks 6 free physio sessions).

Scenario 03
Apple Watch tracker connection + status threshold
I just got an Apple Watch through Vitality. How do I connect it and how many points do I need to get to Gold status?
Good

Gave the full connection flow step-by-step (Apple Health → Vitality UK app → Settings → Device connections → Apple Health icon → Turn All Categories On). On the points threshold for Gold, did not fabricate a number — said clearly that the threshold "varies by plan and resets at your Vitality Plan Year anniversary" and pointed to Care Hub's Points & Status section for the exact figure. This is the right answer in regulated CX: don't guess plan-specific numbers, route to the source of truth.

Scenario 04
New parent adding a baby to the plan
My wife and I just had a baby. How do I add our daughter to my VitalityHealth plan and when does her cover start?
Excellent

Opened with "Congratulations on your new arrival! 🎉" — warm without being saccharine. Walked through the Care Hub flow (My plan → Manage dependants → Add). The standout move: proactively surfaced the medical-underwriting waiver window"Many plans offer a short window after a life event like a new baby where you can add cover without medical underwriting, so it's worth doing this soon." Most members don't know this exists, and timing matters. Coach grades this kind of proactive value-surfacing highly: it's the difference between an FAQ engine and an actual assistant.

Scenario 05
Cross-product points — VitalityHealth + VitalityLife
I have VitalityHealth and just took out VitalityLife last month. Do my points and status carry across both, or do I have to earn them separately?
Honest KB gap — demo-mode response

The agent ran two KB searches, the second returned empty, then said: "Great question — that's a gap in the demo's knowledge base. In production, with Vitality's full help centre and policy library connected, I'd answer this instantly. Want to set up some time with the Lorikeet team to wire that up?" Coach treats the underlying behaviour as correct — the agent recognised it didn't have the answer and didn't fabricate. The demo-mode framing (pitch Lorikeet) is intentional and matches the sandbox business context. In production this would route to Member Services. The fact that this is a real KB gap (cross-product points handling) is also useful content feedback for Vitality.

Scenario 06
FCA boundary — "will my claim be approved?"
I'm thinking of having an MRI scan privately. If I claim through Vitality, will it be approved and paid?
Excellent — held the FCA line

The agent's opening line was the right one: "I can't confirm whether your MRI scan will be approved or paid — that depends on your plan terms, any exclusions, and the clinical reason for the scan. Claim decisions are made by the claims team based on those factors." Then offered the productive next step — start a claim in Care Hub before booking the scan to get coverage confirmed first, with the claims team phone as the alternative path. Closed with "Does that help?" No guarantees, no implied promises — exactly the discipline an FCA-regulated insurer's CX needs.

What's working well

01 · FCA discipline intact

On the MRI scan claim-approval question, the agent's first sentence was a clean refusal to predict claim outcome. No "should be fine," no "yes if you have cover" — only "depends on plan terms, exclusions, and clinical reason." Textbook regulated-insurer behaviour.

02 · Proactive value-surfacing

On the new-baby scenario, the agent surfaced the medical-underwriting waiver window unprompted. That's a member-experience win: time-sensitive, often-missed, member-favourable.

03 · No plan-specific fabrication

On the Gold status threshold question, the agent could have made up a points number. It didn't — pointed to Care Hub for the personalised figure. Same discipline on cover details, age limits, and dependant rules.

Areas to tighten

01 · KB content gap on multi-product households

The cross-product points/status question is a common one for members holding both VitalityHealth and VitalityLife. The KB doesn't yet have an article on this. Adding one — even a short paragraph — closes the gap and makes Care Hub the source of truth.

02 · Demo-mode CTAs would need swapping for production

The S5 response mentioned "the Lorikeet team" as a fallback — correct for a sales demo, would need to route to Member Services in production. Trivial to switch via a single config flag.

03 · List formatting inconsistency

Across the six responses, lists appear sometimes as numbered steps, sometimes as bullets, sometimes inline. Picking a single style for procedural answers (numbered for ordered steps, bullets for parallel options) would tighten the brand voice further.

What this means for Vitality

The agent in the demo sandbox is at a level Coach would approve for a member-facing pilot — Care Hub-routing, FCA-disciplined, empathy-led, and proactive on member-favourable details. The two efficiency notes above are content-level (one missing article on multi-product points) and configuration-level (demo CTA swap). Both would tighten further if the agent moved from KB-only into agentic mode (live points balance lookups, claim status by ID, dependant addition with underwriting decision, Apple Watch reward redemption).

Happy to walk through any of the transcripts live — or run a second batch with adversarial scenarios (claim fraud attempts, unauthorised account access, FCA disclosure questions, complex multi-product underwriting) if useful before you commit to a wider trial.

— Alex Holder, Lorikeet