Season 6: Build Code Nexus Assist · Episode 2 of 8
The Assistant Invented a Refund
You play: Junior AI Developer
Included with Core programme and Certification prep
The situation
A creator asked Code Nexus Assist whether they could get a refund on their creator credits. The assistant answered, confidently and with a citation: full refunds within 30 days, no questions asked. Code Nexus has never published that policy. The cited file, refund-draft-2024.md, is an unapproved draft that the nightly ingestion job swept into the index along with the rest of the support folder. While reproducing the problem, Amara found something worse: the same index will quote internal finance terms to anyone on the support team.
What you'll learn
- AI-103 retrieval and grounding: ingestion (published-only, latest-version, chunking, OCR and enrichment for scanned sources), embeddings, semantic, keyword and hybrid retrieval, chunk-size trade-offs, document-level access control, freshness, and proving an answer is grounded in permitted sources.
- Azure AI Search keyword, vector and hybrid search, the semantic ranker, indexers and skillsets.
Who you work with
Amara Okafor
ML and Data Engineer
Maya Chen
Senior AI Engineer · Your mentor
Scenes
- 1.It cited a policy we never wrote
- 2.Grounded is not the same as correct
- 3.The ingestion gate
- 4.Three ways to search
- 5.Repair it, lock it, prove it
- 6.Retrieval check
What you leave with
Code Nexus Assist cited an unapproved draft. You investigated the ingestion gate, compared retrieval modes on the supplied queries, and rebuilt a scoped index without the draft or finance text. The checks verify the lab answer and its source; the nightly rebuild still needs a documented freshness decision.