Module 8a: How to prepare your Golden Q&A

Checklist Before the Session

• Prepare 10–20 typical user questions

• Write expert answers for each

• Add citation links or references for every answer

• Organize everything in a Google Sheet/CSV (add Audio column if needed)

How to Prepare Your Golden Q&A for Evaluating Your AI Agent

This document explains how to prepare your Golden Q&A for use with Gooey.AI’s bulk evaluator. Follow each step to ensure your AI Agent can be tested and improved effectively.

1. Gather Typical User Questions

• Identify 10 to 20 common questions users might ask your AI Agent.

• These should cover important topics and key use cases.

2. Write Expert Answers

• Write the most accurate answer for each question you would want your AI Agent to give.

• Subject matter experts or your product team should write answers.

3. Add Citations

• For every answer, include a citation.

• The citation is a link or reference to the source material (webpage, PDF, document, knowledge base).

• If citing a PDF or document, include the page number or section.

4. Use Google Sheets for Organization

• Create a Google Sheet with the following columns:

  • Question

  • Answer

  • Citation (URL, document link, or specific page/section)

• If you are evaluating audio (user voice notes), add an “Audio” column. Place the Google Drive link to the audio recording for that question.

5. Example Google Sheet Format

Audio (if needed)	Question	Golden Answer	Citation
[Google Drive audio link]	What is the lip sync tools API?	The lip sync tools API is...	[Link to API docs]
[Google Drive audio link]	How do I animate a character?	To animate a character...	[Link to tutorial]

You can duplicate this Google Sheet

Learn more about Speech Recognition Evals here:

Create language evaluation for Speech Recognition | Gooey.AI Documentationdocs.gooey.ai