Module 2: Set your KPI and Metrics

Points to consider when building your KPIs

1. Collect a few clear set of assumptions from the Theory of Change model.

EG: For the Farmer.chat, a core KPI was: How have smallholder farmers' earnings improved after using the AI copilot?

1. Other KPIs could include:

2. Is the Copilot performing well, ie, its able to generate good answers

3. Is the Copilot successfully answering the questions (is it not answering at all)

4. What is the feedback you are getting from the user (just 👍and 👎)

5. What is the retention for the Copilot?

6. What are the topic-based differences?

7. What’s missing?

8. Language detection and rate keeping

9. Utilization of specific information

10. Outbound referrals to departments

11. Operators