How can I test AI meeting notes before using them in a real meeting?
Use a staged conversation with invented details and a known final outcome. Include a proposal that gets rejected, a corrected number and a deadline that changes. Then compare the notes with the final agreement, not just with individual words that appeared during the discussion.
Test whether the system follows the decision
A simple monologue gives the system little opportunity to confuse proposals with commitments. A short discussion with corrections is more revealing. Check both the summary and extracted action items, because one can be right while the other preserves an earlier version.
In a hypothetical test, propose twelve units for Friday, change the quantity to ten and leave the delivery date undecided. The notes should retain ten units and the unresolved date. We would count an invented deadline as an error even if the rest of the summary reads well.