Ask HN: What would make you trust an AI's assessment of your understanding?

Posted by Aditya_0315 1 day ago

Creating an AI tutor that won't let you progress without having learned anything — not just completing a test. You train, are diagnosed for any problems in understanding, and there is now a live voice challenge where you need to verbally explain your response to an AI, and then it drills down with additional questions.

The voice feature was created by me under the suspicion that it is way more difficult to pretend to have understood something while talking to someone rather than choosing a proper multiple choice answer. But to be honest, I don't know if that is a valuable idea or just another sign of my attachment to the most complicated thing I created.

So, the question I want to ask seriously is: What would help you to trust an AI's diagnosis of your understanding? And is it even worthwhile, or should I stick to the solution of doing spaced repetition and trusting myself?

Comments

Comment by mfalcon 23 hours ago

I'd like to get the reasoning trace by stage in order to verify the AI work. I'd like the AI to explain me why it thinks I'm lacking knowledge on some specific topic or sub-topic.

To finally trust the AI I'd like for it to find (if the content has already some human created exercises) or generate some question/exercise that confirms their diagnosis.

Comment by Aditya_0315 13 hours ago

[flagged]

Comment by nitwit005 2 hours ago

You're saying "not just completing a test", but this will inevitably be a test, just in conversation form.

Comment by Aditya_0315 2 hours ago

[dead]

Comment by rajeasy 17 hours ago

Trust yourself ,issue come when ai understood context differently than you and even after long discussion - you create well documented instruction - it can infer differently. and never use gemini for this.