AI Answers Before the Question Ends
Sometimes before the user completes their thought
Humans Naturally Overlap in Conversation
In face-to-face conversations, strict turn-taking is rarely observed. Unlike machines, humans are highly skilled at overlapping speech, seamlessly interweaving words during interactions. This overlap serves various functions, one of which is “terminal overlap.”
Listeners often anticipate the end of a speaker’s sentence and begin responding before it is fully completed. This natural communicative behavior occurs effortlessly and often goes unnoticed.
Bringing Overlap to Human-AI Text Interaction
Applying this natural conversational behavior to text-based human-AI interactions raises an interesting question: Can an AI respond before a user has finished typing a question?
Text-based AI assistants have become integral tools in daily tasks. Enabling them to respond proactively could enhance their effectiveness and usability.
Our Approach
A custom dataset was used to finetune LLaMA 3-8B, followed by the development of a web-based system capable of generating responses in real time.
The system generates responses before a user has completed their question. A user study revealed mixed reactions: Some participants found the interaction engaging and communicative, while others, particularly those who use prompt writing as a way to structure their thoughts, found it disruptive.
Further details are provided in the research paper.
Tech Stack
Python, LLaMA, HTML, CSS, JavaScript, Photoshop, and Illustrator.