Company
Date Published
Author
Dave Kong and Aditya Thyagarajan
Word count
731
Language
English
Hacker News points
None

Summary

Cleanlab has introduced a feature called Expert Answers, which aims to address the issue of unhelpful AI responses by leveraging subject-matter experts (SMEs) to create a verified cache of responses that AI systems can rely on for consistent and accurate answers. This feature allows SMEs to provide authoritative responses to common queries, which are then reused for all matching future queries, ensuring reliability without the need for time-consuming retraining or prompt adjustments. By clustering similar failed responses, SMEs can prioritize high-impact cases, improving customer trust and reducing abstentions by tenfold, as demonstrated in early pilots with a financial institution's customer support AI. Expert Answers is designed to empower nontechnical experts to directly influence AI behavior, making it more reliable and useful, while also reducing engineering overhead and ensuring compliance in areas like customer support, product management, and legal regulations.