We explored designing a solution to measure the quality of our customers' interactions with us, building on industry standards like Customer Effort Score and Net Promoter Score. We chose an emoji scale with faces representing a five-point scale from "Terrible" to "Amazing", specifically using a row of faces – 😠 🙁 😐 😃 😍 – to represent each rating level. However, we discovered that customers were reluctant to use the heart eyes emoji (😍) due to its perceived romantic connotations and lack of professionalism in certain contexts, particularly among males. We replaced it with a starry-eyed face (🤩), which was well-received by both our customer support team and users, resulting in an 11% increase in "Amazing" CSAT ratings and a notable improvement for male customer support representatives. Our experience highlights the importance of considering cultural and gender differences in emoji usage and interpretation, as well as the potential impact on design decisions that may seem minor but can significantly affect user behavior.