An Extremely Simple but Effective Way to Improve Search Over Text Embeddings

The author presents a simple yet effective way to improve similarity search over text embeddings in GenAI solutions without using techniques like model fine-tuning or prompt engineering. The approach involves adding symbols, such as ###, to the beginning of questions to boost relevant results and increase distance between high and low scores. This technique is tested on three cloud providers: AWS Bedrock, Azure OpenAI, and Google VertexAI, with varying degrees of success. The author highlights the importance of considering trivial things like special characters/symbols in text embeddings, which can significantly impact outcomes. The article provides a starting point for evaluating embedding search and improving GenAI solutions.