An Extremely Simple but Effective Way to Improve Search Over Text Embeddings

The author presents a simple yet effective way to improve similarity search over text embeddings in GenAI solutions without using techniques like model fine-tuning or prompt engineering. The approach involves adding symbols, such as ###, to the beginning of questions to boost relevant results and increase distance between high and low scores. This technique is tested on three cloud providers: AWS Bedrock, Azure OpenAI, and Google VertexAI, with varying degrees of success. The author highlights the importance of considering trivial things like special characters/symbols in text embeddings, which can significantly impact outcomes. The article provides a starting point for evaluating embedding search and improving GenAI solutions.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.