OpenAI's Matryoshka Embeddings in Weaviate

OpenAI has released two new embedding models, text-embedding-3-small and text-embedding-3-large, which are trained using the Matryoshka Representation Learning technique. This technique allows for a trade-off between performance and cost in embeddings by shortening them while maintaining accuracy. The embeddings can be used with Weaviate vector database to store more information at lower costs and search faster.