Company
Date Published
Author
Sreekanth Sivasankaran
Word count
842
Language
English
Hacker News points
None

Summary

The text outlines performance optimizations introduced in version 6.5.0 of Full-Text Search (FTS), primarily centered around the principle of "do less and do it less often." A significant change was transitioning the scatter-gather mechanism from HTTP/HTTP2 to gRPC, leveraging its streaming and request multiplexing capabilities, which resulted in a 2X throughput improvement for low-frequency term queries in a three-node cluster. The integration of new protobuf message types faced initial performance challenges due to legacy JSON message types, which were mitigated by optimizing the parsing process. Further enhancements included refining the numeric range query logic by implementing a more efficient Terms Dictionary lookup API, achieving a 77% increase in throughput during internal tests. Additionally, improvements in caching and reusability for prefix, fuzzy, and wildcard queries yielded throughput gains of 25%, 12%, and 9%, respectively, by reducing garbage creation and optimizing garbage collection cycles.