Refinery 2.9: A Love Letter to Refinery’s Operators

Refinery 2.9 introduces significant improvements aimed at addressing challenges related to configuration, stability, and scalability in managing network traffic for its users. The update features a revamped adaptive trace cache that dynamically adjusts its size according to incoming traffic, eliminating the need for manual configuration and deprecating the CacheCapacity option. It also improves stability by fixing critical bugs and minimizing service disruptions during maintenance. To mitigate issues of rerouting trace storms caused by quick cluster membership changes, a new RedistributionDelay configuration option allows operators to manage the frequency of trace redistribution. A new experimental feature, TraceLocalityMode, aims to enhance scalability by distributing spans of a trace across all nodes in a cluster, thereby balancing the load and reducing network traffic. This feature is disabled by default and recommended for testing in staging environments before production use. Users are encouraged to provide feedback on the update through the company's GitHub repository or Slack community.