Debugging a mysterious HTTP streaming issue

A complex debugging saga unfolded at Mintlify when Cloudflare's automatic compression settings unexpectedly disrupted HTTP streaming for browser and node-fetch requests, while cURL continued to function correctly, resulting in significant latency issues. The team initially explored potential stream compatibility problems and HTTP version discrepancies, but the breakthrough came when Lucas, leveraging his Cloudflare expertise, realized the absence of an Accept-Encoding header in cURL requests was key to the issue. This led to the discovery that disabling compression in Cloudflare's dashboard resolved the problem, underscoring the challenges posed by automated infrastructure changes that lack visibility. The experience highlighted the importance of understanding tool-specific behaviors, such as cURL's handling of compressed responses, and the value of having infrastructure changes documented in a transparent manner, as seen in source-available systems like Trieve, where past similar issues were more easily identified.