Preempting Problems in a Sociotechnical System
Blog post from Honeycomb
Honeycomb emphasizes the importance of humans in sociotechnical systems, arguing that while computers and artificial intelligence can alleviate labor-intensive tasks, they cannot replace the nuanced roles humans play in organizations. This is illustrated through a near-miss incident Honeycomb experienced involving changes in OpenTelemetry's Semantic Conventions, which required human intervention to foresee potential issues with their Refinery sampling proxy. As the changes allowed OpenTelemetry libraries to emit both old and new schema until a certain date, Honeycomb's customer success and engineering teams coordinated to investigate whether any libraries had upgraded to the breaking change, ultimately determining they had not. This incident highlighted the necessity for human oversight in adapting to changes and communicating with customers, as it was not just a technical issue but also involved understanding customer impact and managing the response. Honeycomb employees, particularly those involved with OpenTelemetry, sought to improve communication about such changes in the future. The incident underscores the role of humans as essential transducers of information in complex systems, capable of reflection and adaptation beyond the capabilities of technical artifacts.