Thinking Fast and Estimating Wrong
Blog post from Zapier
Software estimation is inherently flawed due to the limitations of human cognition, as illustrated by an experiment conducted within Zapier. The experiment revealed that estimates can vary significantly based on how questions are framed, emphasizing the impact of cognitive biases such as priming. This is connected to the two systems of thinking described in Daniel Kahneman's "Thinking, Fast and Slow": System 1, which is fast but prone to errors, and System 2, which is more accurate but lazy. These biases, combined with the invisible and complex nature of software projects, make precise estimation difficult. Despite these challenges, estimation remains a necessary practice for setting shared targets and making informed decisions, though it should be approached with an understanding of its limitations. Techniques such as delaying immediate responses, breaking projects into smaller tasks, and using heuristic-based scorecards can help mitigate some of the cognitive pitfalls associated with estimation.