The Data Dichotomy: Rethinking the Way We Treat Data and Services

The text discusses microservices architecture, emphasizing on the importance of data sharing between services in a distributed system. It highlights the challenges faced when sharing significant datasets between services and suggests using a Distributed Log for this purpose. The author proposes using a Streaming Platform like Kafka to enable stateful stream processing within each consuming service, allowing them to join and operate on shared streams while keeping data true to its source. This approach helps in building more scalable, fungible, and autonomous services that can survive and evolve for decades.