This blog offers a comprehensive tutorial on building a data pipeline on Kubernetes using Redpanda, Postgres, and the Go programming language. The tutorial guides users through setting up Redpanda and Postgres on Kubernetes, deploying producer and consumer applications, and exploring the infrastructure's ability to scale. The producer application collects data through an HTTP endpoint and sends it to a Redpanda topic, while the consumer application processes this data, inserting it into a Postgres database. The Redpanda cluster and Postgres setup utilize Helm for deployment, and the tutorial demonstrates horizontal scaling by increasing the number of consumer application instances. The producer and consumer applications are built using different Go client libraries—franz-go and sarama, respectively—to highlight their unique features. The guide emphasizes the potential of Redpanda and Kubernetes for developing scalable, cloud-native applications and suggests exploring tools like the Horizontal Pod Autoscaler and KEDA for automatic scaling. The tutorial concludes by inviting readers to engage with the Redpanda community for further learning and exploration.