Home / Companies / Kestra / Blog / Post Details
Content Deep Dive

Plugin performance improvements

Blog post from Kestra

Post Details
Company
Date Published
Author
Malay Dewangan
Word Count
2,141
Company Posts That Month
2
Language
English
Hacker News Points
-
Post removed?
No
Summary

Kestra reviewed seven plugins to reduce repeated hot-path work and address silent data-loss or error-reporting failures, using JMH benchmarks and real local services to measure performance changes where applicable. JDBC now pools remote database connections by default and caches result-set metadata per result set, yielding roughly 20–25 times faster connection operations with about 200 times less allocation and improved row-mapping throughput. Serdes reuses date formatters and an error-path JSON mapper, reducing parsing overhead and making exception-message processing about 66 times faster, while Redis batches list pushes into variadic LPUSH commands, reducing 10,000 pushes from 10,000 round trips to 20 and substantially improving latency-sensitive workloads. MongoDB loading now passes maps directly as documents instead of serializing and reparsing JSON, producing roughly a 25-fold speed improvement and far less garbage. Reliability fixes ensure GCP Pub/Sub waits for in-flight messages during shutdown, BigQuery supports concurrent appends, AWS Athena and S3 paginate beyond 1,000 results, SQS batches sends, and Kafka propagates producer failures rather than reporting successful tasks when messages were not delivered.

Trends Found in this Post

No tracked trend matches for this post yet.

Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.