Streaming market data from Arroyo into QuestDB

QuestDB is an open-source time-series database known for its ultra-low latency and high ingestion throughput, making it suitable for demanding workloads. It offers native support for Parquet and SQL, ensuring data portability and AI readiness without vendor lock-in. Arroyo, a new stream processing engine written in Rust, complements QuestDB by enabling low-latency, SQL-first stream processing and simplifying the creation of streaming data pipelines. Although Arroyo lacks a native QuestDB connector, a workaround using Arroyo's webhook connector in combination with QuestDB's HTTP endpoint for InfluxDB Line Protocol (ILP) provides an efficient, dependency-free pipeline for real-time analytics. This approach eliminates the need for Kafka and JSON encoding, resulting in a straightforward integration that leverages both systems' SQL capabilities.