Workspaces and New Tiers for Atlas Stream Processing
Blog post from MongoDB
MongoDB Atlas Stream Processing enhances the ease of managing streaming data by introducing workspaces and new processor tiers, replacing the previous stream processing instances to provide more granular control over resources. This transformation allows developers to efficiently process data streams from sources like Apache Kafka by leveraging the MongoDB aggregation framework, making stream processing more accessible and cost-effective. The new workspaces serve as logical containers for processors, connections, and environment monitoring, with resource tiers now defined per processor to match specific workload requirements. The expanded processor tiers, ranging from SP2 for development to SP50 for high-traffic operations, offer flexibility in optimizing performance and cost, with a per-processor pricing model that charges based on usage. The system enables developers to specify processor tiers directly at runtime, allowing for easy scaling from development to production without altering the underlying processor, thus simplifying the development and management of near real-time applications.