Jobs log: Improved o11y for background jobs
Blog post from Tinybird
Tinybird has introduced the jobs_log, a new Service Data Source designed to enhance the visibility and analysis of background jobs in its real-time analytics platform for user-facing applications. This feature allows users to query background job data as if it were a table, providing comprehensive insights into job runs, statistics, queue timings, and errors. It addresses previous limitations of the Jobs API by offering extended log retention of up to 12 months and an unlimited number of records. Available in all Tinybird Workspaces as tinybird.jobs_log, it enables centralized monitoring and can be used to create API endpoints and visualizations, such as time series or bar charts, to track job status and activity across different Workspaces. Organization Admins can leverage the organization.jobs_log to monitor jobs across all Organization Workspaces, enhancing production-level monitoring capabilities. Tinybird offers new users a free trial without requiring a credit card and provides extensive documentation and a Slack community for additional support.