Introducing /monitor: Notify AI agents when the web changes
Blog post from Firecrawl
Firecrawl Monitoring, a new feature of the Firecrawl platform, simplifies the process of tracking changes on web pages by consolidating the entire monitoring stack into a single endpoint. With /monitor, users can set up scheduled checks on specific pages or entire sites and receive notifications only when significant changes occur, reducing the need for traditional, more complex setups involving cron jobs and manual diffing. The platform allows users to specify monitoring parameters in plain English, and it delivers structured diffs of changes, highlighting additions, removals, and modifications, which can be easily read by both humans and agents. Notifications are sent as signed webhooks or emails, ensuring that agents are only activated by relevant changes, and users can see cost estimates for their chosen schedules before committing. Firecrawl Monitoring supports a variety of use cases, such as triggering research agents, refreshing pipelines, tracking competitors, and staying updated with critical sources, and is available to all Firecrawl users via the dashboard or API.