Home / Companies / Firecrawl / Blog / Post Details
Content Deep Dive

Launch Week I / Day 7: Crawl Webhooks (v1)

Blog post from Firecrawl

Post Details
Company
Date Published
Author
Nicolas Camara
Word Count
199
Language
English
Hacker News Points
-
Summary

Firecrawl's Launch Week introduces new webhook support for the /crawl endpoint, allowing users to specify a URL that will receive POST requests when a crawl is initiated, updated, or completed. This enhancement triggers a webhook for each page crawled, not just at the end of the entire process, providing more granular event notifications. There are four types of webhook events: crawl.started, crawl.page, crawl.completed, and crawl.failed, each corresponding to different stages of the crawling process. The webhook response includes details such as success status, event type, crawl ID, and scraped data, which will be populated if the page was successfully scraped, or an error message if the process failed. For further details, users are encouraged to consult the documentation.