Home / Companies / Postman / Blog / Post Details
Content Deep Dive

My ScrapingBee journey

Blog post from Postman

Post Details
Company
Date Published
Author
Kin Lane
Word Count
720
Company Posts That Month
16
Language
English
Hacker News Points
-
Post removed?
No
Summary

Postman has been exploring how developers author or generate API contracts by collecting publicly available OpenAPI artifacts from GitHub and the open web. To tackle the challenge of harvesting open APIs from the web, where not everything has an API, they turned to an API-first scraping solution using the Postman Public API Network. They discovered ScrapingBee, a tool that facilitates data scraping from web pages, including those with JavaScript, and found it effective for parsing OpenAPI files. By utilizing ScrapingBee's features, including a Google Search API folder, Postman was able to efficiently locate OpenAPI artifacts and automate the process, drastically reducing the time needed for their research. This initiative allows Postman to discover new APIs and understand their structures by studying their OpenAPI definitions, with plans to share their findings from this ongoing exploration of the API landscape in the coming months.

Trends Found in this Post

No tracked trend matches for this post yet.

Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.