Microsoft Agent Framework MCP Server: Add Live Web Search and Scraping with Bright Data

Microsoft Agent Framework (MAF) is an open-source Python and .NET SDK for building AI agents that can connect to Model Context Protocol servers, including Bright Data Web MCP for live search and web scraping. The guide demonstrates how to configure this connection securely by pinning compatible MCP SDK versions for MAF 1.21–1.22, sending the Bright Data API key in an authorization header rather than a URL, limiting available tools and prompts, and capping scraped page sizes to control token use. It outlines a research-agent design that searches before scraping, limits function calls, supports selective approval for batch scraping, audits tool activity without logging page contents, and can pass only concise research notes rather than full scraped conversations to a tool-free writer agent. It also discusses prompt-injection protections, including Bright Data’s untrusted-content markers, URL allowlisting for agents with access to sensitive data, and avoiding unnecessary secrets in research agents. In tests involving 20 current GitHub release questions, a restricted Bright Data tool configuration achieved 20 correct answers with lower model-input costs than the default toolset, while models without web access answered none correctly. The guide additionally provides an equivalent .NET setup and recommends evaluating configurations continuously on verifiable, frequently changing questions before using agents in production.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.