Scraping Bing Search Results in 2025 with ProxyTee

Like many search engines, Bing holds a treasure trove of valuable data, including product listings, images, articles, and search trends. Web scraping this information can be highly beneficial for various purposes, especially for gaining insights into Search Engine Results Pages (SERPs). Analyzing high-ranking pages, their keywords, and title strategies, you can inform detailed, data-driven decisions for your own SEO efforts. While the data is publicly accessible, accessing it requires the right approach.

Is Scraping Bing Allowed?

Generally, web scraping is not illegal as long as it’s done without violating any applicable rules or laws related to the targeted website or gathered data. Before you engage in any web scraping, ensure you have done proper legal consultation. Given that Bing search results and terms are publicly available, they could be scraped with the right tool.

Challenges in Scraping Bing

Those who have experience in scraping Bing are aware of the consistent difficulties to scrape successfully. Bing is sophisticated at detecting automated requests, and usually results in IP bans. Therefore, constantly switching IP addresses, user agents, and geographic locations is required if you want to extract data reliably and avoid CAPTCHAs.

Introducing ProxyTee for Bing Scraping

Here at ProxyTee, we provide an affordable, reliable, and easy-to-use solution that overcomes these challenges, allowing users to collect public data at scale. ProxyTee is a provider of rotating residential proxies designed to support web scraping tasks, streaming and other activities needing IP rotation and anonymity. ProxyTee’s key features include:

• Unlimited Bandwidth: ProxyTee ensures that your high-traffic tasks will not be interrupted by bandwidth concerns.
• Global IP Coverage: Access to over 20 million IPs across 100+ countries with ProxyTee’s extensive global network for precise targeting and local operations.
• Multiple Protocol Support: Supporting both HTTP and SOCKS5 protocols, ProxyTee ensures maximum compatibility with a range of tools and applications.
• Auto Rotation: Benefit from IP auto-rotation which changes your IP address at intervals from 3-60 minutes to avoid IP blocks and restrictions from websites, and can customize this based on need.
• User-Friendly Interface: Start immediately without technical skills, thanks to a clean and easy-to-navigate GUI available in the tool.
• Simple API: Simplify automation for proxy-related tasks by using ProxyTee’s simple API for a seemless experience when incorporating your proxy usage into applications.
• Affordable Pricing: Compared to competitors, ProxyTee’s unlimited residential proxies offer savings as high as 50%, while not compromising quality

With these features, ProxyTee empowers you to efficiently and effectively gather data from Bing and other sites. Our main offering, the Unlimited Residential Proxies, provides unparalleled performance with its bandwidth and IP diversity.

Setting Up Your Bing Scraping Project

To effectively demonstrate how to perform this with an API, we will be using Python. Please install if you do not have it by downloading from its official website. Install the ‘requests’ library via pip, using following command: `python -m pip install requests`.

1️⃣ Web Scraper API Query Parameters with ProxyTee

The ProxyTee API can operate via URL or query:

• Search by URL: This method requires passing a Bing URL with the source. Other parameters such as user agent type and location are also useful. You should set the `source` parameter to ‘bing’.
• Search by Query: Use this method when querying the engine directly with terms. In addition to previous parameters, you can add `domain`, `start_page`, `pages`, `limit`, and `locale` parameters to define the range of search result. Set the `source` to `bing_search`.

Both modes also take the `geo_location` to define the location to retrieve specific data. Here’s the payload example

payload = {
    "url": "https://www.bing.com/search?q=tomato",
    "source": "bing",
    "geo_location": "New York,New York,United States",
    "user_agent_type": "desktop",
    # "callback_url": "https://your.callback.url",
}

payload = {
    "query": "tomato",
    "source": "bing_search",
    "geo_location": "New York,New York,United States",
    "user_agent_type": "mobile",
    "locale": "de",
    "start_page": 2,
    "pages": 2,
    "parse": True,
    # "callback_url": "https://your.callback.url",
}

2️⃣ Scraping Bing SERPs for a Keyword Using ProxyTee

Now let’s create a python script using ProxyTee‘s Web Scraper API. The target query will be “ProxyTee”. To get started, import necessary libraries

import requests
import pandas as pd

Now, create a payload that includes source, domain, query, start page, page numbers and parsing.

payload = {
    "source": "bing_search",
    "domain": "com",
    "query": "ProxyTee",
    "start_page": 1,
    "pages": 10,
    "parse": True
}

Now, send this payload to the Web Scraper API using the ‘post’ method.

USERNAME = "API_username"
PASSWORD = "API_password"

response = requests.post(
    "https://api.proxytee.com/v1/queries",
    auth=(USERNAME, PASSWORD),
    json=payload
)

print(response.status_code)

Remember to include your ProxyTee API account credentials for authentication. If you have followed the steps correctly, a HTTP 200 response is a success message.

3️⃣ Saving the Information to JSON using ProxyTee

First, export the data into JSON format:

data = response.json()["results"]

content_list = []

for result in data:
    content_list.append(result["content"])

Now, use the pandas library to export scraped data as a JSON file.

df = pd.DataFrame(content_list)
df.to_json("search_results.json", indent=4, orient="records")

This will generate a file containing the scraped data at your current directory.