They have released a Python package for web parsing. With its help, you can extract data from e-commerce sites, search engines, real estate services, and much more.
Here is a simple example of parsing Bing results:
from oxylabs import RealtimeClient
# Specify credentials for Oxylabs API authorization
username = "username"
password = "password"
# Create a Realtime client with our credentials
client = RealtimeClient(username, password)
# Use bing_search to get Bing results for the query "nike"
result = client.bing.scrape_search("nike")
# Print raw data (as is)
print(result.raw)
Oxylabs can work with almost any websites, but they have separate, more specialized APIs for popular platforms:
- Amazon
- Google Shopping
- Bing
- Kroger
- Wayfair
- YouTube Transcript
You can learn more about Oxylabs on their website
If you only need the Python package for web scraping, it can be found on GitHub
👉 @DataScience4
