Qodex.ai

ScrapingBee

Number of APIs: 5

ScrapingBee is the most powerful web scraping API on the web.

It will handle:

  • headless browsers
  • proxies
  • CAPTCHAs

So you don't have to.

But there's more.

The API also allows you to:

  • Extract complex structured information from any website with CSS selectors
  • Run JavaScript scenario (click, scroll, form filling, etc ...)
  • Take a screenshot of the website, the full page, a part of the screen

Feel free to create an account here to get your API key. The first 1,000 API credits are on us!

  1. HTML API - Screenshot response on smaller screen GET app.scrapingbee.com/api/v1/?url=https://httpbin-scrapingbee.cleverapps.io/html&render_js=false&screenshot=true&window_height=400&window_width=200

  2. HTML API - Usage information GET app.scrapingbee.com/api/v1/usage

  3. Data Extraction - Extract all email addresses from a page GET app.scrapingbee.com/api/v1/?url=https://httpbin-scrapingbee.cleverapps.io/&render_js=false&extract_rules={ "email_addresses": { "selector": "a[href^='mailto']", "output": "@href", "type": "list" } }

  4. JavaScript Execution - Executing custom JavaScript GET app.scrapingbee.com/api/v1/?url=https://httpbin-scrapingbee.cleverapps.io/&render_js=true&js_scenario={ "instructions": [ {"evaluate": "console.log('foo')"} ] }

  5. Google Search API - Simple search GET app.scrapingbee.com/api/v1/store/google?search=healthcare redoc api