Can Price Comparison Pro also scrape Ajax pages?
With ajax pages there are three approaches you can use to scrape prices:
- Our Web Scraping Service – it uses phantomjs to simulate a browser and run JavaScript
- The Scraper API service – they provide a fully rendered option which runs JavaScript
- Any other third-party scraping service that provides a scraping service with HTTP endpoints, as you can just insert their URL + the URL you wish to scrape as a URL encoded parameter
To find out if a page is using ajax to add prices or other information to the page, compare ‘inspect element’ versus ‘view source’. The contents of ‘view source’ is the HTML prior to any JavaScript or ajax running.
