Price Comparison Pro – Price Scraping Issue
Annie A. asked 4 years ago
Hello,
I'm having some issues scraping ecommerce stores for my websites - especially wordpress/woocommerce stores.
At the moment, I find that either:-
- The site doesn't get scraped at all
- The site gets scrapped sometimes but not every time (i.e. Amazon)
- The site gets scrapped but the price is wrong (in some cases I can't even find the price that the plugin scrapped on the page)
Would it be easier to request a quote to scrape my requested websites? or take out the web scraping service - As I've watched a few screencasts and supprot answers, and I am still having an issue.
I would really appreicate it if you could come back to me
Dave Hilditch Staff answered 4 years ago
If you can edit your question and provide some URLs that you’re struggling to scrape I’ll provide you the CSS or xPath to scrape what you need.
Note: If a website is failing to scrape, you can click the ‘recheck price’ button and then use the JavaScript console to see the debug output.
If the wrong price is being scraped, then your selector is wrong – you should use the SelectorGadget chrome extension to ensure your CSS only matches one price on the page.
If it’s not scraping at all, it may be your server got blocked – it depends on how many scrapes you are trying to perform. In these cases, our proxy solution or the Scraper API solution will get around this.
