Hi
I am trying to scrap a page with ajax “Load More” button, that, when clicked, just adds more records on the existing page, making the list longer. Currently it seems the application treats this as new page and scraps all the displayed rows again and again, therefore duplicating the data. is there a way to just scrap the newly added data ?
Hi Zed,
Thanks for reaching out. I’d be happy to help. Next Page Automation only works with Next buttons.
For pages with a Load More button, you need to use the Page Action - ‘Click on a “More results” button at the bottom of page.’ This action will scroll to the bottom of the page and click the button as many times as your settings indicate. And then it will scrape the entire list.
The Page Actions are a paid feature and in order to use them, you will need a paid plan. Once you upgrade you will be able to use any from that list. Any of our paid plans will grant you access to all the features. So you can start with $19.99 a month and work your way up if you wish.
Please let me know if you have any questions.