Is it possible to some how change the url… as I need to switch between multiple tabs, while using the app
Hi siddesh,
Data Miner is not able to easily scrape across multiple tabs. Data Miner is only granted access to the tab it’s opened on. So you would have to open Data Miner and run a recipe for each tab you wish to scrape. However, there are a few different workflows that might help increase the speed.
First is our Quick Srape method. Open Data Miner from the browser toolbar, hover over your recipe, and then click the first icon. This will run the recipe and save it to the recipe without opening the main window. You can visit each tab and do the Quick Scrape accumulating the data into a single file.
The second method would be our Crawl. This is where Data Miner visits a list of unique URLs and scrapes the data. This may not work if you need to manually choose pick which tabs to open, but it’s the most automated method. The process is outlined on the following help page: How to crawl and scrape a website | Data Miner.
This process requires two recipes. You need to scrape the detail page URLs off of the search results page using one recipe and then Data Miner visits the URL and then scrapes the detail page’s data using the second recipe. You can make the recipes yourself by looking at our tutorials here: How to write Data Miner recipes with Recipe Creator | Data Miner or we can make them for you for $300 total ($150 each).
The Crawl feature does also require a paid plan as well, but you can test it with a free plan. You can view paid plans here: Pricing | Data Miner
Our paid plans are easy to cancel when you don’t need them anymore and there is no commitment. You can cancel anytime from your account page here: https://dataminer.io/account
Please let me know if you have any questions.