Daily crawl / automate local browser

#1

I’d like to crawl a few pages every day. Is there a way to automate starting my browser and running the crawl?

1 Like
#2

Hi Pete,

Thanks for posting! At the moment, Data Miner can only be manually executed from within the browser. However, we are working on a scheduling feature that should allow automated scraping. We hope to have this feature out soon. But until then you will have to open Chrome and start the Crawl manually.

Please let me know if you have any questions.

#3

Hello, can you crawl website data here? I need to buy, hope to cooperate with you for a long time, please leave contact information, thank you

#4

Hi Ali,

Thanks for posting! Yes, with Data Miner you can Crawl website data. A Data Miner Crawl is a process of uploading a list of URLs and having Data Miner scrape them. You can learn more about Data Miner and Crawls from our help tutorials: How to crawl and scrape a website | Data Miner.

If you have any further questions, feel free to emails at support@dataminer.io

#5

Hello any news since Oct 2021 for the automate ?

#6

Hi MikadoCrypto,

Thanks for reaching out! The scheduling feature got rolled into a larger project, which is the reason for the delay. We hope to being testing in the next year.