Getting Started – Scrapestorm https://www.scrapestorm.com AI Driven Web Scraping Wed, 18 Aug 2021 01:50:09 +0000 zh-CN hourly 1 https://wordpress.org/?v=6.0 https://www.scrapestorm.com/wp-content/uploads/2018/01/cropped-home_icon-19-2-32x32.png Getting Started – Scrapestorm https://www.scrapestorm.com 32 32 How to Install ScrapeStorm on Mac https://www.scrapestorm.com/tutorial/how-to-install-scrapestorm-on-mac/ Tue, 29 Oct 2019 08:21:41 +0000 https://www.scrapestorm.com/?type=post&pid=6609 Step 1: Click the download button. A pop-up will ask you to save ScrapeStorm on your computer. Click “Save” to begin the download.

Step 2: Wait for ScrapeStorm to finish downloading. Click on the download to open it. Click “Agree” button.

Step 3: Wait for a pop-up with ScrapeStorm to open. Drag and drop ScrapeStorm into the Applications folder.

Step 4: Close the pop-up pictured above. And open the Application folder in Finder. Find the ScrapeStorm app, click it to open it.

Step 5: You may receive a security warning as shown below, and can’t open the app.

Step 6: Hold the control key and click the ScrapeStorm icon, then select open.

Step 7: You may receive a security warning as shown below. Click “Open” to start the app.

 

]]>
Frequently asked questions https://www.scrapestorm.com/tutorial/frequently-asked-questions/ Wed, 08 May 2019 05:46:06 +0000 http://www.scrapestorm.com/?type=post&pid=5784 1. How to import and export scraping tasks?
Please refer to this tutorial: https://www.scrapestorm.com/tutorial/how-to-import-and-export-rules/

 

2. Why is there no data?
There are many reasons why you can’t scrape data.

First, make sure you understand how to use ScrapeStorm.

Please take a look at the tutorial: https://www.scrapestorm.com/?type=tutorial

If you can’t solve the problem yourself, please Contact Us.

 

3. Why is the data missing?
Please check the amount of data in the browser in Chrome, sometimes the number of search displays and the actual number are not consistent.

If you can confirm that the data is missing, please export the scraping task and send it to us.

 

4. Why can’t the task stop automatically?
The task can’t be stopped usually because the software can’t detect the last page.

Please export the scraping task and send it to us.

 

5. Why can’t I download the images?
Please refer to these tutorials:

https://www.scrapestorm.com/tutorial/how-to-download-images-in-smart-mode/

https://www.scrapestorm.com/tutorial/how-to-download-images-in-flowchart-mode/

If you still can’t download the image according to the tutorial, there are probably the following reasons:

(1) The images has not been loaded, please set a longer request waiting time, as shown below:

(2) The images needs special loading method, please use “Load page Info one by one”, as shown below:

(3) You need right click the Field and rewrite Xpath

]]>
How to enter a correct URL https://www.scrapestorm.com/tutorial/how-to-enter-a-correct-url/ Fri, 01 Feb 2019 02:32:33 +0000 http://www.scrapestorm.com/?type=post&pid=4547

For users who use ScrapeStorm for the first time, we recommend that you enter the URL as follows. 

For example:

1. If you want to scrape Google

Do not enter:https://www.google.com/

Please enter:https://www.google.com/search?q=ScrapeStorm

 

2. If you want to scrape Ebay

Do not enter:https://www.ebay.com/

Please enter:https://www.ebay.com/sch/i.html?&_nkw=ipad

3. If you want to scrape Yelp

Do not enter:https://www.yelp.com/biz/isa-restaurant-san-francisco

Please enter:https://www.yelp.com/search?find_loc=San+Francisco

PS:

If you want to scrape some websites behind a login, you can click the pre-login button on the top right corner to sign in first.

You can check out this article for more information: How to scrape web pages that need to be logged in to view

 

For more tutorials, please click here :

https://www.scrapestorm.com/?type=tutorial

]]>
Beginners must see https://www.scrapestorm.com/tutorial/novice-must-see/ Fri, 21 Sep 2018 08:05:21 +0000 http://www.scrapestorm.com/?type=post&pid=1924

Hello,

Thank you for choosing ScrapeStorm.

ScrapeStorm (www.scrapestorm.com) is an AI-Powered visual Web Scraping Tool,which can be used to extract data from almost any websites without writing any code.
It is powerful and very easy to use. For experienced and inexperienced users, it provides two different scraping modes (Smart Mode and Flowchart Mode).
ScrapeStorm supports Windows,Mac OS and Linux operating systems.
You can save the output data in various formats including Excel, HTML, Txt and CSV. Moreover, you can export data to databases and websites.

To help you master how to operate faster, we have an official tutorial for you, which is divided into three parts:

Getting Started:

Introduce the basic situation of our web scraper, the basic settings of the software installation and use and the explanation of some nouns, you can click here to view all the articles under this category.

Main Features:

Introduce all the features of our web scraper. All the features involved in the process can be found here. You can click here to view all the articles under this category.

Examples:

We have published some scraping cases for websites in the form of graphics or video. There are also downloads of scraping rules, you can click here to view all articles under this category.

 

If you want to have a quick understanding of the flow of our software, we have prepared three video cases, you can also start here:

【Smart Mode】The first scraping case

【Smart Mode】The second scraping case

【Flowchart Mode】The first scraping case

 

Thank you again for your support and wish you a pleasant experience.

]]>
Introduction to ScrapeStorm https://www.scrapestorm.com/tutorial/introduction-to-scrapestorm/ Tue, 21 Aug 2018 07:08:38 +0000 http://www.scrapestorm.com/?type=post&pid=833 ScrapeStorm is a new generation of Web Scraping Tool developed by the former Google search technology team based on artificial intelligence technology.

This software is powerful and easy to operate. It is a product tailored for users of non-programming products, operations, sales, finance, news, e-commerce and data analysis, as well as government agencies and academic research.

 

The software can not only automate the extraction of data, but also clean the data during the extraction process, and can filter various contents such as numbers and e-mail at the data source.

By using this software, users can quickly and accurately obtain massive web data, which completely solves the various problems faced by manual data extraction, reduces the cost of obtaining information, and improves work efficiency.

With industry-leading technology advantages, the software is the first scraper to support both Windows, Mac and Linux operating systems.

For different basic users, it supports two different scraping modes, which can scrape 99% of web pages.

1. Smart Mode

The operation is extremely simple, just input the URL to intelligently identify the content of the web page, and you can complete the data scraping without configuring any rules.

 

2. Flowchart Mode

The user only needs to open the collected website, and follow the prompts of the software to automatically generate complex data collection rules with a few clicks of the mouse.

]]>
How to download, install, register, set up and upgrade software versions https://www.scrapestorm.com/tutorial/how-to-download-install-register-set-up-and-upgrade-software-versions/ Tue, 21 Aug 2018 07:08:32 +0000 http://www.scrapestorm.com/?type=post&pid=842 1. ScrapeStorm download and installation

(1)Download
ScrapeStorm is the first Web Scraping Tool to support Windows, Mac and Linux operating systems. You can click here to go directly to the official homepage to download the software, the website will push the corresponding version according to your operating system.

Or click here to open the official website download page, here is a download link for all versions, you can download the corresponding installation package according to your own operating system requirements.

(2)Installation

How to install on Windows?

After the download is complete, find the installation package file in the file save path and double-click to install it.

How to install on Mac?

Please refer to this tutorial:How to Install ScrapeStorm on Mac

How to install on Linux?

When using the Linux version, your Linux system must have a desktop environment.

Run the following command in your terminal:

$ chmod a+x ScrapeStorm*.AppImage

$ ./ScrapeStorm*.AppImage

 

2. ScrapeStorm registration and settings
(1)Open ScrapeStorm and click on the upper left corner to register for new users.

(2)Please enter your email address to sign up.

If you have not received the account activation email, please follow the steps below to troubleshoot:

Step 1: Please confirm that the email address you filled in is correct.
Step 2: If the email address is correct, please check your spam folder. The activation email may be there.
Step 3: If the email is not in the spam folder, please check if the email address blacklist is set. The activation email may be blocked by the email. Please add ScrapeStorm to the whitelist, and then click “resend email” in the login interface.
Step 4: If the above steps do not solve your problem, please contact the official customer service directly, we will solve your problem in the first time.

(3)Modify personal account information.
Click on the top left corner to open the basic data window where you can modify your account information.

(4)Open the settings center by opening the upper left gear icon, where you can make basic software settings.

 

3. How to upgrade the software version

Under normal circumstances, ScrapeStorm will automatically recognize the new version of the prompt update, if not, you can check the update in the settings, and then log in to the official website to download the latest version of the installation package, after the download is complete, double-click to open the software update.

]]>
What is the Smart Mode https://www.scrapestorm.com/tutorial/what-is-the-smart-mode/ Tue, 21 Aug 2018 07:08:27 +0000 http://www.scrapestorm.com/?type=post&pid=849 Smart Mode is a new generation of scraping mode developed by the ScrapeStorm team based on artificial intelligence technology. This mode is extremely simple to operate. It only needs to input the extracted URL, and the data can be extracted without configuring any rules.

This mode supports scraping from a single URL and multiple URLs, and supports bulk import of URLs from local documents.

You can also bulk generate URLs by modifying parameters.

This mode is mainly for the extraction of list-type webpages and content-based webpages. When extracting multiple URLs in batches, it is recommended to input only the same type of webpages, for example, all of them are list types or all of them are content types.

For different types of web pages, we recommend creating different tasks for data scraping.

]]>
What is the Flowchart Mode https://www.scrapestorm.com/tutorial/what-is-the-flowchart-mode/ Tue, 21 Aug 2018 07:08:20 +0000 http://www.scrapestorm.com/?type=post&pid=852 Flowchart mode is an operation mode developed by the ScrapeStorm team to meet the user’s rich personalized scraping requirements.

The flowchart mode supports visual web page click operations, which is fully in line with the way of thinking of manually browsing web pages. Users only need to open the collected website and use a few mouse clicks to automatically generate complex data collection rules.

 

This mode supports scraping from a single URL and multiple URLs, and supports bulk import of URLs from local documents.

You can also bulk generate URLs by modifying parameters.

Through the combination of the above two modes of operation, the mode can extract 99% of the webpage data on the current Internet.

]]>
How to choose the right mode https://www.scrapestorm.com/tutorial/how-to-choose-the-right-mode/ Tue, 21 Aug 2018 07:08:14 +0000 http://www.scrapestorm.com/?type=post&pid=854 1. Smart mode

Suitable for extracting list type web pages and content type web pages.

If you are extracting multiple URLs in batches, it is recommended to enter only the same type of webpages, for example, all of them are list types or all of them are content types. Different types of webpages suggest creating different tasks for extraction.

If you don’t have a programming foundation, or want to save the manual operation of the flowchart mode, and the page you need to extract meets the above types, then this mode is your preferred mode.

 

 

 

2. Flowchart Mode

Suitable for all types of web pages.

If the smart mode does not meet your needs, then the flowchart mode will definitely solve your problem.

In order to minimize the difficulty of user use, we have been optimizing the flowchart mode. However, we still recommend that you learn the tutorial before using the flowchart mode.

It is our ultimate goal to let the user master the mode without reading the tutorial.

]]>
Basic settings for the scraping task https://www.scrapestorm.com/tutorial/how-to-create-and-delete-tasks/ Tue, 21 Aug 2018 07:08:08 +0000 http://www.scrapestorm.com/?type=post&pid=859 1. Create a new task

ScrapeStorm provides a variety of ways to create tasks. You can create a new task by clicking the corresponding button on the home page to create a new mode scraping task, or by clicking the icon in the upper left corner.

2. Delete tasks

When deleting a single task, you can directly click the “×” on the right side of the task to delete. If you want to delete multiple tasks, you can press Ctrl or Shift to select multiple tasks and right click to delete.

3. Task Settings

Right click on the task and set it in the pop-up menu. Specific settings include: Start, Edit Task, View Data, Modify Name, Copy Rule, Share Rule, Change Group, and Delete.

4. Create a new group

Click the icon in the top left corner to create a task group and name the group.

5. Delete the group

Select the group and right click to modify the group name or delete the group.

6. Copy Rule

Right click on the task, select the copy task, and create a new one.

7. Smart mode transforms to flowchart mode.

Click “Copy Rule” and check “Transform to Flowchart Mode” on the interface.

P.S. Before transforming it to flowchart mode, the original task needs to be saved, otherwise it cannot be transformed.

8. Set group and name when creating a new task

When setting up a task in the multi-URL input box, you can select the group of tasks or set the task name.

]]>