How to Install Python Scrapy on Windows?
Scrapy is a web scraping library that is used to scrape, parse and collect web data. Now once our spider has scraped the data then it decides whether to:
- Keep the data.
- Drop the data or items.
- stop and store the processed data items.
In this article, we will look into the process of installing the Scrapy module on Windows.
The only thing that you need for installing the Scrapy module on Windows are:
Installing Scrapy on Windows:
For Conda Users:
If you want the installation to be done through conda, you can use the below command:
conda install scrapy
Type y for yes when prompted.
You will get a similar message once the installation is complete
Make sure you follow the best practices for installation using conda as:
- Use an environment for installation rather than in the base environment using the below command:
conda create -n my-env conda activate my-env
Note: If your preferred method of installation is conda-forge, use the below command:
conda config --env --add channels conda-forge
For PIP Users:
Users who prefer to use pip can use the below command to install the Scrapy package on Windows:
pip install scrapy
You will get a similar message once the installation is complete:
Verifying Scrapy Module Installation:
To verify if Scrapy has been successfully installed in your system run the below code in a python IDE of your choice:
If successfully installed you will get the following output.