How to Install Python Scrapy on Windows?
Last Updated :
20 Feb, 2023
Scrapy is a web scraping library that is used to scrape, parse and collect web data. Now once our spider has scrapped the data then it decides whether to:
- Keep the data.
- Drop the data or items.
- stop and store the processed data items.
In this article, we will look into the process of installing the Scrapy module on Windows.
Pre-requisites:
The only thing that you need for installing the Scrapy module on Windows are:
Installing Scrapy on Windows:
For Conda Users:
If you want the installation to be done through conda, you can use the below command:
conda install scrapy
Type y for yes when prompted.
You will get a similar message once the installation is complete
Make sure you follow the best practices for installation using conda as:
- Use an environment for installation rather than in the base environment using the below command:
conda create -n my-env
conda activate my-env
Note: If your preferred method of installation is conda-forge, use the below command:
conda config --env --add channels conda-forge
For PIP Users:
Users who prefer to use pip can use the below command to install the Scrapy package on Windows:
pip install scrapy
You will get a similar message once the installation is complete:
Verifying Scrapy Module Installation:
To verify if Scrapy has been successfully installed in your system run the below code in a python IDE of your choice:
Python3
import scrapy
scrapy.__version__
|
If successfully installed you will get the following output.
Like Article
Suggest improvement
Share your thoughts in the comments
Please Login to comment...