Skip to content
Related Articles

Related Articles

Improve Article

How to Install Python Scrapy on Windows?

  • Last Updated : 09 Sep, 2021

Scrapy is a web scraping library that is used to scrape, parse and collect web data. Now once our spider has scraped the data then it decides whether to:

  • Keep the data.
  • Drop the data or items.
  • stop and store the processed data items.

In this article, we will look into the process of installing the Scrapy module on Windows.

Pre-requisites:

The only thing that you need for installing the Scrapy module on Windows are:

Installing Scrapy on Windows:

For Conda Users:

If you want the installation to be done through conda, you can use the below command:

conda install scrapy

Type y for yes when prompted.



You will get a similar message once the installation is complete

installing scrapy using conda

Make sure you follow the best practices for installation using conda as:

  • Use an environment for installation rather than in the base environment using the below command:
conda create -n my-env
conda activate my-env

Note: If your preferred method of installation is conda-forge, use the below command:

conda config --env --add channels conda-forge

For PIP Users:

Users who prefer to use pip can use the below command to install the Scrapy package on Windows:

pip install scrapy

You will get a similar message once the installation is complete:

installing scrapy using pip

Verifying Scrapy Module Installation:

To verify if Scrapy has been successfully installed in your system run the below code in a python IDE of your choice:

Python3




import scrapy
scrapy.__version__

If successfully installed you will get the following output.

verifying scrapy installation

My Personal Notes arrow_drop_up
Recommended Articles
Page :