Skip to content
Related Articles

Related Articles

Crawpy – Yet Another Content Discovery Tool

Improve Article
Save Article
Like Article
  • Last Updated : 04 Jan, 2022

Crawpy is a free and open-source tool available on GitHub. This tool is a free and open-source tool this means you can download and install this tool free of cost. This tool is also called yet another content discovery tool written in python language. Crawpy is developed to work asynchronously this means that the tool can reach maximum limits which makes it fast than any other content discovery tool. This tool filter codes and filter words of the domain which the user provide. Crawly has many flags which make its user perform fuzzing in depth. Crawpy also generates reports after performing functioning over the domain. These reports can be used to check results. Crawpy can be used to scan multiple URLs simultaneously. 

What makes this tool different than others:

  • Crawpy can scan multiple URL’s.
  • Crawpy can generate reports after the scanning. You can generate reports of URL scanning.
  • Crawpy has a recursive scan mode which can give the status code in depth after the scanning.
  • Crawpy has many flags which can help its user in fuzzing.
  • Crawpy has a calibration mode that can apply the filter automatically during the scanning of a URL.
  • Crawpy can work asynchronously.


Step 1: Open your kali Linux operating system and use the following command to install the tool.

git clone

Step 2: Now use the following command to install dependencies of the tool.

pip3 install -r requirements.txt  

 All the dependencies has been installed. Now we will see examples to use the tool.


Example 1: Use the Crawpy tool to perform fuzzing on a domain.

python3 -u -w ./common.txt  -k -ac  -e .php,.html

The tool started fuzzing.

Example 2: Use the Crawpy tool to perform fuzzing/content discovery on a domain,

python3 -u -w ./common.txt -e .php,.html -t 20 -ac -k

My Personal Notes arrow_drop_up
Recommended Articles
Page :

Start Your Coding Journey Now!