Cewl Tool – Creating Custom Wordlists Tool in Kali Linux
In this article, we will see how to create a wordlist with the Kali Linux tool Cewl and what options are available in this post.
Cewl is a Ruby program that crawls a URL to a defined depth, optionally following external links, and produces a list of keywords that password crackers such as John the Ripper can use to crack passwords. can. FAB (Files Already Bagged) is a command-line program that generates author/producer lists from already downloaded files using information extraction algorithms similar to CeWL.
Cewl is a custom wordlist generator that comes pre-installed with Kali Linux. By the way, many custom wordlist generating tools, such as Crunch, may be available on the Internet. However, the Crunch tool may not be suitable for ethical hackers. With the help of the cewl tool, we can easily collect words and phrases from the target page. It has the ability to create a list of offensive words. In this tutorial, we will not explain how to install the cewl tool. As said earlier, Kali Linux comes with pre-installed software. Cewl is a robust program that can quickly scrape the webserver of any website.
In the terminal, type “cewl -h” to see a list of all the options it accepts, complete with their descriptions.
Cewl Usage – Default Procedure:
Use the following command to spider the provided URL to a defined depth and print a list of terms that can be used as a dictionary to crack the password.
Saving Wordlist as a file
We save the print list of the term into a tab for the sake of record-keeping, improved readability, and possible references. We’ll use the -w parameter to save the output to a text file in this case.
Now that we’ve successfully run the instruction, let’s check to see if the output has been saved to a register.wordlists.txt is the output position in this situation.
cewl https://www.geeksforgeeks.org/ -w wordlists.txt cat wordlists.txt
Creating a Certain-Length Wordlist:
If you choose to create a wordlist with a certain word length, use the “-m” function, which allows you to set a minimum word length limit.
The following command will produce a list of at least 7 words; as seen in the screenshot, it has crawled the given website and printed a list of words of at least 7 characters.
cewl https://www.geeksforgeeks.org/ -m 7
Email Retrieval from a Website:
The “-e” option unlocks the email parameter, while the -n option hides the list of words created while crawling the provided website. It has successfully found 1 email-id from inside the website, as seen in the image below.
cewl https://www.geeksforgeeks.org/ -n -e
You can use the -v option for the verbose mode to extend the website crawling result and to retrieve all of a website’s information. It would dump the details available on the website rather than generate a wordlist.
cewl https://www.geeksforgeeks.org/ -v
Alpha-Numeric words Generation:
You may use the –with-numbers option in conjunction with the command to create an alpha-numeric wordlist. As you can see in the image below, it has created an alpha-numeric wordlist this time.
cewl https://www.geeksforgeeks.org/ --with-numbers
Count how many times a word appears on a webpage:
Use the -c options to enable the count parameter to count the number of terms repeated several times in a website. As you can see in the picture below, it has printed the count for each word that appears several times on the website.
cewl https://www.geeksforgeeks.org/ -c
Increase Spider Depth:
Use the -d option with the depth level number to activate the depth parameter for more quick crawling if you want to raise the spider level to create a larger list of words by counting more new words from the page. This depth level is set to 2 by default.
cewl https://www.geeksforgeeks.org/ -d 3
Additional debug details:
You can activate debug mode and view issues and raw website information while crawling using the –debug option.
cewl https://www.geeksforgeeks.org/ --debug
Scan to a depth of 2 (-d 2) and a minimum word length of 5 (-m 5), then save the words to a file (-w docswords.txt) using the following parameters:
cewl -d 2 -m 5 -w wordlists1.txt https://www.geeksforgeeks.org/ cat wordlists1.txt