FuzzyWuzzy Python library

There are many methods of comparing string in python. Some of the main methods are:

  1. Using regex
  2. Simple compare
  3. Using difflib

But one of the very easy method is by using fuzzywuzzy library where we can have a score out of 100, that denotes two string are equal by giving similarity index. This article talks about how we start using fuzzywuzzy library.

FuzzyWuzzy is a library of Python which is used for string matching. Fuzzy string matching is the process of finding strings that match a given pattern. Basically it uses Levenshtein Distance to calculate the differences between sequences.
FuzzyWuzzy has been developed and open-sourced by SeatGeek, a service to find sport and concert tickets. Their original use case, as discussed in their blog.



    Requirements of fuzzywuzzy

  • Python 2.4 or higher
  • python-Levenshtein

Install via pip :

pip install fuzzywuzzy
pip install python-Levenshtein

How to use this library ?

First of import these modules,

filter_none

edit
close

play_arrow

link
brightness_4
code

from fuzzywuzzy import fuzz
from fuzzywuzzy import process

chevron_right


Simple ratio usage :

filter_none

edit
close

play_arrow

link
brightness_4
code

fuzz.ratio('geeksforgeeks', 'geeksgeeks')
87
  
# Exact match
fuzz.ratio('GeeksforGeeks', 'GeeksforGeeks')  
  
100
fuzz.ratio('geeks for geeks', 'Geeks For Geeks '
80

chevron_right


filter_none

edit
close

play_arrow

link
brightness_4
code

fuzz.partial_ratio("geeks for geeks", "geeks for geeks!")
100
# Exclamation mark in second string, 
but still partially words are same so score comes 100
  
fuzz.partial_ratio("geeks for geeks", "geeks geeks")
64
# score is less because there is a extra 
token in the middle middle of the string.

chevron_right


Now, token set ratio an token sort ratio:

filter_none

edit
close

play_arrow

link
brightness_4
code

# Token Sort Ratio
fuzz.token_sort_ratio("geeks for geeks", "for geeks geeks")
100
  
# This gives 100 as every word is same, irrespective of the position 
  
# Token Set Ratio
fuzz.token_sort_ratio("geeks for geeks", "geeks for for geeks")
88
 fuzz.token_set_ratio("geeks for geeks", "geeks for for geeks")
100
# Score comes 100 in second case because token_set_ratio 
considers duplicate words as a single word.

chevron_right


Now suppose if we have list of list of options and we want to find the closest match(es), we can use the process module

filter_none

edit
close

play_arrow

link
brightness_4
code

query = 'geeks for geeks'
choices = ['geek for geek', 'geek geek', 'g. for geeks'
   
# Get a list of matches ordered by score, default limit to 5
process.extract(query, choices)
[('geeks geeks', 95), ('g. for geeks', 95), ('geek for geek', 93)]
   
# If we want only the top one
process.extractOne(query, choices)
('geeks geeks', 95)

chevron_right


There is also one more ratio which is used often called WRatio, sometimes its better to use WRatio instead of simple ratio as WRatio handles lower and upper cases and some other parameters too.

filter_none

edit
close

play_arrow

link
brightness_4
code

fuzz.WRatio('geeks for geeks', 'Geeks For Geeks')
100
fuzz.WRatio('geeks for geeks!!!','geeks for geeks')
100
# whereas simple ratio will give for above case
fuzz.ratio('geeks for geeks!!!','geeks for geeks')
91

chevron_right


Full Code

filter_none

edit
close

play_arrow

link
brightness_4
code

# Python code showing all the ratios together, 
# make sure you have installed fuzzywuzzy module
  
from fuzzywuzzy import fuzz
from fuzzywuzzy import process
  
s1 = "I love GeeksforGeeks"
s2 = "I am loving GeeksforGeeks"
print "FuzzyWuzzy Ratio: ", fuzz.ratio(s1, s2)
print "FuzzyWuzzy PartialRatio: ", fuzz.partial_ratio(s1, s2)
print "FuzzyWuzzy TokenSortRatio: ", fuzz.token_sort_ratio(s1, s2)
print "FuzzyWuzzy TokenSetRatio: ", fuzz.token_set_ratio(s1, s2)
print "FuzzyWuzzy WRatio: ", fuzz.WRatio(s1, s2),'\n\n'
  
# for process library,
query = 'geeks for geeks'
choices = ['geek for geek', 'geek geek', 'g. for geeks'
print "List of ratios: "
print process.extract(query, choices), '\n'
print "Best among the above list: ",process.extractOne(query, choices)

chevron_right


Output:

FuzzyWuzzy Ratio:  84
FuzzyWuzzy PartialRatio:  85
FuzzyWuzzy TokenSortRatio:  84
FuzzyWuzzy TokenSetRatio:  86
FuzzyWuzzy WRatio:  84 


List of ratios: 
[('g. for geeks', 95), ('geek for geek', 93), ('geek geek', 86)] 

Best among the above list:  ('g. for geeks', 95)

The FuzzyWuzzy library is built on top of difflib library, python-Levenshtein is used for speed. So it is one of the best way for string matching in python.



My Personal Notes arrow_drop_up

Check out this Author's contributed articles.

If you like GeeksforGeeks and would like to contribute, you can also write an article using contribute.geeksforgeeks.org or mail your article to contribute@geeksforgeeks.org. See your article appearing on the GeeksforGeeks main page and help other Geeks.

Please Improve this article if you find anything incorrect by clicking on the "Improve Article" button below.




Article Tags :

2


Please write to us at contribute@geeksforgeeks.org to report any issue with the above content.