NLP | Proper Noun Extraction

Chunking all proper nouns (tagged with NNP) is a very simple way to perform named entity extraction. A simple grammar that combines all proper nouns into a NAME chunk can be created using the RegexpParser class.

Then, we can test this on the first tagged sentence of treebank_chunk to compare the results with the previous recipe:

Code #1 : Testing it on the first tagged sentence of treebank_chunk



filter_none

edit
close

play_arrow

link
brightness_4
code

from nltk.corpus import treebank_chunk
from nltk.chunk import RegexpParser
from chunkers import sub_leaves
  
chunker = RegexpParser(r'''  
                       NAME:
                       {<NNP>+}
                       ''')
      
print ("Named Entities : \n"
       sub_leaves(chunker.parse(
               treebank_chunk.tagged_sents()[0]), 'NAME'))

chevron_right


Output :

Named Entities : 
[[('Pierre', 'NNP'), ('Vinken', 'NNP')], [('Nov.', 'NNP')]]

Note : The code above returns all the proper nouns – ‘Pierre’, ‘Vinken’, ‘Nov.’
NAME chunker is a simple usage of the RegexpParser class. All sequences of NNP tagged words are combined into NAME chunks.
PersonChunker class can be used if one only want to chunk the names of people.
 
Code #2 : PersonChunker class

filter_none

edit
close

play_arrow

link
brightness_4
code

from nltk.chunk import ChunkParserI
from nltk.chunk.util import conlltags2tree
from nltk.corpus import names
  
class PersonChunker(ChunkParserI):
    def __init__(self):
        self.name_set = set(names.words())
          
    def parse(self, tagged_sent):
          
        iobs = []
        in_person = False
        for word, tag in tagged_sent:
            if word in self.name_set and in_person:
                iobs.append((word, tag, 'I-PERSON'))
            elif word in self.name_set:
                iobs.append((word, tag, 'B-PERSON'))
                in_person = True
            else:
                iobs.append((word, tag, 'O'))
                in_person = False
                  
        return conlltags2tree(iobs)

chevron_right


PersonChunker class checks whether each word is in its names_set (constructed from the names corpus) by iterating over the tagged sentence. It either uses B-PERSON or I-PERSON IOB tags if the current word is in the names_set, depending on whether the previous word was also in the names_set. O IOB tag is assigned to the word that’s not in the names_set argument. IOB tags list is converted to a Tree using conlltags2tree() after completion.
 
Code #3 : Using PersonChunker class on the same tagged sentence

filter_none

edit
close

play_arrow

link
brightness_4
code

from nltk.corpus import treebank_chunk
from nltk.chunk import RegexpParser
from chunkers import sub_leaves
  
from chunkers import PersonChunker
chunker = PersonChunker()
print ("Person name  : "
       sub_leaves(chunker.parse(
               treebank_chunk.tagged_sents()[0]), 'PERSON'))

chevron_right


Output :

Person name  : [[('Pierre', 'NNP')]]


My Personal Notes arrow_drop_up

Aspire to Inspire before I expire

If you like GeeksforGeeks and would like to contribute, you can also write an article using contribute.geeksforgeeks.org or mail your article to contribute@geeksforgeeks.org. See your article appearing on the GeeksforGeeks main page and help other Geeks.

Please Improve this article if you find anything incorrect by clicking on the "Improve Article" button below.