With the help of
nltk.tokenize.SExprTokenizer() method, we are able to extract the tokens from string of characters or numbers by using
tokenize.SExprTokenizer() method. It actually looking for proper brackets to make tokens.
Return : Return the tokens from a string of characters or numbers.
Example #1 :
In this example we can see that by using
tokenize.SExprTokenizer() method, we are able to extract the tokens from stream of characters or numbers by taking brackets in consideration.
[‘( a * ( b+c ))’, ‘ab’, ‘( a-c )’]
Example #2 :
[‘(a b)’, ‘c’, ‘d’, ‘(e f)’]
- Python NLTK | nltk.tokenize.TabTokenizer()
- Python NLTK | nltk.tokenize.SpaceTokenizer()
- Python NLTK | nltk.tokenize.StanfordTokenizer()
- Python NLTK | nltk.tokenizer.word_tokenize()
- Python NLTK | nltk.TweetTokenizer()
- Python NLTK | nltk.tokenize.mwe()
- Python NLTK | nltk.WhitespaceTokenizer
- Python NLTK | nltk.tokenize.LineTokenizer
- Python | NLTK nltk.tokenize.ConditionalFreqDist()
- Python | Gender Identification by name using NLTK
- Python NLTK | tokenize.regexp()
- Python NLTK | tokenize.WordPunctTokenizer()
- Creating a Basic hardcoded ChatBot using Python-NLTK
- Python | Measure similarity between two sentences using cosine similarity
- Text Preprocessing in Python | Set - 1
- Text Preprocessing in Python | Set 2
- Text detection using Python
- Python | Text Summarizer
If you like GeeksforGeeks and would like to contribute, you can also write an article using contribute.geeksforgeeks.org or mail your article to firstname.lastname@example.org. See your article appearing on the GeeksforGeeks main page and help other Geeks.
Please Improve this article if you find anything incorrect by clicking on the "Improve Article" button below.