Convert Unicode to ASCII in Python
Unicode is the universal character set and a standard to support all the world’s languages. It contains 140,000+ characters used by 150+ scripts along with various symbols. ASCII on the other hand is a subset of Unicode and the most compatible character set, consisting of 128 letters made of English letters, digits, and punctuation, with the remaining being control characters. This article deals with the conversion of a wide range of Unicode characters to a simpler ASCII representation using the Python library anyascii.
The text is converted from character to character. The mappings for each script are based on conventional schemes. Symbolic characters are converted based on their meaning or appearance. If the input contains ASCII characters, they are untouched, the rest are all tried to be converted to ASCII. Unknown characters are removed.
Attention geek! Strengthen your foundations with the Python Programming Foundation Course and learn the basics.
To begin with, your interview preparations Enhance your Data Structures concepts with the Python DS Course. And to begin with your Machine Learning Journey, join the Machine Learning - Basic Level Course
To install this module type the below command in the terminal.
pip install anyascii
Example 1: Working with Several languages
In this, various different languages like Unicode are set as input, and output is given as converted ASCII characters.
The translation from hindi Script : nmste vidyarthi The translation from Punjabi Script : sti sri akal
Example 2: Working with Unicode Emojis and Symbols
This library also handles working with emojis and symbols, which are generally Unicode representations.
from anyascii import anyascii # working with emoji example emoji_uni = anyascii('😎 👑 🍎') print("The ASCII from emojis : " + str(emoji_uni)) # checking for Symbols sym_uni = anyascii('➕ ☆ ℳ') print("The ASCII from Symbols : " + str(sym_uni))
The ASCII from emojis : :sunglasses: :crown: :apple: The ASCII from Symbols : :heavy_plus_sign: * M