DenkzeitWiki

Main /

Python Unicode

Python
Unicode Unicode Transformation Format
Unicode is an abstract mapping from numbers to character symbols. It is not a document encoding.
UTF-8 is a document encoding.

When printing a string, Python will attempt to convert it to your default encoding, which is usually ASCII.[1]

 >>> u'üöä'
 u'\xfc\xf6\xe4'

• http://diveintopython.org/xml_processing/unicode.html
  

---

• http://www.reportlab.com/i18n/python_unicode_tutorial.html

 >>> u"Hello World!"  #create a Unicode string
 u'Hello World!'

To construct the string, Python assumed that the literal input was in UTF8, the "default encoding".[2]

Sometimes you want to see how stuff is being stored internally. We deal with this using an 'encoding' called 'utf-16', which is actually pretty close to how the Unicode is stored internally. In fact, there are two flavours, 'utf-16-le' for little-endian machines and 'utf-16-be' for big-endian machines.

 >>> a.encode('utf-16')
 '\377\376A\000n\000d\000r\000\202\000'

So utf-16 is almost like the internal representation of unicode-strings in python. The raw string so to speak.

---

• Unicode
  
  
• http://evanjones.ca/python-utf8.html --utf8
• http://www.vandervossen.net/2003/07/unicode_in_python --kurz und gut
• http://www.jorendorff.com/articles/unicode/python.html --kurz und ehm gut
  
• http://www.peterbe.com/plog/html-entity-fixer --HTML entity fixer, escapes characters
  
• http://james.lab6.com/2003/10/12/unicodelessons/ --Lessons learned when using Unicode with Python
  
• Some Observations on Working With Non-ASCII Character Sets

• http://python.miscellaneousmirror.org/peps/pep-0100.html --PEP 100: Python Unicode Integration
• http://www.python.org/doc/2.2.3/whatsnew/node8.html --Unicode Changes
  
  
• http://www.egenix.com/files/python/LSM2005-Developing-Unicode-aware-applications-in-Python.pdf --Developing Unicode-aware Applications in Python
• http://blog.ianbicking.org/do-i-hate-unicode-or-do-i-hate-ascii.html --Do I hate Unicode, or Do I Hate ASCII?
• http://faassen.n--tree.net/blog/view/weblog/2005/08/02/0 --Changing the Python default encoding considered harmful
  
• Unicode HOWTO
  
• http://www.djangoproject.com/documentation/unicode/
  
  
• [Python-de] Unicode, warum ASCII als default, warum nicht Latin-1 ???
  • ASCII is the default-encoding of unicode-strings if str()-ified.

MySQL

• MySQL and Python and Unicode
• End to End Unicode Web Applications in Python