The IronPython, Unicode, and Fragmentation Debate

| by Jonathan Allen Follow 608 Followers on Jun 15, 2007. Estimated reading time: 2 minutes |

Unlike the canonical implementation, IronPython implements the str class as Unicode rather than an ASCII byte stream. While some are saying this is a serious fragmentation issue, others say it is no big deal.

The root of the issue is whether or not the str class must to be implemented as ASCII. While ASCII is severely limited in terms of supporting non-English languages, it can do so using code pages. ASCII strings can also be used to represent binary data as byte streams.

In non-canonical implementations like IronPython and JPython, the str class is implemented using the platform defined String class. In this case, that means Unicode strings. While this will not affect most applications, those that use str for non-English code pages or as byte arrays won't work.

Calvin Spealman argues this is a serious problem:

IronPython takes the syntax, but stops short of the language. The problem is one for both Python and IronPython lovers. In Python land, we're seeing what appears to be an influx of interest from the IronPython (also, via Silverlight) world, but all those new developers are creating completely incompatible code. IronPython advocates, on the other hand, look silly to think they are promoting the Python language, and are completely missing out on hundreds of great libraries, years of built up community, and synergy that isn't just a buzzword.

Response from the community have not been quite so negative. Michael Foord responds:

To make it clear - at Resolver we have a 'large' IronPython application, which uses many modules from the Python standard library as well as third party Python libraries - and it works *great*.

Manuel also defends the decision:

First of all, Python, CPython, IronPython, Jython, PyPy are all changing entities. As changing entities, we can only legitimately criticize their trajectories. I see zero evidence that IronPython will "fork" the Python community. So much activity is being spent to make the Python library run in IronPython, in the FePy community and in the Microsoft sanctioned community.

Even Guido van Rossum, the creator of Python himself, stepped in:

You realize that Jython has exactly the same str==unicode issue, right? I've endorsed this approach for both versions from the start. So I don't know what you are so bent out of shape about.

For the time being, it looks like the Python community is willing to accept some incompatibilities in exchange for support on more platforms.

Rate this Article

Adoption Stage

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Check out the pythonic-syntax Boo .NET language. by Cedric Vivier

If you do not know it, maybe you should try the Boo Language for .NET instead of IronPython.
Boo is a new object oriented statically typed programming language for the .NET/Mono with a python inspired syntax and a special focus on language and compiler extensibility.

Thought from the ground-up for the .NET/Mono world everything is Unicode by default.

Oh, I forgot to add, no more "self"-plague in your classes YAY! :)

class MyClass:
y = 1

def AddToFieldY(x):
y += x

c = MyClass()
print c.y // displays 3

The official website is here:
Oh, and if you like it, please join the community on the mailing-list :)

How about a Python section in InfoQ? by Zeev B

I see there is a Ruby section in InfoQ - Why not add a python section also?

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

2 Discuss

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you