Let’s say you need to do a website that must support multiple
languages for cultures as diverse as Japan, France, Russia, Saudi
Arabia, and Brazil, as well as the US. This can be quite a
daunting task, with all kinds of unexpected gotchas.
The ideal character set of choice is, of course, UTF8. Alas, you
will note that most of the systems you’ll need to use defaults to
LATIN1, including MySQL. If your site is written in PHP, that
also by default is set to LATIN1.
I find it quite puzzling that in this day and age of
globalization that many of the tools don’t default to UTF8. And
there are major issues with this, because everything in the chain
of delivery must either be set to UTF8 or can handle UTF8 or
you’ll see bizarreness when you attempt to display the characters
of some languages. You will probably see a series of question
marks (“??? ??? ?????”) instead of the actual words. Sometimes
you may see a series of squares. …
[Read more]