UTF-8 locales not supported

[bshannon]

hypermail expects locales to be named as "en_US", but most locales are
now named as "en_US.UTF-8".

[jkbzh]

Thanks @bshannon.
I did a compromise. Assuming that the mapping between en_US and en_US.UTF-8 is the same, I made hypermail use en_US.UTF-8 if the en_US locale is not found.

Unfortunately, we cannot generalize this change to all the other languages. Using UTF-8 locales would mean that the functions in hypermail that depend on the locale for parsing and generating markup would assume all is UTF-8. The latter would clash at least with the messages in lang.h which are not coded into UTF-8 and result in a mixed charset output. As you pointed out in another conversation, the best approach would be to make hypermail support UTF-8 throughout.

I'm closing this particular issue as the en_US issue is fixed. I do agree that it's part of a more general one for supporting UTF-8 in hypermail.