German translation Special character showing problem

Re: German translation Special character showing problem

amit kumar wrote:
>
>Myself Amit Kumar, I got some problem on German language.
>
>It did not recognise the special charactor like =E9, =F3, =E4 and so on, it
>put the "?".
>
>In Deutsch language:-
>
>
>  English             Deutsch                    Show On Target(Blacktop)
>1)Domain              Dom=E4ne                      Dom?ne.
>2)Encryption Method   Verschl=FCsselungsmethode     Verschl?sselungsmethode
>and so on.
>
>Please suggest me, how I can resolve this problem?

Exactly where are you seeing the '?' characters. In the archives? In
emails? If in emails, in what emails and where?

What is the list's preferred_language setting? Is it German?

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

Re: German translation Special character showing problem

Am Samstag, 18. April 2009 schrieb amit kumar:

Hi Amit,

> It did not recognise the special charactor like é, ó, ä and so on, it
> put the "?".
>
> 2)Encryption Method   Verschlüsselungsmethode    
> Verschl?sselungsmethode and so on.
>
> Please suggest me, how I can resolve this problem?

Oops. This problem should not exist at all. 

Could you tell me more abour your setup? 
Which linux distribution do you use? 
Where does the Mailman-package come from? 
Which version? 

When do you see those problems *exactly*?

Peer

--

-- 
Heinlein Professional Linux Support GmbH
Linux: Akademie - Support - Hosting

http://www.heinlein-support.de

Zwangsangaben lt. §35a GmbHG:
HRB 93818 B / Amtsgericht Berlin-Charlottenburg, 
Geschäftsführer: Peer Heinlein  -- Sitz: Berlin

Re: German translation Special character showing problem

amit kumar wrote:
>
>In Deutsch language:-
>
>  English             Deutsch                    Show On Target(Blacktop)
>1)Domain              Domäne                      Dom?ne.
>2)Encryption Method   Verschlüsselungsmethode     Verschl?sselungsmethode
>and so on.
>
>Language setting was "German".

You are not telling us where you are seeing these '?' characters.

"Show On Target(Blacktop)" means nothing to me. Are you seeing them in
the Mailman web interface?, on what pages? In the mailman archives? In
email from Mailman? Which emails? where in the email?

You should not be seeing this on a German language list, but in order
to help, we need to know where you are seeing it.

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

Re: Mailman-i18n Digest, Vol 72, Issue 3

Re: German translation Special character showing problem

amit kumar wrote:
>
>Sorry, I have seen this "?" on networkmanager-vpnc plugin. When I start to
>make the vpnc connection through nm-applet. It ran the networkmanager-vpnc
>plugin.
>Left click the nm-applet's icon --> go to the vpn connection --> go to
>configure vpn --> press add button --> then press the create button --> see
>on Optional there is a Domain. That "domain" is in German "Domäne" but it
>print  "Dom?ne". That is the problem.

None of the above seems to involve Mailman. Unless the "Dom?ne" that
you see is on a Mailman generated page, this is not the appropriate
place to get help for this issue. This list, mailman-i18n <at> python.org,
is for i18n issues involving the GNU Mailman email list management
software only.

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

Problem with Danish characters?

Hi all,

I have (so far) been unable to show correctly Danish characters
in the names of the list members. Let me give 2 examples.

1.
Say I create a list 'test' and subscribe a member like here:
      newlist -l da test kaja <at> cs.au.dk kaja
      echo "Kaja Jørgensen <kaja <at> cs.au.dk>" | add_members -r - -a n -w n test
to which Mailman responds with:
      Tilmeldt: Kaja Jørgensen <kaja <at> cs.au.dk>

So far so good. Now I ask for the membership list with
      list_members -f test
and receive back:
      Kaja J?rgensen <kaja <at> cs.au.dk>

2.
I edit the membership list from the web page:
- go to Membership List
- replace member name Kai Nielsen with Kai Jørgensen Nielsen (looks good)
- submit changes
- go to another web membership page, then back to one with 'Kai...'
   and see: Kai J&#248;rgensen Birger Nielsen

Relevant settings in .../mailman/Mailman/mm_cfg.py are:
   # Charset and Encoding
   DEFAULT_CHARSET = 'iso-8859-1'
   VERBATIM_ENCODING = ['iso-8859-1']

We've been using Mailman for yers. Currently running v. is 2.1.11 on
Linux (RHEL 5.3). Could you help? Perhaps point me to a previous thread
on this list which provides a solution?

Regards
Kaja

Re: Problem with Danish characters?

Kaja P. Christiansen wrote:
>
>I have (so far) been unable to show correctly Danish characters
>in the names of the list members. Let me give 2 examples.
>
>1.
>Say I create a list 'test' and subscribe a member like here:
>      newlist -l da test kaja <at> cs.au.dk kaja
>      echo "Kaja Jørgensen <kaja <at> cs.au.dk>" | add_members -r - -a n -w n test
>to which Mailman responds with:
>      Tilmeldt: Kaja Jørgensen <kaja <at> cs.au.dk>
>
>So far so good. Now I ask for the membership list with
>      list_members -f test
>and receive back:
>      Kaja J?rgensen <kaja <at> cs.au.dk>

The name 'Kaja Jørgensen' is stored internally as a python unicode
object. list_members encodes this for display using the encoding given
by Python's sys.getdefaultencoding(). This in turn defaults to
"ascii". If you want list_members to show non-ascii characters as
other than '?', you have two choices.

You can edit the definition of setencoding() in
/usr/lib/pythonV.V/site.py to replace "ascii" with "iso-8859-1", or
you can edit Mailman's bin/list_members  and replace the line

ENC = sys.getdefaultencoding()

with

ENC = "iso-8859-1"

>2.
>I edit the membership list from the web page:
>- go to Membership List
>- replace member name Kai Nielsen with Kai Jørgensen Nielsen (looks good)
>- submit changes
>- go to another web membership page, then back to one with 'Kai...'
>   and see: Kai J&#248;rgensen Birger Nielsen

Again, the name is properly stored internally. This display is due to
over-protection of the web interface from cross-site-scripting
attacks. The attached file escape_html.patch.txt contains a patch that
will allow these names to display properly in the admin Membership
List.

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

--- f:/test-mailman-2.2/Mailman/Utils.py	2009-03-12 15:28:34.000000000 -0700
+++ f:/test-mailman/Mailman/Utils.py	2009-03-21 20:10:12.593750000 -0700
 <at>  <at>  -425,8 +425,10  <at>  <at> 

 
 
+_ampre = re.compile('&amp;((?:#[0-9]+|[a-z]+);)', re.IGNORECASE)
 def websafe(s):
-    return cgi.escape(s, quote=True)
+    # Don't double escape html entities
+    return _ampre.sub(r'&\1', cgi.escape(s, quote=True))

 
 def nntpsplit(s):

Re: Problem with Danish characters?

Mark Sapiro wrote:
>
>You can edit the definition of setencoding() in
>/usr/lib/pythonV.V/site.py to replace "ascii" with "iso-8859-1", ...

Actually, the above is not the proper way to do this. The proper way is
to create /usr/lib/pythonV.V/site-packages/sitecustomize.py containing
the two lines

import sys
sys.setdefaultencoding('iso-8859-1')

--

-- 
Mark Sapiro <mark <at> msapiro.net>        The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan

Re: Problem with Danish characters?

Hi Mark,

Thanks much for the escape_html.patch.txt and the advice below:
they have solved the problem with Danish characters in list_members
(also sync_members!) and web membership page.

This brings me to another question. When I define DEFAULT_CHARSET
in the mm_cfg.py, and mm_cfg.py is imported in other modules, the
encoding is actually known to Mailman. Would it be possible to use
this value instead of patching Python?

Kaja

> Mark Sapiro wrote:
>> You can edit the definition of setencoding() in
>> /usr/lib/pythonV.V/site.py to replace "ascii" with "iso-8859-1", ...
> 
> 
> Actually, the above is not the proper way to do this. The proper way is
> to create /usr/lib/pythonV.V/site-packages/sitecustomize.py containing
> the two lines
> 
> import sys
> sys.setdefaultencoding('iso-8859-1')
>