headers
Casey Brown | 1 Jul 2011 21:55
Favicon

Call for image filter referendum

/Please distribute this message widely/

*Call for referendum*:  The Wikimedia Foundation, at the direction of
the Board of Trustees, will be holding a vote to determine whether
members of the community support the creation and usage of an opt-in
personal image filter, which would allow readers to voluntarily screen
particular types of images strictly for their own account.

Further details and educational materials will be available shortly.
The referendum is scheduled for 12-27 August, 2011, and will be
conducted on servers hosted by a neutral third party.  Referendum
details, officials, voting requirements, and supporting materials will
be posted at http://meta.wikimedia.org/wiki/Image_filter_referendum
shortly.

For the coordinating committee,
Philippe (WMF)
Cbrown1023
Risker
Mardetanha
PeterSymonds
Robert Harris

--

-- 
Casey Brown
Cbrown1023
Permalink | Reply | 0 comments |
headers
Matthew Pocock | 29 Jul 2011 14:58
Picon
Gravatar

character encoding wrong for some pages

Hi,

I've been pulling down pages from wiktionary in a Java application. The
majority of pages seem to work fine (e.g. http://en.wiktionary.org//wiki/-a).
I can load them in Java, and if I wget them, I end up with a file containing
what I'd expect.

However, some pages seem not to work (e.g.
http://en.wiktionary.org/wiki/absolute_instrument). In Java, I get a codec
exception and when using wget, the resulting downloaded file is garbled. I
think this is because although they claim to be UTF-8 encoded, they are not.
These pages show up fine in my browser, but it isn't telling me what charset
it uses to decode the text.

Is this a known issue? Is there any workaround for this? Can it be fixed
server-side?

Thanks,

Matthew

--

-- 
Dr Matthew Pocock
Visitor, School of Computing Science, Newcastle University
mailto: turingatemyhamster@...
gchat: turingatemyhamster@...
msn: matthew_pocock@...
irc.freenode.net: drdozer
tel: (0191) 2566550
mob: +447535664143
(Continue reading)

Permalink | Reply | 3 comments |
headers
Kurt Roeckx | 29 Jul 2011 15:11
Picon

Re: character encoding wrong for some pages

On Fri, Jul 29, 2011 at 01:58:15PM +0100, Matthew Pocock wrote:
> Hi,
> 
> I've been pulling down pages from wiktionary in a Java application. The
> majority of pages seem to work fine (e.g. http://en.wiktionary.org//wiki/-a).
> I can load them in Java, and if I wget them, I end up with a file containing
> what I'd expect.
> 
> However, some pages seem not to work (e.g.
> http://en.wiktionary.org/wiki/absolute_instrument). In Java, I get a codec
> exception and when using wget, the resulting downloaded file is garbled. I
> think this is because although they claim to be UTF-8 encoded, they are not.
> These pages show up fine in my browser, but it isn't telling me what charset
> it uses to decode the text.

It works perfectly for me.  Maybe your problem is that wgets saves
it as a gzipped filed?

The headers have this in it:
Content-Encoding: gzip
Content-Length: 5486
Content-Type: text/html; charset=UTF-8

And there is nothing wrong with it as far as I can see.

Kurt
Permalink | Reply | 0 comments |
headers
Daniel Zahn | 29 Jul 2011 15:15
Picon

Re: character encoding wrong for some pages

Hi,

when i wget the page "absolute_instrument"  i get a gzipped version of it.

file absolute_instrument
absolute_instrument: gzip compressed data, from Unix

as opposed to the example "-a", which is not gzipped, but plain HTML right
away.

Hence, the former one might look garbled to you, unless you use "gunzip"
first to remove the compression. (If gzip complains about "unknown suffix"
rename it to *.gz).
Then you should get regular HTML.

Here's an example on how to remove gzip in Java:

http://code.hammerpig.com/how-to-gunzip-files-with-java.html

I am not sure however how the server-side decides whether to compress it or
not.
Hope that helps anyways,

Daniel

On Fri, Jul 29, 2011 at 2:58 PM, Matthew Pocock <
turingatemyhamster@...> wrote:

> Hi,
>
(Continue reading)

Permalink | Reply | 1 comment |
headers
Matthew Pocock | 29 Jul 2011 16:04
Picon
Gravatar

Re: character encoding wrong for some pages

Ah, thanks! That was indeed my problem. I now look in the headers and if
they contain "Content-Encoding: gzip", I unzip the content. Not sure how I
could be silly enough to miss that.

Matthew

On 29 July 2011 14:15, Daniel Zahn <dzahn@...> wrote:

> Hi,
>
> when i wget the page "absolute_instrument"  i get a gzipped version of it.
>
> file absolute_instrument
> absolute_instrument: gzip compressed data, from Unix
>
> as opposed to the example "-a", which is not gzipped, but plain HTML right
> away.
>
> Hence, the former one might look garbled to you, unless you use "gunzip"
> first to remove the compression. (If gzip complains about "unknown suffix"
> rename it to *.gz).
> Then you should get regular HTML.
>
> Here's an example on how to remove gzip in Java:
>
> http://code.hammerpig.com/how-to-gunzip-files-with-java.html
>
> I am not sure however how the server-side decides whether to compress it or
> not.
> Hope that helps anyways,
(Continue reading)

Permalink | Reply | 0 comments |
headers
Casey Brown | 1 Jul 2011 21:55
Favicon

Call for image filter referendum

/Please distribute this message widely/

*Call for referendum*:  The Wikimedia Foundation, at the direction of
the Board of Trustees, will be holding a vote to determine whether
members of the community support the creation and usage of an opt-in
personal image filter, which would allow readers to voluntarily screen
particular types of images strictly for their own account.

Further details and educational materials will be available shortly.
The referendum is scheduled for 12-27 August, 2011, and will be
conducted on servers hosted by a neutral third party.  Referendum
details, officials, voting requirements, and supporting materials will
be posted at http://meta.wikimedia.org/wiki/Image_filter_referendum
shortly.

For the coordinating committee,
Philippe (WMF)
Cbrown1023
Risker
Mardetanha
PeterSymonds
Robert Harris

--

-- 
Casey Brown
Cbrown1023
Permalink | Reply | 0 comments |

Gmane