Yuri Astrakhan | 21 Jan 16:01 2016

Deadline for Jerusalem hackathon scholarships is today

**If you are a community developer interested in working on maps:**
The Wikimedia Hackathon 2016 <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2016> (Jerusalem, March 31 - April 3) focuses on https://phabricator.wikimedia.org/tag/community-wishlist-survey/ projects. There is some budget for sponsoring volunteer developers. THE DEADLINE TO REQUEST TRAVEL SPONSORSHIP IS TODAY, JANUARY 21. Exceptions can be made for developers focusing on Community Wishlist projects until the end of Sunday 24, but not beyond. If you or someone you know is interested, please REGISTER NOW <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2016>.

Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Yuri Astrakhan | 12 Dec 21:23 2015

Re: New version of Wikipedia-map

Tim, I was very excited to get your email!  I somehow missed Simon's efforts, and I think it would be a great idea for all of us to sync up (perhaps via hangout?)

I have recently submitted Kartographer extension (code)  for security review, and I hope we could deploy it at least to Wikivoyage fairly soon.  Kartographer eventually should allow readers to see and interact with the map just like Graph examples.

Kartographer uses mabox.js library, which includes Leaflet. Using mapbox.js will allow editors to add styled GeoJSON directly to wikipedia pages - example.  Also worth mentioning is the new feature I added to Kartotherian - an ability to generate pushpin images of any Maki symbol in any color (example).

Kartographer should allow editors to customize map for each article.  The big remaining issue is the server-side rendering - we can already generate static images, but we must be able to generate them with the extra GeoJSON layers.  It seems leaflet/mapbox.js do not support node.js headless rendering.  I saw the leaflet-headless project, but it might require some work to use it with mapbox.js.  So any help with this would be great.

Now to the points from your email:
* Style goals task is open, we should discuss how to work on it
* Transportation POIs was a request from Wikivoyage community.  I feel they should be at least reduced in size and restyled - should be easy enough using Mapbox Studio, but I am very bad at visual designing - any patches are welcome.
* Mobile Android app just added maps, but they use the base layer plus add pushpins for Wikipedia articles.  Eventually I hope they will be able to show maps as part of the articles, with the extra layers.
* Simon map is an awesome effort, and we should figure out how to bring it from wmflabs to production - otherwise we won't be able to use it for Wikipedia traffic - the virtual servers won't be able to support it, and it is not safe from security perspective.
* Multilingual maps are a huge request, so seriously doubt it in 2 months.  WMDE has graciously offered one of their engineers, Johannes, to work on Mapnik. He already fixed a very long standing RTL font rendering bug, and hopefully he will be able to figure out how to add HSTORE storage to Mapnik. Once done, it will be simple to add all languages to the vector tiles, and to pick what to render at the last second.
* We cannot show maps to any Wikipedia users as part of the articles because we don't have the server capacity for that yet. But, you can easily switch the geohack template (GPS coords in the upper right corner) to use our new maps, just like ruwiki did, by modifying GeoTemplate and GeoHack.js (these are ruwiki, but you can do the same for dewiki, enwiki, etc).  As always, this is up to the community and not WMF, thus I didn't do it myself.  Switching ruwiki geohack quadrupled our traffic. But geohack is obviously a stopgap measure - once we have more capacity, I hope we can use Kartographer extension on all Wikipedias.
* I'm fairly happy with the performance - all maps are served via 2 varnish caching servers + 4 backend servers.  For full production, we will need 4 varnish servers in each of the 4 data centers. That should significantly improve performance for many regions.
* A still big open question is how to add large external databases to Wikipedia.  OSM database required huge efforts, but we shouldn't have to do this every time we add a new db. No solution for this yet.  One option is to set up a well understood API on your database, and let Kartographer pick up that data?
* We already generate a un-labeled map (use /osm/ instead of /osm-intl/ ) - this can help with label collusion.
* Priorities is a great question :)  This quarter we were primarily concentrating on community feedback and adaption - which has been going great (maps on android, geo hack, wikivoyage). The next quarter we should start doing more integration and expansion, assuming we can get our hands on some servers.

== What can you help with ==
* Design a new better map Wikipedia-specific style
* Design a new better WebGL map Wikipedia-specific style
* Help improve SQL for vector tile generation (many bugs there)
* Help making mapbox.js run in node.js
* Gather and outline maps usage scenarios (product manager role)
* Expose your data via an API, and consume it via Kartographer
* Add more capabilities to Kartographer, e.g. spinning globe, etc
* Something else?

Ping me with any questions or ideas!

On Sat, Dec 12, 2015 at 9:17 PM, Tim Alder <tim-OEduV1PSX1RrN0UOaXResw@public.gmane.org> wrote:
Hello Yuri,
I'm glad that Simon (in CC) starts to create a new leaflet-version of
the map that we want to include inside Wikipedia [1]. Daniel Schwen is
in CC as developer of the WikiMiniAtlas.

I believe the  most things we can do in a community-driven process, but
there are some things where the WMF can perhaps help:
*Some design advice for Simon's map would be nice. What do you think
about the map? (The interactive Icons and the background map have to
work together, in the moment are e.g. the train station icons on the
background in the same color space like the icon above. Perhaps you can
re-color the train station or remove them. Especial the tram stations
seems not so important for me and could be removed in my eyes.)
*What features should we really have?
*What can we do to be usable in the mobile Wikipedia version or the app?
*What's the status of multilingual map tiles. Is there a chance to have
it available in 2 months or so?
*We know that only a promile of the Wikipedia-readers are using the map.
Do you see a chance that we get some advertising for it. I mean a larger
icon or for some time a little hint or a pop-up of the map for some
percent of the readers or so could help.

How happy are you in the moment with the render stack and the servers?
Do you think there will some problems with the performance to deliver tiles?

My Wikipedia-coordinates are in the Toollabs-OSM-database "gis" in
tables "wp_coords_red0", for each request I generate a new Geojson for
individual window of view. Do you think it would make more sense to try
to reder this data in vector tiles? Compared with OSM this data volume
is so little that we don't need hstore for it. I believe the benefit
could be to avoid collisions with other label and make it more
consistent during panning the map. It could be also interesting to
really render the labels in each different language as clickable labels.
What do you think? Could you help with rendering?

Did WMF change the priorities for maps?

Best regards,
Tim alias Kolossos


Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Federico Leva (Nemo | 8 Dec 12:19 2015

Where to find maps.wikimedia.org on ru.wikipedia.org?

Since several days ago, I'm struggling to find any URL or action on 
ru.wiki from which I can see or load maps.wikimedia.org. Yet, some claim 
that maps.wikimedia.org is used on the Russian Wikipedia.

Please help: https://www.mediawiki.org/wiki/Talk:Scrum_of_scrums/2015-12-02


Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Federico Leva (Nemo | 8 Dec 12:17 2015

Fwd: Generate location maps dynamically, producing actual images

I can't believe there isn't a report for this, anyway I filed 

     T92535: Exclude {{location map}} images from PageImages
     T70008: PDF-related improvements needed at Wikivoyage, especially 
for dynamic maps
     T32702: PDF export extension problem with <div style="position:> 
and any location templates
     T52714: VisualEditor: Location map template does not display correctly
     T64572: Media Viewer and location map overlays


Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Simon Legner | 13 Nov 11:00 2015

Status of WIWOSM?


I wanted to ask what the current status of the WIWOSM project [1] is.
It seems that there hasn't been a data update since March 2015 as
reported via [2, 3].

Is this due to technical problems or does the project lack of maintainers?

Thanks in advance and best regards from Austria,

[1] https://wiki.openstreetmap.org/wiki/WIWOSM
[2] https://github.com/aiomaster/WIWOSM/issues/11
[3] https://wiki.openstreetmap.org/wiki/Talk:WIWOSM#No_update_since_march_2015

Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Yuri Astrakhan | 7 Oct 01:05 2015

3 maps-related proposals

Folks, 3 out of 11 tech proposals are for maps! I say maps are important, eh? :) Please evaluate and comment - what does the maps community think about them. Thanks!

Developing a map to show entities around the world that need photographs on Wikipedia

Wikimedia Maps Rendering Improvements
Improving road labels and borders on Wikimedia Maps

Wikimaps Warper 2.0
Refactoring Wikimaps Warper code to make the project more accessible for volunteer contributions

---------- Forwarded message ----------
From: Chris Schilling <cschilling-AeOJrEpdGNeGglJvpFV4uA@public.gmane.org>
Date: Wed, Oct 7, 2015 at 1:14 AM
Subject: [Wikitech-l] Technical expertise needed for Individual Engagement Grant proposals!
To: labs-l-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org, wikitech-l-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org

Hey folks,

Applicants for the current round of Individual Engagement Grants (IEG) have
submitted many proposals that involve new tools, bot tasks, and other
technical elements.  I’ve provided the list of these proposals and brief
descriptions below.

Your feedback in these technical proposals is requested!  If one of these
ideas interests you, consider reading it over, and feel free to endorse,
express concerns, make suggestions, and ask questions.  Your input and
expertise will help the applicants develop better proposals, and support
the IEG Committee during their evaluation. Comments are requested until
October 19th.

With thanks,



Wiki Needs Pictures
> Developing a map to show entities around the world that need photographs
on Wikipedia

Wikimedia Maps Rendering Improvements
> Improving road labels and borders on Wikimedia Maps

Wikimaps Warper 2.0
>Refactoring Wikimaps Warper code to make the project more accessible for
volunteer contributions

Alt Text Tools <https://meta.wikimedia.org/wiki/Grants:IEG/Alt_text_tools>
>Tool to make it easier to improve text alternatives for images

Batch Uploader for Small GLAM Projects
>Creating a simple batch uploader for small-to-medium entry level partner

Bot Development for Azerbaijani Wikipedia
>Developing a translation bot for Azerbaijani Wikipedia

Proofreading semiautomatically the Catalan Wikipedia with LanguageTool
>Proofreading the whole Catalan Wikipedia using the LanguageTool with the
help of scripts and appropriate supervision.

Color Blindness Content Checker
>Make Wikipedia chart and diagrams color blind accessible

Pan-Scandinavian Machine-assisted Content Translation
>Creating more machine translation language data for use in Content
Translation, for Swedish, Danish and Norwegian Bokmål+Nynorsk projects.

StrepHit: Wikidata Statements Validation via References
>Creating a process that extracts facts from text and produces Wikidata
statements with reference URLs.

Semi-automatically generate Categories for Vietnamese Wikipedia
>Generating new categories for small-scale & medium-scale Wikipedias where
editors are lacking.

Chris "Jethro" Schilling
I JethroBT (WMF) <https://meta.wikimedia.org/wiki/User:I_JethroBT_(WMF)>
Community Organizer, Wikimedia Foundation
Wikitech-l mailing list

Maps-l mailing list
Maps-l <at> lists.wikimedia.org
T Fish | 18 Sep 03:16 2015

Maps on Wikipedia

Is there a way to get an extension to display the tile server on
wikipedia? It would be useful to be able to display dynamic maps (with
something like a GeoJson) instead of static SVGs. I know the roads
project would find this extremely useful.


Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Yuri Astrakhan | 17 Sep 20:46 2015

Announcing the launch of OSM Maps for Wikipedia

Wikimedia Foundation has implemented a new vector tile service Kartotherian (Mapbox+Mapnik stack) and launched an experimental tile and static maps service available at https://maps.wikimedia.org. Using this service, you can browse and embed map tiles into your own tools using OpenStreetMap data. Currently, we handle traffic from *.wmflabs.org and *.wikivoyage.org (referrer header must be either missing or set to these values) but we hope to open it up to Wikipedia traffic if we see enough use. 

Tiles are served from https://maps.wikimedia.org, but can only be accessed from *.wmflabs.org and *.wikivoyage.org.  Kartotherian can produce tiles as images (png), and as raw vector data (pbf Mapbox format or json):
  https://maps.wikimedia.org/{source}/{zoom}/{x}/{y}[ <at> {scale}x].{format}

Additionally, Kartotherian can produce snapshot (static) images of any location, scaling, and zoom level with
  https://maps.wikimedia.org/img/{source},{zoom},{lat},{lon},{width}x{height}[ <at> {scale}x].{format}
For example, to get an image centred at 42,-3.14, at zoom level 4, size 800x600, use
https://maps.wikimedia.org/img/osm-intl,4,42,-3.14,800x600.png  (copy/paste the link, or else it might not work due to referrer restriction).

Editing map style is very easy using the Mapbox Studio, and does not require any data on your machine - simply point it at Wikimedia server.

How can you help?
* Provide us feedback to help guide future features
* Improve our map styles
* Improve our data extraction
* File bugs in Phabricator
* Adapt your labs tool to use this service - for example, use Leaflet js library and point it to https://maps.wikimedia.org

Based on usage and your feedback, the Discovery team will decide how to proceed. We could add more data sources (both vector and raster), work on additional services such as static maps or geosearch, work on supporting all languages, switch to client-side WebGL rendering, etc. Please help us decide what is most important.

https://www.mediawiki.org/wiki/Maps has more about the project and related Maps work.

We would like to thank WMF Ops (especially Alex Kosiaris, Brandon Black, and Jaime Crespo), services team, OSM community and engineers, and the Mapnik and Mapbox teams. The project would not have completed so fast without you.

Maps-l mailing list
Maps-l <at> lists.wikimedia.org
Sebastian Wallroth | 2 Aug 10:52 2015

WikiDACH 2015 - Wikipedia tut gut

Vom 30. Oktober bis 1. November 2015 findet nun endlich im prächtigen Schweriner Schloss [1] 
die erste WikiDACH [2] statt. Der Landtag von Mecklenburg-Vorpommern gestattet die kostenfreie 
Nutzung damit sich die Welt der Wikipedianer (und aller anderen Wikimedia-Projekte) mit den 
Menschen der Region, sowie ganz Österreichs, der Schweiz und Deutschlands austauschen können. 
Teilnehmer können hier ihr Interesse bekunden [3] und es werden noch Helfer [4] gesucht. Wer 
einen Vortrag oder Workshop [5] anbieten möchte, trägt sich bitte ein. Bitte beschreibt, was 
Ihr anbieten möchtet. Ein griffiger Titel ist dabei sehr wichtig, außerdem natürlich das Format 
und die gewünschte Länge des Slots. Da wir viele Besucher erwarten, die die Wikipedia und ihre 
Schwesterprojekte noch nicht kennen, wäre auch eine Angabe hilfreich, ob sich der Slot für 
Anfänger eignet. 

Das Orga Team der WikiDACH 2015 [6]

[1] https://de.wikipedia.org/wiki/Schweriner_Schloss
[2] https://de.wikipedia.org/wiki/Wikipedia:WikiDACH/2015
[3] https://de.wikipedia.org/wiki/Wikipedia:WikiDACH/2015/Teilnehmer
[4] https://de.wikipedia.org/wiki/Wikipedia:WikiDACH/2015/Call_for_Helps
[5] https://de.wikipedia.org/wiki/Wikipedia:WikiDACH/2015/Call_for_Papers 
[6] https://de.wikipedia.org/wiki/Wikipedia:WikiDACH/2015/Organisatoren


Sebastian Wallroth
Mobil 0176-15154002
PGP Key: https://de.wikipedia.org/wiki/Benutzer:Sebastian_Wallroth/PGP

Maps-l mailing list
Maps-l <at> lists.wikimedia.org
James Heald | 11 Nov 22:32 2014

Help needed to finish finding the maps in the BL Flickr stream. 11, 000 maps found so far in first 50%.

Hi everybody,

A quick update on the campaign to find all the maps (and ground plans) 
in the British Library's one-million-image Flickr stream scanned from 
old 19th century books.

This is of particular relevance to the Wikimaps project, because as soon 
as we've tagged all the maps and plans on Flickr, the BL will start 
georeferencing them with its own loyal volunteers, so that in the new 
year we should be able to upload all the maps to Commons, complete with 
a full set of georeferencing control points.

The good news is that in the first ten days, we've gone through the 
Flickr pages for half the books scanned for the collection, and tagged 
11,000 maps and plans, ready for georeferencing.

See latest status here:

The bad news is that the effort so far has almost all been made by about 
ten people, who are now starting to tire.  So the project desperately 
needs more help, if we're to push on and get all the old maps found.

As the status page above shows and links, a lot of progress has been 
made with many parts of the index; but some other parts -- for example, 
index pages of books relating to the United States, and to Scandinavia 
-- still remain almost untouched.

What's needed is very simple.  As explained on the status page, it's 
just to go through each entry that has a pink "Untagged maps?" templated 
link, tag all the images that are maps, then remove the templated link 
from the list on the wikipage.

This should produce an excellent resource for the Wikimaps project.  But 
first we need to identify the maps, so the British Library can 
georeference them.

So if anyone on this list knows anyone who might be interested to help, 
or if anyone could organise a group to help, please do let them know (or 
even please do help with a bit of tagging yourself).

It would be so good to get all the maps and charts and plans found in 
this collection.  But it's going to need a bit more help.

All best,


Maps-l mailing list
Maps-l <at> lists.wikimedia.org
James Heald | 28 Oct 22:50 2014

Looking for 10, 000 maps in the BL flickr stream, from Friday 31 October. Help needed to get the word out.


This is to let everybody know about a campaign to try to find 10,000 
digitised maps 'hidden' in 13,000 books in the set of a million images 
that the British Library uploaded to Flickr last year.

Once they've been identified, the BL will then run the maps through its 
Georeferencer crowd-activity (from which we can download the full 
output).  But first the files need to be identified on Flickr, and 
tagged as maps.

A draft article for this week's en-wiki Signpost can be found under 
development here:

There's also going to be an all-day tagathon session at the British 
Library in London to launch the effort, to which anyone who can make it 
is very welcome.  (Even more welcome if you register first, but that's 
not absolutely essential), see:


There is coverage of maps from all over the world, as shown by this plot 
of 3,000 maps on the globe, that have already been found and georeferenced:


(Non-map images in the collection have a similar distribution).

The BL Labs group are having their annual symposium meeting on Monday 
3rd November.   It would be fantastic, as a demonstration of the power 
of openness, if the lion's share of the index could have been worked 
through by that afternoon.

Make-or-break for that target is whether people can be encouraged to 
help on the internet.

So I would really appreciate anything anyone can do to help get the word 
out -- eg perhaps with mentions in the equivalents of the Signpost in 
other languages.

I'm afraid everything is in English so far, but perhaps there is still 
time to do something about that.

The project status page is here,

which has links to all the geographical index pages, with their pink 
"Untagged maps" templates.

These page will go live at 11:00 UTC on Friday.  (Edits to them before 
then will probably be over-written -- though tags added on Flickr would 
be okay).

I would be really grateful for any help anyone could give with this over 
the weekend, or encourage others to give.  Even an hour, or half an hour 
to go through a block of 15 books in the index, would make a difference.

So anything anyone could do between now and then to get the word out 
would be very very appreciated.



Maps-l mailing list
Maps-l <at> lists.wikimedia.org