OpenStreetMap

apm-wa's Diary

Recent diary entries

Given the COVID-19 pandemic, even though Turkmenistan has reported no cases, I spent part of this week checking the tags of hospitals and clinics in that country to make sure anyone using OSM data could find the nearest hospital or clinic, if it is in the OSM database. Overpass Turbo came in very handy for this exercise.

After completing that task, I started tinkering with Overpass Turbo and pulled up the hotels in Turkmenistan. In Mary I discovered four different locations had been entered in the OSM database for the Soviet-era Sanjar Hotel. Only one could be correct. Fortunately I found a ground-level photo of both the hotel and its associated cafe among the Mapillary images I had collected in years past, and so was able to identify the correct buildings for hotel and cafe, and delete incorrect tags from the others (one of them is the Mary province tax office–hardly a good place to spend the night).

Location: Mary City, Mary Region, Turkmenistan

Summary Report on OSMF Chair's Outreach Jan-early Apr 2020

Posted by apm-wa on 18 April 2020 in English. Last updated on 19 April 2020.

Background

Shortly after the new year began, the OSM Foundation chair started contacting members of the OSM community writ large to collect information on the state of the community and project, and to assess attitudes toward the Board’s work. Most conversations were confidential in order to ensure that respondents would speak openly, frankly, and honestly (and it is the chair’s sense that virtually all of them did, and in fact some of them were quite brutally frank about the Board’s perceived shortcomings). Thus, this report will not detail “who said what”. It will, rather, tend more to aggregate viewpoints expressed during the conversations, with illustrative but unattributed quotes.

The chair began by polling members of the Board of Directors of the Foundation, and expanded to members of the Advisory Board, including both corporate members and local chapters. The latter tended to be conference calls with multiple members of those chapters. These calls generated recommendations that the chair talk to pillars of the OSM community or representative members of a tribe (e.g., software developers), so the chair reached out to those individuals as well. Another result was outreach to local communities not formally affiliated with the OSMF, and those conversations proved to be among the most fruitful. The chair held one conversation with a local community and two with corporate representatives face to face due to the happy coincidences of parties being in the same geographic location.

This effort is not over. If anything, the conversations revealed a desire for better communication between the Board and the community’s various tribes (including working groups), which can only be satiated by making the effort to reach out, to schedule calls, then just to call. Geographic coverage of the current outreach effort remains a work in progress; to date the chair has made no calls to Latin America, for example.

The Top Lines

Most conversations started with two open-ended questions: “What should the Foundation Board be focused on?” and “What do I as a Board member need to know to make OSM a continued success?” The chair sought not to direct responses in any direction, but to allow respondents to address whatever they saw as the highest priorities. That said, the chair did solicit reactions to the OSMF Board’s then-recent release of a diversity statement and formation of the Diversity and Inclusion Special Committee, which undoubtedly gave an upward bias to the number of times that subject came up. The bulk of the responses fell into a finite number of categories.

Issue 1: Stability and maintenance of the core infrastructure (hardware, software, human capital)

Out of the 40+ conversations, some variation on this general theme came to the forefront 23 times, more than any other topic. The cognoscenti widely recognise that demand for OSM’s services (tiles, geocoding, and geodata) has outstripped the current configuration of hardware and software, and is straining the volunteer labor force, particularly the sysadmins. They also widely recognise that the Operations Working Group has collapsed, which they see as symptomatic of the increased demands placed on the hitherto “100% volunteer do-ocracy”.

Though not universally held, the view that OSMF should begin to hire staff to augment the volunteer labor (particularly sysadmins and a software developer to maintain the API) is widespread. Notably, individuals responsible for maintaining OSM infrastructure specifically expressed that sentiment.

Several respondents called for the Board to act on the slow tile service, though proposed solutions ranged from “OSMF should invest in enough tile servers to meet demand” to “OSMF should restrict tile use to OSM only and let commercial providers do the rest.”

A few people advocated movement to the cloud. Lack of redundancy of some critical services was a concern to people familiar with OSM’s hardware setup.

Multiple old-timers made comments to the effect that “nobody envisioned OSM’s success,” or as one of them put it, “OSM shouldn’t have worked, but somehow it did, with lots of time, effort, emotion, and pride.” One respondent commented that OSM serves up maps to two billion users per day, yet has only two sysadmins to maintain and service the hardware. Several remarked that OSM has outgrown the model of “do-ocracy” that got it this far and opined that it needs a new management model. One respondent highlighted the “disconnect between casual mapping and the size of the project” as it is today, and noted that having grown from a “smaller project, and not especially geographically diverse” OSM today requires greater commitment. Another said, “More structure and more governance is [sic] required just because it’s used more extensively.” Put another way, a respondent said, “Growth and success have led it past the type of individuals who started it.”

Countering that, one respondent commented, “The Catch-22 of OSM is that actual mappers want a smaller OSMF” and don’t want dependence on “outside money.” One respondent perhaps captured this dilemma best: “Super organization isn’t necessary, but anarchy is not an answer, either.”

(Second place tie) Outreach to Local Chapters and Communities

Local chapter/community outreach tied for the second-most frequent issue raised in the calls, with 12 mentions (though only 9 local chapters/communities were contacted). These respondents commented on the desirability of better communication between the Board and local communities.

(Second place tie) Vector tiles

Surprisingly, a desire for vector tiles came up 12 times in conversations, tying for second place with community outreach. Some respondents merely see in vector tiles a sign of progress, that OSM is keeping up with Google; others see in them a solution to desires (multilingual standard maps, for example). While the tech wizards asserted that OSMF hardware is adequate to host vector tiles, at least initially, surprisingly not one respondent could quote a solid cost estimate for shifting from raster to vector tiles, nor could any respondent chart in shorthand a course of action needed to carry out such a shift. Time estimates ranged from “a couple of weekends” to “six to eight weeks”. One major issue appears to be who would control the style sheets that determine which vector maps are displayed, and some users in the commercial sphere expressed concerns that OSMF-sponsored vector tiles would compete with their paid services. In short, though there is a strong indication that vector tiles are desirable, there is lack of consensus either as to how much would be too much or how much it would cost.

One respondent noted that there is nothing to stop local chapters or others from hosting vector tiles if they wanted to, and suggested encouraging local communities and chapters to experiment with vector tiles before the OSMF settles on a solution, should it decide to do so.

(Fourth place tie) Frustration with Board inaction

Out of over 40 conversations, “Board inaction” tied for fourth place (with diversity/inclusion, at 10 responses) among the most-mentioned issues the communities wanted the Board to deal with. Respondents widely view the Board as having failed to take responsibility for issues that have arisen. One respondent asserted that the Board has taken exactly one significant decision since 2010, the change of license to ODbL.

One consequence of this is that third parties unaccountable to the community at large have filled some vacuums. The Board’s conscious decision to take a hands-off approach to development of the iD editor, in particular, is a flashpoint in this regard. While some welcomed development of a user-friendly, intuitive editor, even if by a third party not under community influence, iD’s tagging presets have raised concerns about perceived lack of community input into development decisions. As one respondent put it, “Key technologies should be OSMF’s responsibility.”

Another respondent viewed this abdication of responsibility as a prelude to long-term death of the OSM community, as it paves the way for a backdoor corporate takeover of OSM. Another respondent said bluntly that Board weakness “creates a power dynamic with outsiders who can pay workers–and then control it.” One respondent noted, “There is room for the Board to be more assertive because of the threats out there–the need to meet threats and challenges. Volunteers cannot do it themselves.”

Were the Board to begin making substantive decisions, in the opinion of some respondents another weakness would quickly become apparent. As one put it, the Board “has no real ability to put contracts in place” to implement decisions. The Board, this person said, “must either build capacity” or “let outsiders do it.”

Another issue is the Board’s failure to enforce its policies, such as tile use policy, which has led directly to a massive overload of OSM’s tile servers (which according to the Operations Working Group at peak loads respond to nearly 400,000 tile calls per second). Respondents raised protection of the trademark a few times, and thought that previous boards had neglected it. Additional issues include failure to pursue community development, a bias in favor of European points of view, and failure to demand attribution for use of OSM data.

However, two prominent community members asserted that Board inaction is “the OSM way” and indicated a desire to continue to see the OSMF Board as a mere figurehead, existing solely to fulfill requirements of the Companies Act 2006 and nothing more. As one put it, “The Board is to do the minimum necessary to keep OSM running.” Another expressed fear that a future Board could “go in a bad direction” and thus the precedent of the Board’s making decisions “could bode ill.” The community will need to reconcile this divergence in attitudes one way or the other.

(Fourth place tie) Diversity/Inclusion

This tied for fourth place with “Board inaction” (again, with probable upward bias in response rate since the chair solicited feedback on relevant Board actions). Communities outside western Europe generally welcomed the Board’s recent adoption of a diversity statement and formation of the Diversity and Inclusion Special Committee (with the caveat that members of one local community had not read the statement and so could not comment on it). One community went so far as to say it was long overdue, but still is not enough because local communities avoid speaking up out of fear of very vocal and hostile community members in other geographic areas shouting them down. One respondent said bluntly that the Diversity and Inclusion Special Committee “needs a space for discussions without being attacked” and cited “a tendency to intimidate” on the part of other community members. In that regard, multiple respondents called for a Code of Conduct of some sort to moderate dialogues and reduce the fear of hostile responses.

Respondents in Africa and Asia underscored the cost of volunteering, noting that in lower-income countries the cost of Internet access and need to work more than one job to support a family constrains time devoted to volunteer mapping. This is an obstacle to geographic diversity.

Respondents see the fee waiver program for Foundation membership positively in theory, but in many minds, its impact remains to be seen. Data users were surprisingly supportive of diversity because they see it as a source of data quality. As one respondent put it, “mapping is somewhat subjective” so diverse mappers generate more diverse (i.e., complete) data than does a “white male dominated” mapping community.

Many respondents complained of special interests’ “steering” or “dominating” issues to the detriment of the broader interests of the OSM community. As one of them put it, “If you let the loudmouths direct strategy, nothing will happen.” Another put it slightly differently, “Use of the project is imperiled by a few loud voices.”

One respondent in Europe criticized the Board for focusing on “political correctness” by publishing the diversity policy and forming the special committee.

(Sixth place) Artificial intelligence/machine learning

The sixth-most raised issues revolved around artificial intelligence and machine learning, with those in favor of incorporating them under human approval processes represented in Asia, Africa, and among the corporate members sponsoring these technologies. Opposition to artificial intelligence and machine learning seems to be concentrated in western Europe, where it is viewed as of little utility. Support is found in geographic locales facing daunting obstacles: high internet costs, low internet penetration, and low volunteerism, the latter two often rooted in economic circumstances. As one respondent put it bluntly, “[our country] is vast, and we don’t have enough volunteers to map all the roads and waterways by hand.” Mappers in such circumstances appear to welcome AI tools as a way of increasing craft mapper productivity.

Interestingly, the corporate members underscored continued importance of local knowledge, for as one put it, “AI can draw a road, but only a local mapper can name it” (and we might add, certify that it is a road and not something else.) Another non-corporate respondent noted, “A growing proportion of data cannot be collected by armchair mapping, we need on-the-ground knowledge.” Corporate users, who professed keen interest in improved data quality, highlighted the role of AI in rapidly detecting vandalism so that the Data Working Group and local mappers can react quickly.

While application of AI and machine learning is not a Board issue, strictly speaking, but rather one squarely in the laps of the local communities each to decide within the framework of organized mapping guidelines, its importance to certain local communities was striking.

Due to the corona virus pandemic the annual face-to-face meeting of the OSMF board of directors shifted to what we wryly termed a “screen-to-screen” meeting using the Zoom video conferencing account of our facilitator, Allen “Gunner” Gunn. To our collective surprise, the video conference went fairly well. It was not as good as meeting face to face, but was far better than audio only, and so much so that the board plans to experiment with shifting from using Mumble (audio only) for monthly board meetings to a video conferencing platform.

In keeping with the FOSS philosophy of OSMF, we will try BigBlueButton, an open-source videoconferencing platform. Thus, if OSMF members want to tune in to the next board meeting, watch for announcements that we will meet in a video conference. We will ask that non-members of the board keep their cameras and microphones off, and that only board members have their cameras and microphones on.

Minutes of the “screen-to-screen” meeting remain in process. Bottom line up front: the board has taken on board much of the information in the SWOT analysis, last year’s survey, and the 40+ conference calls I have made to community members, local communities and chapters, and members of our advisory board. We accept all criticism that has come our way and are working on how to address the problems you have identified to us.

In March I flew to Riga for what will likely be the last in-person regional SOTM for a while due to the pandemic, State of the Map Baltics (many thanks and kudos to Rihards Olups for pulling it together and being my host in Riga). My presentation on “Winds of Change in OSM” was well received. I plan to deliver an updated version of that presentation during the virtual SOTM in July, so if you are interested in a synopsis of what I have been hearing from across the community, and my take on it all, be sure to tune in.

I have also been armchair mapping. One outcome of the pandemic has been evacuation of tourists, business people, and guest workers from affected countries to their homelands. These evacuations are typically organized by embassies and consulates. As a former diplomat and ambassador, and the instigator of the Tag:office=diplomatic tagging scheme, I have begun upgrading diplomatic POIs in my old stomping grounds, the former Soviet Union, so that people can not only find their homelands’ embassies and consulates, but find contact information for them in the various offline smartphone apps like MAPS.ME. So far Turkmenistan, Azerbaijan, and Georgia are done (though I posted a few fixme tags for problems I cannot solve from afar, and which need local mappers to solve). So I am not only keeping busy chairing the board of directors of the OSM Foundation, I am mapping, too.

OpenStreetMap and Coronavirus Tracking

Posted by apm-wa on 4 March 2020 in English.

Johns Hopkins University in collaboration with ESRI and others has posted a coronavirus tracking dashboard here that includes an interactive map. The base map comes from a mix of sources including OpenStreetMap. If you click on the icon consisting of four squares in the upper right corner of the map, you get a list of basemap sources, and If you zoom in to a particular country, the source of the geodata automatically appears in the lower right corner of the map along with the other virus-related data sources. It is nice to know that OSM is helping in the effort to contain and reduce the impact of coronavirus.

Last week I visited Baku for only the second time, and managed to see the new seaport at Alat. The Mapillary images I collected are now on line so perhaps I can update the map at some point.

Mapping these days is taking a back seat to OSM Foundation business, unfortunately. Chairing the OSM Foundation board has turned into at least a half-time job. In the last two months I have held 32 conference calls with various OSM stakeholders: mappers, users of data, corporate members of the Foundation, old-timers, software developers, and local communities in ranging from Ireland to Japan and the Philippines. That effort will continue as I reach out to members of the OSM community and hear what advice they have, what they perceive as OSM’s needs, and their thoughts on what the board should be doing to support OSM. I am boiling down everything and will present some preliminary assessments–my personal take on what it all means, not the board’s–at SOTM Baltics on March 6.

Location: Baku Ferry Sea Port \ Alat, Karadag Raion, Baku City, Baku Ekonomic Zone, Azerbaijan

The Power of Research

Posted by apm-wa on 13 January 2020 in English.

Since returning to the United States from Turkmenistan last June, I have been plowing through the mass of information collected, but which I did not have time to study thoroughly. Yesterday, while (Turkmen-English dictionary in hand) I was deciphering Parliamentary Resolution No. 111-IV of 10 May 2010, I found reference to one of the six towns (‘‘şäherçeler’’ in Turkmen) not yet on the OSM map. That resolution ‘‘inter alia’’ renamed the village around the Danew rail station to Bahar (which means “spring” in Turkmen) and upgraded it to town status. Fortunately user jaimemd had mapped that rail station and its surrounding village five years earlier, so I was able to retag Bahar.

One town down, five more to go. The detective work continues. When done, all current “towns” in Turkmenistan will be on the map, along with all “cities” as defined under Turkmen law.

Location: 39.267, 63.153

A Mystery Solved

Posted by apm-wa on 8 January 2020 in English.

As I mapped Turkmenistan a couple of years ago, I noted that two locations were marked as the town of Darganata. Only one could be correct, and in my explorations I determined which one was Darganata, then pursued the correct name of the other, which turned out to be a village named Çarwadar. I made the correction, but filed away a question in the back of my mind: why would a mapper insert such an obvious error in OSM?

The answer came to light yesterday as I examined a Soviet military map of the area. In Soviet times, Çarwadar was a state farm named Sovkhoz Dargan-Ata, or in Russian совхоз “Дарган-Ата”(the contraction “sovkhoz” means “state farm”). Not a town, not even a village in Soviet terms, but a state farm community named in honor of its big brother a few kilometers away. Mystery solved! Today Çarwadar is a full fledged village, not just a farm community, and enjoys its own name, which means “herdsman”. The old state farm focused on sheep raising, and presumably the residents of Çarwadar still do.

Location: Charvadar, Darganata District, Lebap Region, Turkmenistan

Another Turkmen Highway Identified

Posted by apm-wa on 1 January 2020 in English.

I’ve been scanning Soviet military maps for information relevant to the OSM map of Turkmenistan, coupled with data collected between 2015 and 2019, and among other things have identified yet another numbered highway, the P-28. It connects the A-388 highway south of Yoloten to Tagtabazar and a few villages to the east and southeast, all the way to the Afghanistan border. Bit by bit, the OSM map of Turkmenistan is becoming ever richer.

At some point I intend to do a fulsome correction of Turkmenistan’s borders. The existing ones were largely drawn from CIA maps to get something in place but are not as accurate as the lines on the Soviet military maps. Bear with me, this will be a time-consuming project! But as winter sets in, when it is cold outside and the rain is coming down, doing this will be more attractive than chopping firewood or pruning dead limbs, and I will get to it.

Location: 35.952, 62.878

The following is copied from the Indiana University website:

“The bulk of Indiana University’s Russian Military Topographic Map Collection is made up of the Soviet Red Army topographic maps, which were produced for defense and economic planning. This collection came to Indiana University from the duplicate map room of the Library of Congress Map Collection in the early 1990s. These maps cover not only parts of Russia and Eastern Europe, but extend as far north as Scandinavia, as far west as Germany and the Netherlands, and as far south as Iran.

“An interactive index map of the collection is located here: https://iu.maps.arcgis.com/apps/webappviewer/index.html?id=098c42997ca441029b69f0597ff92ea6

“For more information, visit the Cyrillic Maps Collection.”

There are very few maps of Central Asia, but coverage of Russia, Belarus, Ukraine, the Baltics, Poland, and eastern Germany is pretty good. The maps of former Soviet states are uncopyrighted, but odds are good that coverage outside the USSR was taken in violation of local copyrights and so may not be used in OSM.

Armchair Mapping Turkmenistan

Posted by apm-wa on 22 December 2019 in English.

Now that I have been away from Turkmenistan for six months, my efforts at continuing to map that country are by necessity confined to “armchair mapping”, using a combination of Soviet-era military maps that identify municipalities (albeit by Soviet-era names, which often differ from current names), the “Districts in Turkmenistan” list of names of municipalities I posted some time back to the OSM wiki, and the various official name-change documents I also posted to the wiki. It is different from primary data collection on the ground, which I must confess I miss.

Some of the local mappers I trained are continuing to collect and post data, however, so there is some work going on based on local knowledge, and that is a good thing.

A 1916 "New Introductory Geography"

Posted by apm-wa on 16 December 2019 in English. Last updated on 17 December 2019.

During a recent visit to the American Midwest, Ann and I browsed an antique shop where I found a copy of Tarr & McMurry’s 1916 edition of “New Introductory Geography”, a textbook, for five dollars. Since it is long out of copyright I have begun scanning some of the lovely color plates and have posted two of Africa to Wikipedia.

1916 physical map of Africa

1916 political map of Africa

NACIS 2019 Banquet Speech

Posted by apm-wa on 27 November 2019 in English.

My banquet speech at the North American Cartographic Information Society’s annual conference last month was not videographed, but a couple of members asked for recordings, so I used Power Point’s voice recording feature to run through the slides while reading the narrative into a microphone. I then converted the Power Point into an mp4 file using Office 365. The result is not perfect but if you are interested in learning how the mapping exercise in Turkmenistan improved quality of life, you can find the video on YouTube here.

Location: 47.250, -122.440

New Dedicated Smartphone, $42.39, Back to Mapillary

Posted by apm-wa on 26 November 2019 in English. Last updated on 4 December 2019.

Today I was in Best Buy looking for something else and saw it was selling the LG Phoenix 4 with 16Gb RAM and Android 7 for $39.99 plus tax (prepaid AT&T but I don’t intend to use airtime). I splurged on it, brought it home, connected to home wifi, installed Mapillary, and on my next road trip will try it as a new dedicated imagery collection device. I cannot really justify spending hundreds of dollars on a GoPro or other pricey dedicated device; my cartography habit has to be kept relatively low cost (I say that having bought a new PC a few years back, the specs of which were calibrated to creating wall maps using Maperitive…)

I also began my first “armchair mapping” of Turkmenistan, working on some imagery collected earlier to update the map, and correcting some errors inserted by novice mappers. I have not yet started a serious examination of the Soviet military maps but that will come.