Why Book Corners won't sync contributions back to OpenStreetMap
Posted by pizzaiolo 12 hours ago
Comments
Comment by jasonkester 5 hours ago
There needs to be a Single Point of Truth, and it should not be your little website.
BigCentralThing should be the official database that knows about where all the Whatevers are. Your little Whatever Locator site should only ever _pull_ from them. Need a new Whatever in the database? Get BigCentralThing to add it, then pull it in.
As an example, I run https://bettybeta.com/, a select guide to bouldering in Fontainebleau tailored for Women and short folk. We have a list of boulder problems in our database, but no way for anybody (even an admin) to add a new one. Every boulder problem record includes a link to its page at https://bleau.info/, who are dedicated to cataloging every climb in the forest.
Bleau.info is the Single Point of Truth. If one of our users does a First Ascent and wants to log it with us, we'll point them at that other site with instructions on how to get their climb in there, and tell them how to get us to import it. Any other path would lead to our database and the "official" database eventually diverging.
There are half a dozen other websites doing similar things to us. Some do what we do, but the ones that don't quickly find themselves out of sync and end up with a lot more work on their hands.
It's tough because, as the author says, writing the flow to import at our end is really easy (I've written it, before coming to this realization and hiding it again). But doing it is a trap.
Comment by Moghammed 4 hours ago
I run valideparkeren.nl, a crowd sourced overview of all accessible parking spots in the Netherlands. Ideally, there should be a government-owned single source of truth, but the whole reason for starting this is because that source doesn't exist yet. I'm starting to work with the government to eventually hand this project over to them, which was the goal from the start, but the only way to make that happen is by first becoming the source of truth.
Edit: I was also planning to add my data to OSM at some point, but I'm reconsidering that after reading this. I completely understand that they only want high quality data, but in my case I'm convinced that high coverage and slightly lower quality is better than low coverage and high quality. Of course, transparency of how sure we are about the data is vital, so users can decide the risk they want to take.
Comment by jasonkester 3 hours ago
Being The List of anything is a big, thankless job filled with nonstop toil to keep it up to date. It's not something you want to do unless it's truly your passion or somebody is paying you (a lot) to do it.
The problem is that building to tools to Be The List is pretty straightforward and fun. You only learn about the toil you've signed yourself up after the fact, once people start relying on it.
Good luck!
Comment by xtiansimon 35 minutes ago
Does the submitter add to spot and then shoot you a message to pull by some unique id (author, submitter)? If you’re curating from their database, then spot doesn’t have the schema features to resolve to your subset by filtering alone, right?
Comment by inigyou 1 hour ago
Comment by Aurornis 12 hours ago
A project like OSM would be bombarded with spam and junk submissions if it didn’t have these barriers to submission. Understandable.
Comment by WhyNotHugo 10 hours ago
If their apps instead submitted directly to OSM (letting submission trickle back down), then the flow would fit into "user submission". Book Corners simply becomes an app though which the user performed the submission, rather than an intermediary exporting data.
Comment by SOLAR_FIELDS 32 minutes ago
> Contact the relevant local communities affected by the contributions
Do I literally have to do new local community outreach every little town one of my bookcases shows up in? Ridiculous if so
Comment by Doctor_Fegg 31 minutes ago
Comment by SOLAR_FIELDS 5 minutes ago
Comment by Dylan16807 2 hours ago
Comment by maxerickson 10 hours ago
(an import is when there isn't complete review...)
Comment by greyb 10 hours ago
I'm not sure about this. The barriers to submissions are honestly more likely to cause object and amenity level data to become out of date. Google is able to have such an up to date place database because it relies on a large quantity of crowdsourced submissions, and employs consensus to figure out the truth.
Comment by Doctor_Fegg 6 hours ago
OSM doesn’t have that option. If it didn’t have these guardrails in place, a million CS students will see some open-looking data (or not even that, maybe something scraped) and throw it into OSM with a cursory Python script, resulting in an almighty mess. We need the process because we don’t have Google’s leverage of “we pay you”.
Comment by darren_ 2 hours ago
and people say hacker news has no sense of humour
Comment by londons_explore 3 hours ago
Eg. Draw me a map, but include only data points tagged with 'osm-license-verified-and-spam-filtered'.
That way users of the data get to decide their own tradeoff between legal risks, data freshness, spam, etc.
Comment by zimpenfish 3 hours ago
Google denied our address existed[0] for years (which caused several problems with online shops that used Google Maps as the source of truth for address resolution) - took a good few tries to get them to actually add it.
Currently Google Maps is showing an "ALDI charging station" directly across the road when it is, in fact, about a mile down the road.
It's also showing a Chipotle just around the corner when, you'll not be surprised, there is no Chipotle there and, hilariously, the photo it has is of the Chipotle at the O2 Dome a good 10km away.
Absolute clusterfuck of nonsense is Google Maps.
[0] A 1960s London estate which was adequately represented on Google Maps and Streetview, mind.
Comment by michaelt 2 hours ago
I work in a warehouse, and if you type our address into Google Maps, it puts the maker right on our building. But they also label the building as a pub, two buildings down the street.
I've submitted corrections, and had a reply saying they were accepted. You can look on street view and the true location of both pub and warehouse are clearly visible, so there'd be no problem verifying my correction. Their map view includes the outline of the pub, as does their satellite view. The pub's been there 10 years, the warehouse since the 1990s. The Street View car has driven through the pub's car park three times.
And yet, the pub marker stays in the wrong place.
Comment by SchemaLoad 8 hours ago
As it is today you can largely expect OSM POI data to be incomplete or out of date unless you have someone particularly keen on keeping your local area up to date. OSM is best used as a background map layer for your own custom applications, like embedded maps in apps showing your own data overlayed. Rather than an alternative to the google maps app.
Comment by rixed 6 hours ago
Comment by ryukoposting 11 hours ago
These restrictions are unique to projects doing automated submissions of mass data.
If you're an individual just trying to make the world a better place, you can make an OSM account, go to the website, click, add a thing, hit submit, done. Someone will review it.
Apps like CoMaps and Organic Maps make it super easy to contribute data for businesses, landmarks, and such.
Comment by zx8080 11 hours ago
I will share an unpopular opinion: thil will only make a freeworkforce for those projects who profit from using OSM. And the OSM has surprisingly unreliable data quality for walking around even in the popular tourist places like Tokyo or Kyoto, or New York. I've tried, and it's so worse than GMaps (or Bing) to being completely unusable. No work hours of Starbucks, no local dining cafe, no menu contributions.
It's great for the trail and hike outdiors, sure. But that's very different from the city map, as the nature featutes rarely change, not like city POIs.
Comment by mikeocool 10 hours ago
I don’t think you’ll find even most the die hard OSM fan disagree with you on the POI data.
On the other hand, the road network in OSM is very high quality. As you point out, it’s used and contributed to by companies like Lyft and Amazon.
The fact that anyone can download an accurate detailed global road network for free is pretty crazy.
Comment by nemomarx 10 hours ago
I would assume that tourist places don't have many locals going by and updating them and tourists don't want to fill in info on that kind of app, but that's mostly an adoption question. If more people contributed more info would be mapped.
Comment by ygra 7 hours ago
Comment by MikeNotThePope 11 hours ago
Comment by boredatoms 11 hours ago
This moves the goal posts of OSM
Comment by kelnos 4 minutes ago
Comment by emj 1 hour ago
Comment by ygra 8 hours ago
- opening_hours=*
- amenity=cafe
- website:menu=*
But they can easily become outdated again. Still, local QA via StreetComplete, MapComplete, EveryDoor and a multitude of other apps is always needed.Comment by andreagrandi 5 hours ago
It's available from every users dashboard (it's a ~2 MB compressed GeoJSON file). It includes both libraries orignally imported from OSM and additional libraries added by users.
While I still think the whole OSM process to submit back is a bit too much for the time I have available (but I still understand and respect), at least I want to give users an additional option to retrieve the data (in addition to the public API).
If you have any other advices, I will be glad to hear them and, compatibly with my spare time, I will try to implement them (if they make sense and are useful for users) :)
Thanks
Comment by zaik 1 hour ago
Comment by andreagrandi 4 minutes ago
Comment by michaelt 1 hour ago
Comment by zaik 1 hour ago
https://wiki.openstreetmap.org/wiki/Key:image
The only difficulty is data than can not be easily represented in key=value pairs, such as timetables for buses. But even this can be resolved by adding external references.
Comment by phoronixrly 1 hour ago
Comment by Rygian 5 hours ago
> There are also important licensing questions. A user’s permission to send a library to OSM is not automatically the same as having a sufficiently clear right to release that factual information under terms compatible with OSM
which would imply that you could not make available your database available for download under ODbL. Yet you have made it available under that license.
Maybe that part of the article needs further editing?
Also, if the data of your tool is now available under ODbL, then the tasks related to importing it into OSM can be effectively performed by anyone, not necessarily you.
Comment by andreagrandi 5 hours ago
Yes, I should edit it. I had not though about the bulk download until another user on Mastodon suggested it to me.
> Also, if the data of your tool is now available under ODbL, then the tasks related to importing it into OSM can be effectively performed by anyone, not necessarily you.
Definitely. I would be more than glad if libraries which are not on OSM were added back, I just don't have the required spare time to go through all the process and also maintain it.
Comment by florkbork 9 hours ago
Or set up a maproulette challenge with much the same detail.
Or just a geojson dump under an ODBL licence and share with with relevant communities. The third one or something very like it is required if you have mixed ODBL with non ODBL content.
Comment by raphinou 1 hour ago
Comment by childofhedgehog 10 hours ago
Comment by argee 9 hours ago
Comment by arjie 11 hours ago
I suppose if you want something badly enough you have to do it yourself, but it's not that the thing doesn't exist though it doesn't seem to. It's that I want others to want it too :)
Comment by altairprime 10 hours ago
Comment by DoctorOetker 11 hours ago
It could use GPS for rough geolocation, and 3D models of all the scenery could be generated. New contribution traces would contain changes compared to the past. Volunteers could request new paths it would like to see explored, and OSM could propose paths that cut through or ride along segments of recently submitted recordings of other users, to check if those changes are real, without checking the whole suspected recording.
Separate ground truth recording from its interpretation into mappable concepts, going out to make a recording or observation is a different task from deciding how to canonicalize the content.
Comment by nullisland00 10 hours ago
Comment by PetitPrince 5 hours ago
I vaguely remember a blog post about doing photogrammetry out of their images, but I'm not entirely sure about it.
Comment by DoctorOetker 4 hours ago
Comment by Rygian 2 hours ago
They're already covering the blurring, as well as detecting useful objects in imagery (traffic signs for a start).
Comment by nemomarx 10 hours ago
Comment by mips_avatar 11 hours ago
Comment by gopher_space 10 hours ago
This sort of feels like a generational thing but I would have flown over.
Comment by mips_avatar 6 hours ago
Comment by vladms 5 hours ago
Which is probably what might happen if you would have the option to "report them to osm". Someone should check things, because maybe you are a new person to them, maybe the spam filter might not be as robust as you might think, etc. Even if you are perfect, other submission might not be, so someone needs to check/review/etc.
Comment by phoronixrly 11 hours ago
Comment by Brian_K_White 8 hours ago
I'd rather no data than bad data. There is no seperate baby & bath water. If a bulk source of data contains an unknown mix of good and bad data, that is all one big single item of bad data that is of no use to anyone.
Comment by mips_avatar 7 hours ago
Comment by stmw 8 hours ago
Comment by sampton 11 hours ago
Comment by Maxious 11 hours ago
> Example of a valid and useful note can be "a new road was constructed here" or "this shop is closed and does not exist anymore".
Comment by progbits 6 hours ago
Comment by farfatched 11 hours ago
Perhaps it's not that OSM that needs a signal, but perhaps it's that there's an opportunity for an open map that has many signals, of which OSM and Book Corners are examples.
Comment by Gigachad 10 hours ago
Comment by moring 6 hours ago
Comment by dartharva 9 hours ago
Comment by aaron695 9 hours ago
Comment by Tiberium 12 hours ago
Comment by jburbank 11 hours ago
Is it possible that we (myself included) have become conditioned to think content is llm generated as the default opinion?
Comment by asdf88990 11 hours ago
Comment by Tiberium 10 hours ago
> The workflow I had in mind was deliberately cautious
> The code was not the difficult part.
> These requirements are not a one-time form to complete and forget. They create an ongoing responsibility around the account, the documented process, community feedback, failures, and potential reversions.
Just a few examples. And yes, Pangram 4 also flags it as 100% LLM written. I don't mind being downvoted or flagged, but I think more people should be aware of the LLM style, even if they're ok with it being used without any disclaimer. It's honestly sad that nowadays people on HN cannot recognize this style.
Comment by phoronixrly 11 hours ago
Comment by Demiurge 12 hours ago
Comment by mxfh 11 hours ago
Why would you want to have more people from anywhere else possibly raid them for anything useful? This way nobody is inclined to put anything worthwhile in there if it just ends up outside of their communities. Not that I'm in general pessimistic, just would like to know what is gained by putting the exact location into a map and not just have a list of neigborhoods with a book corner and optional photo on that neigborhood level, if people want to network around them.
Comment by Gigachad 10 hours ago
Comment by neilv 10 hours ago
I sometimes edit OSM, so I'm wondering whether any public bookshelf omissions are intentional, and adding the shelves would be unwelcome by the people running them.
Comment by vladms 5 hours ago
I would not include the wishes of the people into it, because there are various groups that might have strange ideas (dunno, like only churches of some type should be shown; or no shops of a certain kind because it hurts my feelings, etc.).
I personally would not like any edits that advances the wishes of "any" group of people (like removing features). I do not like all things that exists on maps, but I will not remove them because of my feelings.
Comment by ikr678 9 hours ago