Concordia: News and Views

Grab the whole thing here: http://atlantides.org/batlas/2008-09-04/baids-2008-09-04.tgz

Let me know what problems you find.

README file for Barrington Atlas Identifiers, version published 2008-09-04
This is the first complete release.
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 100, 101, 102
List of all maps presently covered: 1-102 (complete)

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-09-03
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 1, 1a, 2, 3, 4, 5, 6, 64
List of all maps presently covered: 1-99

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• No changes to previously released IDs.
• Note that map 64 was erroneously listed as included in previous releases, but was not present. This difficiency is corrected with this release.

I'm going on a trip next month to help my wife with her meetings at Neobiota, scout for next year's sabbatical, and workshop with the Concordia principals. I'd enjoy meeting up with open source GIS, archaeology, or classics programmers along my route:

• 24-25 September: Prague, CZ
• 27-29 September: Colmar, FR
• 01-08 October: Arles and Montpellier, FR
• 12-15 October: London, UK

In other words: Praha, Argentorate, Argentovaria, Lugdunum, Arelate, and Londinium, with a side trip to Aquae Sulis. Looks like I could even bump into Andrew Turner.

README file for Barrington Atlas Identifiers, version published 2008-08-28
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99
List of all maps presently covered: 7-99

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-20
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 28, 29, 30, 31, 32, 33, 34, 67, 68, 69, 70, 71, 81, 82, 83
List of all maps presently covered: 7-88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-19
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 7, 8, 9, 26, 27
List of all maps presently covered: 7-27, 35-66, 72-80, 84-88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-15
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 19, 41, 42, 43, 44, 45, 46, 47, 48
List of all maps presently covered: 10-25, 35-66, 72-80, 84-88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-08
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 14, 15, 16, 17, 18, 24, 25, 39, 40
List of all maps presently covered: 10-18, 20-25, 35-40, 49-65, 72-80, 84-88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-05
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 10, 11, 12, 13, 20, 21, 49
List of all maps presently covered: 10, 11, 12, 13, 20, 21, 22, 23, 35, 36, 37, 38, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 65, 72, 73, 74, 75, 76, 77, 78, 79, 80, 84, 85, 86, 87, 87 inset, 88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* No changes to previously released IDs.

README file for Barrington Atlas Identifiers, version published 2008-08-04
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 23, 84, 85, 87, 87 inset, 88
List of all maps presently covered: 22, 23, 35, 36, 37, 38, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 65, 72, 73, 74, 75, 76, 77, 78, 79, 80, 84, 85, 86, 87, 87 inset, 88

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

• All readme files, dated folders and compressed tar files have been modified and renamed as necessary to redress the erroneous substitution of 2007 for 2008. No changes to IDs have occurred.

README file for Barrington Atlas Identifiers, version published 2007-07-26
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 62, 63, 66, 72, 86
List of all maps presently covered: 22, 35, 36, 37, 38, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 65, 72, 73, 74, 75, 76, 77, 78, 79, 80, 86

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* No changes to previously issued files in this release

README file for Barrington Atlas Identifiers, version published 2007-07-22
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered in this release: 50, 51, 52, 53, 54, 56, 57, 58, 59, 60
List of all maps presently covered: 22, 35, 36, 37, 38, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 65, 73, 74, 75, 76, 77, 78, 79, 80

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* Still suppressing ID creation for roads; have also added suppression for "coastal change" (so far only seen in Map 53)
* No changes to previously issued files in this release

README file for Barrington Atlas Identifiers, version published 2007-07-21
Reference URL: http://atlantides.org/batlas

Background: http://horothesia.blogspot.com/search/label/batlasids
New maps covered: 35, 36, 74, 75, 76, 77, 78, 79, 80

Major classes of change from prior versions are listed below. Consult individual files named like map22-diff.txt for output files differencing from prior version to this version.

* No changes from prior versions beyond the addition of data for new maps.

Before I read Bjørn Sandvik's post about semantic geospatial services, I didn't know there was an effort to build bridges from WS-* to the Semantic Web. More significantly, his post is a useful introduction to semantic web issues to GIS users who are more familiar with the concept of services than the concept of Web resources. The metadata in OGC service capability documents (abstract, keywords, etc) are inadequate for the purpose of machine reasoning, and application of RDF and OWL could certainly make it more clear what a service is about.

There is a different effort already underway to semantically link open datasets called "Linked Data" [wikipedia, http://linkeddata.org] or "Linking Open Data" [W3C]. This service-free, or at least, service-agnostic, approach is the one I find more compelling for Pleiades and Concordia. The diagram below (from Richard Cyganiak) shows how geographic data courtesy of GeoNames is right at the heart of the Linked data project.

This graph of data has grown by leaps and bounds since we pitched Concordia. We didn't initially propose to join the Linked Data project, but I'd really like to see Ancient World datasets link themselves together in this way.

http://atlantides.org/batlas

Readme:

• Eliminated duplication/collision problems with alias id values. Although the combination of label + map number + grid square is almost perfectly unique across the entire atlas, the same cannot be said for features not appearing on the maps (like "unlocated" and "false" toponyms), nor for alternative aliases, such as those created for individual constituent names in a multi-name label. Where possible, these collisions are eliminated by adding a one-up numbering scheme (postfixed) on the id, or by omitting non-primary alias alternatives where necessary. The one-up postfix numbers are also reflected in matching captions (in parentheses).
• Corrected initial two-capitals error in geographic names and associated captions generated when a parenthetical variant indication leads the toponym (e.g., (L)Ibida, which should produce the variants "Libida" and "Ibida", not "LIbida" and "Ibida".
• Captions for "group" features now read like "aqueduct group" instead of "aqueduct-group".
• Suppress serialization of a few redundant captions

Latest XML in http://atlantides.org/batlas/

I've added a read-me file, as well as text files containing diffs between previous and current versions of the individual xml files. The readme file says:

• altered citations so that location descriptions for unnamed features are enclosed in parentheses
• fixed bug in processing of fragmentary, unreconstructable geognames so that lacunae are signaled with parentheses around ellipsis (...) instead of ellipsis alone; also, mark them correctly as completeness="non-reconstructable" instead of type="variant"
• remove inverted quotes from geogname variants and instead mark them as accuracy="inaccurate"
• handle group notation in location description for unnamed features like aqueducts and villas so that, e.g., Map-by-Map directory entry in Aqueducts for map 22 C5 with location description "Nicopolis ad Istrum (2)" becomes "aqueduct-group-nicopolis-ad-istrum-22-c5" instead of "aqueduct-nicopolis-ad-istrum-2-22-c5"; this also adds a new element child of indicating the number of features associated with the group.

Update: follow the batlasids tag trail for follow-ups.

Back in February, I blogged about clean URLs and feed aggregation. In March, we learned about the ORE specification for mapping resource aggregations in Atom XML, just as we were gearing up to start work on the Concordia project, with support from the US National Endowment for the Humanities and the UK Joint Information Services Committee.

Our first workshop was held in May. One of the major outcomes was a to-do for me: provide a set of stable identifiers for every citable geographic feature in the Barrington Atlas so collaborators could start publishing resource maps and building interoperation services right away, without waiting for the full build-out of Pleiades content (which will take some time).

The first fruits can be downloaded at: http://atlantides.org/batlas/ . All content under that URL is licensed cc-by. Back versions are in dated subdirectories.

There you'll find XML files for 3 of the Atlas maps (22, 38 and 65). There's only one feature class for which we don't provide IDs: roads. More on why not another time. I'll be adding files for more of the maps as quickly as I can, beginning with Egypt and the north African coast west from the Nile delta to Tripolitania (the Concordia "study area"). Our aim is full coverage for the Atlas within the next few months.

What do you get in the files?

IDs (aka aliases) for every citable geographic feature in the Barrington Atlas. For example:

• BAtlas 65 G2 Ouasada = ouasada-65-g2

If you combine one of these aliases with the "uribase" also listed in the file (http://atlantides.org/batlas/) you get a Uniform Resource Identifier for that feature (this should answer Sebastian Heath's question).

For features with multiple names, we provide multiple aliases to facilitate ease of use for our collaborators. For example, for BAtlas 65 A2 Aphrodisias/Ninoe, any of the following aliases are valid:

• aphrodisias-ninoe-65-a2
• aphrodisias-65-a2
• ninoe-65-a2
  

Features labeled in the Atlas with only a number are also handled. For example, BAtlas 38 C1 no. 9 is glossed in the Map-by-Map Directory with the location description (modern names): "Siret el-Giamel/Gasrin di Beida". So, we produce the following aliases, all valid:

• (9)-38-c1
• (9)-siret-el-giamel-gasrin-di-beida-38-c1
• (9)-siret-el-giamel-38-c1
• (9)-gasrin-di-beida-38-c1

Most unlabeled historical/cultural features also get identifiers. For example:

• Unnamed aqueduct at Laodicea ad Lycum in BAtlas 65 B2 = aqueduct-laodicea-ad-lycum-65-b2
  
• Unnamed bridge at Valerian in BAtlas 22 B5 = bridge-valeriana-22-b5

Unlocated toponyms and false names (appearing only in the Map-by-Map Directory) get treated like this:

• BAtlas 22 unlocated Acrae = acrae-22-unlocated
  
• BAtlas 38 unlocated Ampelos/Ampelontes? = ampelos-ampelontes-38-unlocated = ampelos-38-unlocated = ampelontes-38-unlocated
• BAtlas 65 false name ‘Itoana’ = itoana-65-false
  

The XML files also provide associated lists of geographic names, formatted BAtlas citations and other information useful for searching, indexing and correlating these entries with your own existing datasets. What you don't get is coordinates. That's what the Pleiades legacy data conversion work is for, and it's a slower and more expensive process.

Read on to find out how you can start using these identifiers now, and get links to the corresponding Pleiades data automatically as it comes on line over time.

Why do we need these identifiers?

Separate digital projects would like to be able to refer unambiguously to any ancient Greek or Roman geographic feature using a consistent, machine-actionable scheme. The Barrington Atlas is a stable, published resource that can provide this basis if we construct the corresponding IDs.

Even without coordinates, other projects can begin to interoperate with each other immediately, as long as they have a common scheme of identifiers. After using BAtlas URIs to normalize, control or annotate their geographic description, they can publish services or crosswalks that provide links for the relationships within and between their datasets. For example, for each record in a database of coins you might like links to all the other coins minted by the same city, or to digital versions (in other databases) of papyrus documents and inscriptions found at that site.

Moreover, we would like other projects to start using a consistent identifier scheme now, so that as Pleiades adds content we can build more interoperation around it (e.g., dynamic mapping, coordinate lookup, proximity search across multiple collections). To that end, Pleiades will provide redirects (303 see other) from Barrington Atlas URIs (following the scheme described here) as follows:

• If a corresponding entry exists in Pleiades, the web browser will be redirected to that Pleiades page automatically
  
• If there is not yet a corresponding entry in Pleiades, the web browser will be redirected to an HTML page providing a full human-readable citation of the Atlas, as well as information about this service

So, for example:

• http://atlantides.org/batlas/aphrodisias-ninoe-65-a2 will re-direct to http://pleiades.stoa.org/places/638753
• http://atlantides.org/batlas/vlahii-22-e4 will re-direct to http://atlantides.org/batlas/vlahii-22-e4.html until there is a corresponding Pleiades record

The HTML landing pages for non-Pleiades redirects are not in place yet, but we're working on it. We'll post again when that's working.

Why URIs for a discretely citable feature in a real-world, printed atlas?

I'll let Bizer, Cyganiak and Heath explain the naming of resources with URI references. In the parlance of "Linked Data on the Web," Barrington Atlas features are "non-information resources"; that is, they are non-digital/real-world discrete entities about which web authors and services may want to make assertions or around which to perform operations. What we are doing is creating a stable system for identifying and citing these resources so that those assertions and operations can be automated using standards-compliant web mechanisms and applications. The HTML pages to which web browsers will be automatically redirected constitute "information resources" that describe the "non-information resources" identified by the original URIs.

How

If I get a comment box full of requests for a blow-by-blow description of the algorithm, I'll post something on that. If you're really curious and energetic, have a look at the code. It's intended mostly for short-term, internal use, so it's not marvelously documented. Yes, it's a hack.

One of the big headaches was deciding how to decompose the complex labels into simple, clean ASCII strings that can be legal URL components. Sean blogged about that, and wrote some code to do it, shortly after the workshop.

Credit where credit is due

Sean and I had a lot of help from the workshop participants (Ben Armintor, Gabriel Bodard, Hugh Cayless, Sebastian Heath, Tim Libert, Sebastian Rahtz and Charlotte Roueché) in sorting out what to do here. Older, substantive conversations that informed this process (with these folks and others; notably Rob Chavez, Greg Crane, Ruth Mostern, Dan Pett, Ross Scaife†, Patrick Sims-Williams, Linda Smith and Neel Smith) go back as far as 2000, shortly after the Atlas was published.

Many thanks to all!

Examples in the Wild

Sebastian Rahtz has already mocked up an example service for the Lexicon of Greek Personal Names. It takes a BAtlas alias and returns you all the name records in their system that are associated with the corresponding place. So, for example:

• http://clas-lgpn2.class.ox.ac.uk/batlas/aloros-50-b3

This is just one of several services that LGPN is developing. See the LGPN web services page, as well as the LGPN presentation to the Digital Classicist Seminar in London last month.

Sebastian Heath, for some time, has been incorporating Pleiades identifiers into the database records of the American Numismatic Society. He has blogged about that work in the context of Concordia.

Do you have an application? Let me know!

I have just updated the XML files providing Barrington Atlas IDs and associated information (background). The following additions and changes were made

• IDs added for Map 73 (Ammon)
• All files refreshed so that alternative captions for rivers, islands and island groups with multiple names all carry the appropriate formulaic postfix expression (fl., Ins. Inss.); no alias IDs have been changed; no geogname elements have been changed; no features have been added or removed

Copies of the prior versions are available for reference in an appropriately-dated subdirectory, e.g.: http://atlantides.org/batlas/2007-07-11/

Sean Gilles has blogged about deriving unique representations of geographic names from the Barrington Atlas.

He suggests the pattern:
http://pleiades.stoa.org/batlas/{label-normalized}-{map}-{grid}

See the complete post for how to transliterate names containing non-ASCII characters into URL friendly (near) equivalents. It's mostly simple: 'Ağva' becomes 'agva' but there are more interesting cases.

Quick question: should the host component of the url be 'pleiades.stoa.org' or 'atlantides.org'? This may not matter from a redirection point-of-view but consistency, searchability, and interchange issues might make it desirable to designate one or the other as the preferred form.

I continue to be interested in using the Atom Syndication Format, Georss, KML and Google's mapping tools to express the geographic component of data related to the ancient Mediterranean. These formats are all simple, well-documented and xml-based so that Greek, Roman and Byzantine Pottery at Ilion (Troia), in which we try to use open standards, is a good test-bed for trying out ideas.

To cut to the chase, the following URLs show what I'm up to:

• Google Maps: http://maps.google.com/maps?q=http://classics.uc.edu/troy/grbpottery/grbpilion.kml
• Google Earth: http://classics.uc.edu/troy/grbpottery/grbpilion.kml

Clicking on the Google Maps link shows a browser-embedded map with a short list of sites on the left. It's early yet, but that list will expand. Regardless, clicking on a site name on the left will bring up a text-bubble pointing to the right place on the map. Within the bubble are one or more links to relevant pages on the GRBPIlion website. Imagine more dots and you get the idea.

The implementation is pretty simple but should give me flexibility going forward. There are three basic components. The file "geography.atom" defines geographic entities. If you look inside you'll see that I derive unique IDs from the Barrington Atlas, so Gaza is "http://atlantides.org/batlas/gaza-70-e2". In doing so, I follow the suggestions of Tom Elliot of ISAW. Looking inside "groups.xml" - which instantiates concepts such as "African Red Slip" for rendering into html - shows that a few such groups make reference to these geographic entities. Search for 'rel="geographic"' to see what I mean. Finally, I munge those two files into "grbpilion.kml", which can be shown directly in Google Earth or via Google Maps using the URLs listed above.

The xslt that does the munging is "kml.xsl". It's pretty ugly right now but it works so will do for the short term.

At a more abstract level, I can theoretically put elements such as '<link rel="geographic" href="http://atlantides.org/batlas/gaza-70-e2" />' anywhere in the publication. Right now I only implement this idea in groups.xml but I look forward to extending this system to individual sherd descriptions and to the bibliography.