<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Central Unit blogs</title>
	<atom:link href="http://finds.org.uk/blogs/centralunit/feed/" rel="self" type="application/rss+xml" />
	<link>http://finds.org.uk/blogs/centralunit</link>
	<description>Just another Portable Antiquities Scheme blogs weblog</description>
	<lastBuildDate>Fri, 05 Oct 2012 15:41:10 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.5.1</generator>
		<item>
		<title>The Portable Antiquities Scheme joins Pelagios</title>
		<link>http://finds.org.uk/blogs/centralunit/2012/10/05/the-portable-antiquities-scheme-joins-pelagios/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2012/10/05/the-portable-antiquities-scheme-joins-pelagios/#comments</comments>
		<pubDate>Fri, 05 Oct 2012 15:41:10 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Classics]]></category>
		<category><![CDATA[GeoNames]]></category>
		<category><![CDATA[Institute for the Study of the Ancient World]]></category>
		<category><![CDATA[natural language processing]]></category>
		<category><![CDATA[Nomisma]]></category>
		<category><![CDATA[Pleiades]]></category>
		<category><![CDATA[XSLT]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=1121</guid>
		<description><![CDATA[NOTE: This has been recycled from: http://pelagios-project.blogspot.co.uk/2012/10/the-portable-antiquities-scheme-joins.html Hacking Pelagios RDF in the ISAW library, June 2012 Earlier in 2012, the excellent Linked Ancient World Data Institute was held in New York at the Institute for the Study of the Ancient World (ISAW). During this symposium, Leif and Elton convinced many participants that they should contribute their ... <a href="http://finds.org.uk/blogs/centralunit/2012/10/05/the-portable-antiquities-scheme-joins-pelagios/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<div class="separator" style="clear: both; text-align: center;">NOTE: This has been recycled from: <a href="http://pelagios-project.blogspot.co.uk/2012/10/the-portable-antiquities-scheme-joins.html" class="liexternal">http://pelagios-project.blogspot.co.uk/2012/10/the-portable-antiquities-scheme-joins.html</a></div>
<table class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;" cellspacing="0" cellpadding="0" align="center">
<tbody>
<tr>
<td style="text-align: center;"><a href="http://farm9.staticflickr.com/8009/7337615858_5ca2264b33.jpg" style="margin-left: auto; margin-right: auto;" class="liimagelink" rel="lightbox[1121]"><img src="http://farm9.staticflickr.com/8009/7337615858_5ca2264b33.jpg" alt="" width="320" height="211" border="0" /></a></td>
</tr>
<tr>
<td class="tr-caption" style="text-align: center;">Hacking Pelagios <acronym title="Resource Description Framework">RDF</acronym> in the ISAW library, June 2012</td>
</tr>
</tbody>
</table>
<p>Earlier in 2012, the excellent <a href="http://wiki.digitalclassicist.org/Linked_Ancient_World_Data_Institute" class="liexternal">Linked Ancient World Data Institute</a> was held in New York at the Institute for the Study of the Ancient World (ISAW). During this symposium, Leif and Elton convinced many participants that they should contribute their data to the Pelagios project, and I was one of them.</p>
<p>I work for a project based at the British Museum called the <a href="http://finds.org.uk/" class="liinternal">Portable Antiquities Scheme</a> which encourages members of the public within England and Wales to voluntarily record objects that they discover whilst pursuing their hobbies (such as metal-detecting or gardening). The centrepiece of this projects is a publicly accessible database which has been on-line in various guises for over 13 years and the latest version is now in the position to produce interoperable data much more easily than previously.</p>
<table class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;" cellspacing="0" cellpadding="0" align="center">
<tbody>
<tr>
<td><a href="http://1.bp.blogspot.com/-jV_pt-stSbg/UFyFlAwpCCI/AAAAAAAAEWs/7n-_nFp0AeY/s1600/pasDb.png" style="margin-left: auto; margin-right: auto;" class="liimagelink" rel="lightbox[1121]"><img title="A screenshot of the finds.org.uk database front end" src="http://1.bp.blogspot.com/-jV_pt-stSbg/UFyFlAwpCCI/AAAAAAAAEWs/7n-_nFp0AeY/s320/pasDb.png" alt="Image of the finds.org.uk database" width="320" height="247" border="0" /></a></td>
</tr>
<tr>
<td class="tr-caption" style="font-size: 13px;">The Portable Antiquities Scheme database</td>
</tr>
</tbody>
</table>
<p>Within the <a href="http://finds.org.uk/database" class="liinternal">database</a> that I have designed and built (using Zend Framework, jQuery, Solr and Twitter Bootstrap), we now hold records for over 812,000 objects, with a high proportion of these being Roman coin records (<a href="http://finds.org.uk/database/search/results/objectType/COIN/broadperiod/ROMAN" class="liinternal">175,000</a>+ at the time of writing, some with more than 1 coin per record). Many of these coins have mints attached (over <a href="http://finds.org.uk/database/search/results/q/pleiadesID%3A%5B%2A+TO+%2A%5D" class="liinternal">51,000</a> are available to all access levels on our database, with a further 30,000 or so held back due to our <a href="http://www.imat.cimtech.co.uk/Resources/IM@T_Online/2004/0104_Ox%20Arch%20PAS%20diag.gif" class="liexternal" rel="lightbox[1121]">workflow</a> model.) To align these mints with a <a href="http://pleiades.stoa.org/" class="liexternal">Pleiades</a> place identifier was straightforward due to the limited number of places that are involved, with the simple addition of columns to our database. Where possible, these mints have also been assigned identifiers from <a href="http://www.nomisma.org/" class="liexternal">Nomisma</a>, <a href="http://www.geonames.org/" class="liexternal">Geonames</a> and <a href="http://developer.yahoo.com/geo/geoplanet/" class="liexternal">Yahoo!&#8217;s WOEID</a> system (although that might be on the way out with the recent <a href="http://developer.yahoo.com/boss/geo/" class="liexternal">BOSS news</a>), however some mints I haven&#8217;t been able to assign &#8211; for instance &#8216;<a href="http://finds.org.uk/romancoins/mints/mint/id/297" class="liinternal">mint moving with Republican issuer</a>&#8216; or &#8216;<a href="http://finds.org.uk/romancoins/mints/mint/id/38" class="liinternal">C</a>&#8216; mint which has an unknown location.</p>
<p>Once these identifiers were assigned to the database, it allowed easy creation of  <acronym title="Resource Description Framework">RDF</acronym> for use by the Pelagios project and it also facilitated use of their widgets to enhance our site further. To create the <acronym title="Resource Description Framework">RDF</acronym> for ingestion by Pelagios, our solr search index dumps <acronym title="eXtensible Markup Language">XML</acronym> via a cron job cUrl request, which is transformed by <a href="https://github.com/portableant/Beowulf---PAS/blob/master/public_html/xsl/pelagios.xsl" class="liexternal"><acronym title="eXtensible Stylesheet Language Transformation">XSLT</acronym></a> every Sunday night to our server and uses s3sync to send the dump to Amazon S3 (where we have incremental snapshots). These data grow at the rate of around 100 &#8211; 200 coins a week, depending on staff time, knowledge and whether the state of the coin allows one to attribute a mint (around 45% of the time.) The <acronym title="Portable Antiquities Scheme">PAS</acronym> database also has the facility for error reporting and commenting on records, so if you use the attributions provided through Pelagios and find a mistake, do tell us!</p>
<p>At some point in the future, I plan to try and match data extracted from natural language processing (using Yahoo geo tools and <a href="http://www.opencalais.com/" class="liexternal">OpenCalais</a>) against Pleiades identifiers and attempt to make more annotations available to researchers and Pelagios.</p>
<p>For example, this object <a href="http://finds.org.uk/database/artefacts/record/id/49791" class="liinternal">WMID-3FE965</a>, the Staffordshire Moorlands patera or trulla (shown below):</p>
<div class="separator" style="clear: both; text-align: center;"><a href="http://finds.org.uk/images/sworrell/medium/114-1479_img.jpg" style="margin-left: 1em; margin-right: 1em;" class="liimagelink" rel="lightbox[1121]"><img src="http://finds.org.uk/images/sworrell/medium/114-1479_img.jpg" alt="" width="320" height="185" border="0" /></a></div>
<p>Has the following inscription with place names:</p>
<div class="separator" style="clear: both; text-align: center;"><a href="http://finds.org.uk/images/sworrell/medium/all-2bwhard.jpg" style="margin-left: 1em; margin-right: 1em;" class="liimagelink" rel="lightbox[1121]"><img src="http://finds.org.uk/images/sworrell/medium/all-2bwhard.jpg" alt="" width="320" height="11" border="0" /></a></div>
<div class="separator" style="clear: both; text-align: center;"></div>
<p>This is a list of four forts located at the western end of Hadrian&#8217;s Wall; Bowness (MAIS), Drumburgh (COGGABATA), Stanwix (UXELODUNUM) and Castlesteads (CAMMOGLANNA). it incorporates the name of an individual, AELIUS DRACO and a further place-name, RIGOREVALI. Which can further be given Pleiades identifiers as such:</p>
<div>
<ol>
<li>Bowness: <a href="http://pleiades.stoa.org/places/89239" class="liexternal">89239</a></li>
<li>Drumburgh: <a href="http://pleiades.stoa.org/places/89151/" class="liexternal">89151</a></li>
<li>Stanwix: <a href="http://pleiades.stoa.org/places/967060430/" class="liexternal">967060430</a></li>
<li>Castlesteads: <a href="http://pleiades.stoa.org/places/89133/" class="liexternal">89133</a></li>
</ol>
<h3></h3>
<h3>Integrating the Pelagios widget and awld.js</h3>
<p>Using Pleiades and Nomisma identifers allows the <acronym title="Portable Antiquities Scheme">PAS</acronym> database to enrich records further via the use of rdfa in view scripts and by the incorporation of the Pelagios widget and the <a href="http://isaw.nyu.edu/members/sebastian.heath-40nyu.edu/awld-js" class="liexternal">ISAW javascript</a> library on a variety of pages. For example, the screenshot below gives a view of a gold aureus of Nero recorded in the North East of England with the Pelagios widget activated:</p>
<table class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;" cellspacing="0" cellpadding="0" align="center">
<tbody>
<tr>
<td style="text-align: center;"><a href="http://3.bp.blogspot.com/-_vl7V05DEx4/UFyJXQNvBDI/AAAAAAAAEW8/vBYowoDEu40/s1600/widget.png" style="margin-left: auto; margin-right: auto;" class="liimagelink" rel="lightbox[1121]"><img src="http://3.bp.blogspot.com/-_vl7V05DEx4/UFyJXQNvBDI/AAAAAAAAEW8/vBYowoDEu40/s320/widget.png" alt="" width="320" height="177" border="0" /></a></td>
</tr>
<tr>
<td class="tr-caption" style="text-align: center;">The pelagios widget embedded on a coin record:<br />
<a href="http://finds.org.uk/database/artefacts/record/id/495315" class="liinternal"><span style="background-color: white; color: #333333; font-family: 'Helvetica Neue', Helvetica, Arial, sans-serif; line-height: 18px; text-align: start;">DUR-B4E094</span> </a></td>
</tr>
</tbody>
</table>
<p>The javascript library by Nick Rabinowitz and Sebastian Heath also allows for enriched web pages, this page for <a href="http://finds.org.uk/romancoins/emperors/emperor/id/12" class="liinternal">Nero</a> shows the libary in action:</p>
<div class="separator" style="clear: both; text-align: center;"><a href="http://2.bp.blogspot.com/-Kw8j3x7pmhk/UGq7pz_rn2I/AAAAAAAAEYg/tXBgLer8Bf8/s1600/nero.JPG" style="margin-left: 1em; margin-right: 1em;" class="liimagelink" rel="lightbox[1121]"><img src="http://2.bp.blogspot.com/-Kw8j3x7pmhk/UGq7pz_rn2I/AAAAAAAAEYg/tXBgLer8Bf8/s320/nero.JPG" alt="" width="320" height="169" border="0" /></a></div>
<p>&nbsp;</p>
<div>
<p>These emperor pages also pull in various resources from third party websites (such as Adrian Murdoch&#8217;s excellent talking head video <a href="http://www.youtube.com/user/adrianmurdoch?feature=watch" class="liexternal">biographies of Roman emperors</a>), data from dbpedia, nomisma, viaf and the site&#8217;s internal search engine. The same approach is also used, but in a more pared down way for all other issuer periods on our website, for example: <a href="http://finds.org.uk/earlymedievalcoins/rulers/ruler/id/192" class="liinternal">Cnut the Great</a>.</p>
<h3 style="text-align: left;"><strong><br />
Integrating Johan&#8217;s map tiles</strong></h3>
<div>Following on from Johan&#8217;s posting on the magnificent set of map tiles that he&#8217;s produced for the Pelagios project (and as seen in use over at the <a href="http://pleiades.stoa.org/home" class="liexternal">Pleiades </a>site and <a href="http://numismatics.org/ocre/maps" class="liexternal">OCRE</a>), I&#8217;ve now integrated these into our mapping system. I&#8217;ve done it slightly differently to the examples that Johan gave; due to the volume of traffic that we serve up, it wasn&#8217;t fair to saddle the Pelagios team with extra bandwidth. Therefore, Johan provided zipped downloads of the map tiles and I store these on our server (if you&#8217;re a low traffic site, feel free to use our <a href="http://finds.org.uk/imperium" class="liinternal">tile store</a>):</div>
<table class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;" cellspacing="0" cellpadding="0" align="center">
<tbody>
<tr>
<td style="text-align: center;"><a href="http://2.bp.blogspot.com/-nC9OMW-zRKc/UFyKOmGgvfI/AAAAAAAAEXE/GmuVU0ifjAM/s1600/imperiumMap.jpg" style="margin-left: auto; margin-right: auto;" class="liimagelink" rel="lightbox[1121]"><img src="http://2.bp.blogspot.com/-nC9OMW-zRKc/UFyKOmGgvfI/AAAAAAAAEXE/GmuVU0ifjAM/s320/imperiumMap.jpg" alt="" width="320" height="189" border="0" /></a></td>
</tr>
<tr>
<td class="tr-caption" style="text-align: center;">Imperium map layer, with parish boundary. Zoom level 10.</td>
</tr>
</tbody>
</table>
<p>The map zoom has been set to the level (10 for Great Britain) at which we decided site security was ensured for the discovery points (although Johan has made tiles available to level 11). This complements the other layers we use:</p>
<ul>
<li>Open Street Map</li>
<li>terrain</li>
<li>satellite</li>
<li>soil map</li>
<li>Stamen map watercolor</li>
<li>Stamen map toner</li>
<li><a href="http://geo.nls.uk/maps/" class="liexternal">NLS historic OS maps</a></li>
</ul>
<p>Each find spot is also reverse geocoded for a WOEID and Geonames identifier to be produced, elevation to obtained and subsequently we link to Aaron Straup Cope&#8217;s excellent <a href="http://woe.spum.org/" class="liexternal">woedb</a> for further enhancement of place data.  We also serve up boundaries derived from the Ordnance Survey Opendata BoundaryLine dataset, split from shapefiles and converted to KML by ogr2ogr scripts. The incorporation of this layer allows researchers (over 300 projects currently use our data) to interpret the results that they get from searches on our database against the road network and settlement data much more easily and has already gathered many positive comments from our staff and research colleagues.</p>
<p>By contributing to the Pelagios project, we hope that people will find our resources more easily and that we in turn can promote the efforts of all the fantastic projects that have been involved in this programme. What we&#8217;ve managed to implement from joining the Pelagios project already outweighs the time spent coding the changes to our system. If you run a database or website with ancient world references, you should join too!</p>
<p>&nbsp;</p>
</div>
</div>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2012/10/05/the-portable-antiquities-scheme-joins-pelagios/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>CASPAR seminar series</title>
		<link>http://finds.org.uk/blogs/centralunit/2011/01/07/caspar-seminar-series/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2011/01/07/caspar-seminar-series/#comments</comments>
		<pubDate>Fri, 07 Jan 2011 14:40:54 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Education]]></category>
		<category><![CDATA[British Museum]]></category>
		<category><![CDATA[digital technology]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=1112</guid>
		<description><![CDATA[The Centre for Audio-Visual studies and practice in Archaeology is holding an inaugural series of seminars at the Institute of Archaeology, UCL, 31- 34 Gordon Square on Monday afternoons, starting this coming week. The programme is quite varies and the following speakers are booked to speak: 10 Jan Broadcast archaeology Michael Wood (Story of England, ... <a href="http://finds.org.uk/blogs/centralunit/2011/01/07/caspar-seminar-series/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>The Centre for Audio-Visual studies and practice in Archaeology is holding an inaugural series of seminars at the Institute of Archaeology, UCL, 31- 34 Gordon Square on Monday afternoons, starting this coming week. The programme is quite varies and the following speakers are booked to speak:</p>
<p>10 Jan Broadcast archaeology Michael Wood (Story of England, BBC) &amp; Ray Sutcliffe (Chronicle)</p>
<p>17 Jan Producing archaeology on TV Charles Furneaux (Kaboom Film and Television)</p>
<p>24 Jan Archaeology and radio Ben Roberts (The British Museum)</p>
<p>31 Jan Using digital technology to visualise the past Tom Goskar (Wessex Archaeology) and Stuart Eve (UCL)</p>
<p>7 Feb The Google ancient places prokect Leif Isaksen (University of Southampton)</p>
<p>21 Feb Archaeology, television and the public Tim Schadla-Hall &amp; Chiara Bonacchi (UCL)</p>
<p>28 Feb Developing digital communities Andy Bevan and Lorna Richardson (UCL)</p>
<p>7 Mar The Portable Antiquities Scheme Dan Pett (The British Museum)</p>
<p>14 Mar Archaeology, videogames and the public Andrew Gardner (UCL)</p>
<p>21 Mar Where do we go from here Don Henson (Honorary Director of CASPAR)</p>
<p>Enquiries to: Tim Schadla-Hall t.schadla-hall@ucl.ac.uk or Chiara Bonacchi chiara.bonacchi@gmail.</p>
<p>All seminars in room 612 and everyone is welcome. A drinks reception follows each seminar.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2011/01/07/caspar-seminar-series/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Leveraging geodata for enriched records</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/09/30/leveraging-geodata/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/09/30/leveraging-geodata/#comments</comments>
		<pubDate>Thu, 30 Sep 2010 14:04:45 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[Geography]]></category>
		<category><![CDATA[Geospatial]]></category>
		<category><![CDATA[GIS]]></category>
		<category><![CDATA[Techie stuff]]></category>
		<category><![CDATA[api]]></category>
		<category><![CDATA[caching]]></category>
		<category><![CDATA[Chris Heilmann]]></category>
		<category><![CDATA[Gary Gale]]></category>
		<category><![CDATA[geodata tools]]></category>
		<category><![CDATA[Jeff Stott]]></category>
		<category><![CDATA[Jim O\'Donnell]]></category>
		<category><![CDATA[National Council for Metal Detecting]]></category>
		<category><![CDATA[w3gconf]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=748</guid>
		<description><![CDATA[This post discusses how I&#8217;ve been using various geodata tools (principally Yahoo!, but also Flickr shapefiles, Google&#8217;s maps and geocoder apis, Geonames, OSdata and I&#8217;m now exploring the Unlock project from Edina to see what they can offer as well), for the enrichment of our database. I started writing this post back in May, but ... <a href="http://finds.org.uk/blogs/centralunit/2010/09/30/leveraging-geodata/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>This post discusses how I&#8217;ve been using various geodata tools (principally Yahoo!, but also Flickr shapefiles, Google&#8217;s maps and geocoder apis, Geonames, OSdata and I&#8217;m now exploring the Unlock project from Edina to see what they can offer as well), for the enrichment of our database. I started writing this post back in May, but as I&#8217;ve just spoken at the <a href="http://www.w3gconf.com/" class="liexternal">W3G unconference</a> in Stratford-on-Avon, I thought I&#8217;d finish it and get it out. Gary Gale and his helpers produced a very good un-conference, at which I met some very interesting people (shame TW Bell couldn&#8217;t come!) and saw some good examples of what other people are up to.</p>
<p>My presentation from that conference is embedded here:<br />
<iframe src="http://www.slideshare.net/slideshow/embed_code/5321797" width="940" height="746" frameborder="0" marginwidth="0" marginheight="0" scrolling="no"></iframe><br/><br/></p>
<p>Most of us realise the power of maps and I&#8217;ve made them a very central cog of the new Scheme website that we soft launched at the end of March 2010. Hopefully this isn&#8217;t too long and boring and has some technical stuff that may be of some use to others. As always, the below is CC-NC-SA.</p>
<p><a href="http://finds.org.uk/blogs/centralunit/files/2010/09/allfinds.jpg" class="flow" rel="lightbox[748]"><img class="alignnone size-medium wp-image-1026" title="allfinds" src="http://finds.org.uk/blogs/centralunit/files/2010/09/allfinds-212x300.jpg" alt="A map showing all finds recorded by the Scheme" width="212" height="300" /></a>At the Scheme, we&#8217;ve been collecting data on the provenance of archaeological discoveries made by the public and publishing it online for 13 years now (much longer than I&#8217;ve worked for the Scheme!), and these are collated on our database and provide the basis for spatial interrogation of where and when these objects have been discovered. Many researchers are using the database for a variety of geomatics, for example patterning, cluster analysis etc. A few of our recent AHRC funded PhD candidates have been implementing GIS techniques as one of the integral parts of their research &#8211; for example:</p>
<ol>
<li><a href="http://www.finds.org.uk/research/projects/project/id/12" title="Outline of Tom's research" class="liinternal">Tom Brindle</a>, KCL</li>
<li><a href="http://www.finds.org.uk/research/projects/project/id/19" title="Outline of Philippa's work" class="liinternal">Philippa Walton</a>, UCL</li>
<li><a href="http://www.finds.org.uk/research/projects/project/id/13" title="Outline of Ian's research" class="liinternal">Ian Leins</a>, Newcastle University</li>
<li><a href="http://www.finds.org.uk/research/projects/project/id/31" title="Outline of Katie's research" class="liinternal">Katie Robbins</a>, Southampton University</li>
</ol>
<p>They are all incidentally <a href="http://www.finds.org.uk/contacts/alumni" title="A list and stats for our alumni" class="liinternal">alumni of the Scheme</a> (and one has rejoined recently!), and have been inspired with their research from working on these data that we collate.  I won&#8217;t be discussing the philosophical arguments of provenance and its meaning within this article, but demonstrating how we&#8217;re using third-party tools to enhance find spot data on our site and talk about some of the problems we face to make use of them. Some of the post will have some code examples, but you can gloss over them if you&#8217;re not into that (which the majority of our readers will probably be!)</p>
<h4>Find spot data</h4>
<p>Our <a href="http://finds.org.uk/contacts" class="liinternal">Find Liaison Officers</a> record the majority of objects that we are shown onto our database and ask the finder to provide us with the most accurate National Grid Reference (OSGB36) that they can produce. Many of our finders are now using GPS units to produce grid references (we&#8217;re aware of the degree of accuracy/precision they provide, but as most objects aren&#8217;t from secure archaeological contexts, the variance won&#8217;t affect work that much.) We encourage people to provide these figures to a level of 8 figures and above and this proportion is growing every year. The list below shows the precision of each grid reference length:</p>
<ul>
<li>0 figure [SP] = 100 kilometre square</li>
<li>2 figure [SP11] = 10 kilometre square</li>
<li>4 figure [SP1212] = 1 kilometre square</li>
<li>6 figure [SP8123123] = 100 metre square</li>
</ul>
<p>Then we get the figures that are actually of some archaeological use:</p>
<ul>
<li>8 figure [SP812341234] = 10 metre square</li>
<li>10 figure [SP1234512345] = 1 metre square</li>
<li>12 figure [SP123456123456] = 10 centimetre square</li>
</ul>
<p>This find spot data is given to us in confidence by the finders and landowners and we therefore have to protect this confidence. We have an agreement with the main providers of our data &#8211; the metal detecting community &#8211; representative body (<a href="http://www.ncmd.co.uk/" class="liexternal">The National Council for Metal Detecting</a>), that we won&#8217;t publish on-line find spots at a precision higher than a 4 figure national grid reference or to parish level. These grid references can be obscured from public view completely by asking the Finds Liaison Officer to enter a to be &#8220;<strong>known as</strong>&#8221; alias on the find spot form at the time of recording (or subsequently).</p>
<h4>Converting OSGB36 grid references to Latitude and Longitude pairs</h4>
<p>Most of the web mapping programs out there, make use of Latitude and Longitude pairs for displaying point data on their mapping interfaces. Therefore, we now convert all our NGRs to LatLng on our database and these are stored as floats in two columns in our find spots table. Whilst processing these grid references to the LatLng pairs, I also do some further manipulations to produce and insert into our spatial data table:</p>
<ol>
<li>Grid reference length</li>
<li>Accuracy of grid reference as shown above</li>
<li>Four figure grid reference</li>
<li>1:25k map reference</li>
<li>1:10k map reference</li>
<li>Findspot elevation</li>
<li>Where on Earth ID</li>
</ol>
<p>The <acronym title="Hypertext PreProcessing">PHP</acronym> code functions to do this are based around some written by the original Oxford ArchDigital team and has some additions by me. There are publicly available code examples by <a href="http://www.nearby.org.uk/downloads.html" title="Geograph php code" class="liexternal">Barry Hunter</a> or <a href="http://www.jstott.me.uk/phpcoord/" title="Jeff Stott's phpcoord code" class="liexternal">Jeff Stott</a> or some other versions out there on the web! My code is used as either a service or view helper in my Zend Framework project and bundles together a variety of functions. I&#8217;m not a developer, I&#8217;ve just taught myself bits and pieces to get the <acronym title="Portable Antiquities Scheme">PAS</acronym> website back on the road; if you see errors, do let me know or suggest ways to improve the code.</p>
<h4>Using Yahoo! to geo-enrich our data</h4>
<p>Several years ago, the great <a href="http://twitter.com/twbell" class="liexternal">Tyler Bell</a> (formerly of Oxford ArchDigital and Yahoo!) gave a paper at an archaeological computing conference at UCL&#8217;s Institute of Archaeology, where he broke his joke about <acronym title="eXtensible Markup Language">XML</acronym> being like high school sex (won&#8217;t elaborate on this, ask him) whilst some toe-rags were trying to steal my push bike (they came off badly as I was standing behind them!) Tyler&#8217;s paper gave me much food for thought, and it is over the last year or so, that this idea has really come to fruition with our data. The advent of Yahoo!&#8217;s suite of geoPlanet tools has allowed us to do various things to our data set and present it in different ways. Below, I&#8217;ll show you some of things their powerful suite of tools has allowed us to do.</p>
<h4>Putting dots on maps for finds with just a parish name</h4>
<p>Prior to 2003, we often received the majority of our finds with a very vague find spot, often just to parish level. As everyone loves maps and would like to see where these finds came from, I wanted to get a map on every page that needed one.. Previously, our FLOs would be asked to centre a find on the parish for these find spots; this is now such a waste of time when you can use geoPlanet to get a latitude and longitude, Postcode, type of settlement, bounding box and a WOEID to enhance the data that we hold. To do this is pretty simple with the aid of YQL.</p>
<p>I first heard about YQL from <a href="http://eatyourgreens.org.uk/" class="liexternal">Jim O&#8217;Donnell</a> (formerly NMM&#8217;s web wizard) and then more at the Yahoo! Hack day in London, when I pedalled round London with Andrew Larcombe on the <a href="http://pppp.andrewl.net/" class="liexternal">Purple Pedals bikes</a>. Yahoo describe YQL as <strong>SELECT * FROM Internet</strong>, which is indeed pretty true. Building opentables to use with their system is pretty easy &#8211; I&#8217;ll write more about some Museum tables in another post soon. So all my geo extraction is performed using YQL and the examples below show how. All of these are done with the public endpoint. If you run a high traffic site, it is definitely worth changing your code to use Oauth and authenticate your YQL calls for the non-public endpoint (better rate limits etc). It is slightly tricky and you do need to work out how to refresh your Yahoo token, but it is worth the effort.</p>
<p>For example, I grew up in Stapleford, Cambridgeshire and you can search for that with the following YQL call:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym>]select * from geo.places where text=&quot;stapleford,cambridgeshire&quot;[/html]</p>
<p>Which maps to this REST <acronym title="Uniform Resource Locator">URL</acronym> of:<br />
<a href="http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20geo.places%20where%20text%3D%22stapleford%2Ccambridgeshire%22" title="REST call to geoplanet for Stapleford" class="liexternal">http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20geo.places%20where%20text%3D%22stapleford%2Ccambridgeshire%22</a><br />
producing an <acronym title="eXtensible Markup Language">XML</acronym> or JSON response like below (diagnostics omitted):</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym> toolbar="true"]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot; yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-05-05T11:12:49Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;place xmlns=&quot;http://where.yahooapis.com/v1/schema.rng&quot; xml:lang=&quot;en-US&quot; yahoo:<acronym title="Uniform Resource Identifier">URI</acronym>=&quot;http://where.yahooapis.com/v1/place/35984&quot;&gt;<br />
            &lt;woeid&gt;35984&lt;/woeid&gt;<br />
            &lt;placeTypeName code=&quot;7&quot;&gt;Town&lt;/placeTypeName&gt;<br />
            &lt;name&gt;Stapleford&lt;/name&gt;<br />
            &lt;country code=&quot;<acronym title="Gigabyte">GB</acronym>&quot; type=&quot;Country&quot;&gt;United Kingdom&lt;/country&gt;<br />
            &lt;admin1 code=&quot;<acronym title="Gigabyte">GB</acronym>-ENG&quot; type=&quot;Country&quot;&gt;England&lt;/admin1&gt;<br />
            &lt;admin2 code=&quot;<acronym title="Gigabyte">GB</acronym>-CAM&quot; type=&quot;County&quot;&gt;Cambridgeshire&lt;/admin2&gt;<br />
            &lt;admin3/&gt;<br />
            &lt;locality1 type=&quot;Town&quot;&gt;Stapleford&lt;/locality1&gt;<br />
            &lt;locality2/&gt;<br />
            &lt;postal type=&quot;Postal Code&quot;&gt;CB22 5&lt;/postal&gt;<br />
            &lt;centroid&gt;<br />
                &lt;latitude&gt;52.145329&lt;/latitude&gt;<br />
                &lt;longitude&gt;0.151490&lt;/longitude&gt;<br />
            &lt;/centroid&gt;<br />
            &lt;boundingBox&gt;<br />
                &lt;southWest&gt;<br />
                    &lt;latitude&gt;52.127220&lt;/latitude&gt;<br />
                    &lt;longitude&gt;0.133460&lt;/longitude&gt;<br />
                &lt;/southWest&gt;<br />
                &lt;northEast&gt;<br />
                    &lt;latitude&gt;52.164879&lt;/latitude&gt;<br />
                    &lt;longitude&gt;0.176640&lt;/longitude&gt;<br />
                &lt;/northEast&gt;<br />
            &lt;/boundingBox&gt;<br />
            &lt;areaRank&gt;3&lt;/areaRank&gt;<br />
            &lt;popRank&gt;1&lt;/popRank&gt;<br />
        &lt;/place&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>By parsing the <acronym title="eXtensible Markup Language">XML</acronym> or JSON response (I tend to use the JSON response),  a Latitude and Longitude pair can be retrieved for placing the object onto the map. It isn&#8217;t the true find spot, but can at least give a high level overview of the point of origin. Whilst doing this, I also take the postcode, woeid, bounding box etc to reuse again. Parsing data is pretty simple once you have got your response and decoded the JSON, for example:</p>
<p>[<acronym title="Hypertext PreProcessing">PHP</acronym>]<br />
 $place = $place-&gt;query-&gt;results-&gt;place;<br />
 $placeData = array();<br />
 $placeData['woeid'] = (string) $place-&gt;woeid;<br />
 $placeData['placeTypeName'] = (string) $place-&gt;placeTypeName-&gt;content;<br />
 $placeData['name'] = (string) $place-&gt;name;<br />
 if($place-&gt;country){<br />
 $placeData['country'] = (string) $place-&gt;country-&gt;content;<br />
 }<br />
 if($place-&gt;admin1) {<br />
 $placeData['admin1'] = (string) $place-&gt;admin1-&gt;content;<br />
 }<br />
 if($place-&gt;admin2){<br />
 $placeData['admin2'] = (string) $place-&gt;admin2-&gt;content;<br />
 }<br />
 if($place-&gt;admin3){<br />
 $placeData['admin3'] = (string) $place-&gt;admin3-&gt;content;<br />
 }<br />
 if($place-&gt;locality1){<br />
 $placeData['locality1'] = (string) $place-&gt;locality1-&gt;content;<br />
 }<br />
 if($place-&gt;locality2){<br />
 $placeData['locality2'] = (string) $place-&gt;locality2-&gt;content;<br />
 }<br />
 if($place-&gt;postal){<br />
 $placeData['postal'] = $place-&gt;postal-&gt;content;<br />
 }<br />
 $placeData['latitude'] = $place-&gt;centroid-&gt;latitude;<br />
 $placeData['longitude'] = $place-&gt;centroid-&gt;longitude;<br />
 $placeData['centroid'] = array(<br />
 &#8216;lat&#8217; =&gt; (string) $place-&gt;centroid-&gt;latitude,<br />
 &#8216;lng&#8217; =&gt; (string) $place-&gt;centroid-&gt;longitude<br />
 );<br />
 $placeData['boundingBox'] = array(&#8216;southWest&#8217; =&gt; array(<br />
 &#8216;lat&#8217; =&gt; (string) $place-&gt;boundingBox-&gt;southWest-&gt;latitude,<br />
 &#8216;lng&#8217; =&gt; (string) $place-&gt;boundingBox-&gt;southWest-&gt;longitude),<br />
 &#8216;northEast&#8217; =&gt; array(<br />
 &#8216;lat&#8217; =&gt; (string) $place-&gt;boundingBox-&gt;northEast-&gt;latitude,<br />
 &#8216;lng&#8217; =&gt; (string) $place-&gt;boundingBox-&gt;northEast-&gt;longitude)<br />
 );<br />
 return $placeData;<br />
[/php]</p>
<p>The image below shows an autogenerated findspot and a parish boundary (see below for flickr shapefile use) and adjacent places.</p>
<p><a href="http://finds.org.uk/blogs/centralunit/files/2010/09/autogenerated.jpg" class="liimagelink" rel="lightbox[748]"><img class="alignnone size-medium wp-image-1045" title="autogenerated" src="http://finds.org.uk/blogs/centralunit/files/2010/09/autogenerated-210x300.jpg" alt="An autogenerated findspot" width="210" height="300" /></a></p>
<p>Within our database, I have a certainty field for where the co-ordinates originate from. This table has the following content:</p>
<ol>
<li>From a map</li>
<li>From finder verbally</li>
<li>GPS from the finder</li>
<li>GPS from the <acronym title="Finds Liaison Officer">FLO</acronym></li>
<li>Centred on the parish via a paper map</li>
<li>Recorded at a rally (so certainty could be dubious)</li>
<li>Produced via webservice</li>
</ol>
<p>Therefore researchers are appraised of where the findspot comes from and whether we can treat it (if at all) as useful.</p>
<h4>Getting elevation (via Geonames)</h4>
<p>The woeid or the LatLng can be used to get elevation of the find spot. This can be achieved by a combination of reverse geocoding against Flickr place names (for woeid) and the Geonames <acronym title="Application Programming Interface">API</acronym> call for &#8216;Elevation &#8211; Aster Global Digital Elevation Model&#8217;. So for example, I want to get the elevation for the centre of Stapleford. You can query the geonames <acronym title="Application Programming Interface">API</acronym> with the following YQL:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym> wraplines="true"]select * from json where <acronym title="Uniform Resource Locator">URL</acronym>=&quot;http://ws.geonames.org/astergdemJSON?lat=52.145329&amp;lng=0.151490&quot;;[/html]</p>
<p>Which when executed produces this <a href="http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20json%20where%20url%3D%22http%3A%2F%2Fws.geonames.org%2FastergdemJSON%3Flat%3D52.145329%26lng%3D0.151490%22%3B&amp;env=store%3A%2F%2Fdatatables.org%2Falltableswithkeys" class="liexternal">response</a>:</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym>]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot;<br />
    yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-09-30T12:26:00Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
     &lt;results&gt;<br />
        &lt;json&gt;<br />
            &lt;astergdem&gt;17&lt;/astergdem&gt;<br />
            &lt;lng&gt;0.15149&lt;/lng&gt;<br />
            &lt;lat&gt;52.145329&lt;/lat&gt;<br />
        &lt;/json&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>So I now have the elevation of 17 metres above sea level. Great! I&#8217;ve been experimenting a bit with this against some findspots that we know elevation for. One high profile object, the Crosby Garrett Helmet was pinpointed to 1 metre difference in the GPS elevation and the Geonames sourced one.</p>
<p>By providing an elevation for each of our findspots, researchers can then do <a href="http://en.wikipedia.org/wiki/GIS_Viewshed_Analysis" title="Viewshed analysis how to" rel="nofollow" class="liwikipedia">viewshed analysis</a>; I don&#8217;t think anyone has really done this yet for the artefact distributions that we record, but I could be proved wrong!</p>
<h4>Reverse geocoding from Latitude and Longitude with Yahoo!</h4>
<p>At present, the GeoPlanet suite doesn&#8217;t provide this feature, but you can still manage to do this via YQL and using the following query:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym>]select * from flickr.places where lon={Longitude} and lat={latitude}[/html]</p>
<p>So for example using Stapleford&#8217;s LatLng as the YQL parameters gives you:</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym> wraplines="true"]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot; yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-05-05T01:27:47Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;places accuracy=&quot;16&quot; latitude=&quot;52.145329&quot; longitude=&quot;0.151490&quot; total=&quot;1&quot;&gt;<br />
            &lt;place latitude=&quot;52.145&quot; longitude=&quot;0.151&quot; name=&quot;Stapleford, England, United Kingdom&quot; place_id=&quot;m2G8tyiaBJVjFQ&quot; place_type=&quot;locality&quot; place_type_id=&quot;7&quot; place_url=&quot;/United+Kingdom/England/Stapleford/in-Cambridgeshire&quot; timezone=&quot;Europe/London&quot; woeid=&quot;35984&quot;/&gt;<br />
        &lt;/places&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>You&#8217;ll notice a couple fo useful things in the Flickr <acronym title="eXtensible Markup Language">XML</acronym> returned, for example the place_url, in this case: /united+kingdom/england/stapleford/in-cambridgeshire  which when appended to Flickr&#8217;s root <acronym title="Uniform Resource Locator">URL</acronym> for photos can give you <a href="http://www.flickr.com/places/united+kingdom/england/stapleford/in-cambridgeshire" title="Photos on Flickr from Stapleford, Cambridgeshire" class="liexternal">http://www.flickr.com/places/united+kingdom/england/stapleford/in-cambridgeshire</a> which in turn gives you access to feeds in various flavours from that page.</p>
<p>One of the other cool things available in Flickr&#8217;s <acronym title="Application Programming Interface">API</acronym> is placeinfo. I&#8217;d love a boundary map of how Flickr views the parish of Stapleford. As I previously obtained and gave my findspot a WOEID, I can see if Flickr has this data. So perform this YQL query:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym>]select * from flickr.places.info where woe_id=&#8217;35984&#8242;[/html]</p>
<p>And execute it to obtain the following XML:</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym> wraplines="true"]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot;<br />
    yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-09-30T12:34:50Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;place has_shapedata=&quot;1&quot; latitude=&quot;52.145&quot; longitude=&quot;0.151&quot;<br />
            name=&quot;Stapleford, England, United Kingdom&quot;<br />
            place_id=&quot;m2G8tyiaBJVjFQ&quot; place_type=&quot;locality&quot;<br />
            place_type_id=&quot;7&quot;<br />
            place_url=&quot;/United+Kingdom/England/Stapleford/in-Cambridgeshire&quot;<br />
            timezone=&quot;Europe/London&quot; woeid=&quot;35984&quot;&gt;<br />
            &lt;locality latitude=&quot;52.145&quot; longitude=&quot;0.151&quot;<br />
                place_id=&quot;m2G8tyiaBJVjFQ&quot;<br />
                place_url=&quot;/United+Kingdom/England/Stapleford/in-Cambridgeshire&quot; woeid=&quot;35984&quot;&gt;Stapleford, England, United Kingdom&lt;/locality&gt;<br />
            &lt;county latitude=&quot;52.373&quot; longitude=&quot;0.007&quot;<br />
                place_id=&quot;pVJUVwKYA5qQZa9wqQ&quot;<br />
                place_url=&quot;/pVJUVwKYA5qQZa9wqQ&quot; woeid=&quot;12602140&quot;&gt;Cambridgeshire, England, United Kingdom&lt;/county&gt;<br />
            &lt;region latitude=&quot;52.883&quot; longitude=&quot;-1.974&quot;<br />
                place_id=&quot;pn4MsiGbBZlXeplyXg&quot;<br />
                place_url=&quot;/United+Kingdom/England&quot; woeid=&quot;24554868&quot;&gt;England, United Kingdom&lt;/region&gt;<br />
            &lt;country latitude=&quot;54.314&quot; longitude=&quot;-2.230&quot;<br />
                place_id=&quot;DevLebebApj4RVbtaQ&quot;<br />
                place_url=&quot;/United+Kingdom&quot; woeid=&quot;23424975&quot;&gt;United Kingdom&lt;/country&gt;<br />
            &lt;shapedata alpha=&quot;0.00015&quot; count_edges=&quot;16&quot;<br />
                count_points=&quot;44&quot; created=&quot;1248244568&quot; has_donuthole=&quot;0&quot; is_donuthole=&quot;0&quot;&gt;<br />
                &lt;polylines&gt;<br />
                    &lt;polyline&gt;52.155731201172,0.17115999758244 52.158447265625,0.17576499283314 52.159084320068,0.18161700665951 52.159244537354,0.18208900094032 52.15747833252,0.18410600721836 52.153221130371,0.18645000457764 52.151500701904,0.17897999286652 52.14905166626,0.17045900225639 52.136436462402,0.15260599553585 52.135303497314,0.14247800409794 52.140232086182,0.13955999910831 52.145477294922,0.14135999977589 52.145721435547,0.14150799810886 52.145240783691,0.14707000553608 52.154125213623,0.16043299436569 52.155731201172,0.17115999758244&lt;/polyline&gt;<br />
                &lt;/polylines&gt;<br />
                &lt;<acronym title="Uniform Resource Locators">URLs</acronym>&gt;<br />
                    &lt;shapefile&gt;http://farm4.static.flickr.com/3483/shapefiles/35984_20090722_6d95b5e27e.tar.gz&lt;/shapefile&gt;<br />
                &lt;/urls&gt;<br />
            &lt;/shapedata&gt;<br />
        &lt;/place&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>Brilliant, the polylines can be used draw an outline shapefile on the map.</p>
<h4>Extracting place data from find descriptions</h4>
<p><a href="http://finds.org.uk/blogs/centralunit/files/2010/05/ygeo.png" class="liimagelink" rel="lightbox[748]"><img class="alignnone size-full wp-image-823 flow " title="ygeo" src="http://finds.org.uk/blogs/centralunit/files/2010/05/ygeo.png" alt="Y!Geo tags" width="178" height="144" /></a>Many of our objects are tied by descriptive prose to various places around the World. By using Yahoo&#8217;s Placemaker, we can now extract the entities from the finds data and allow for cross referencing of all objects that have Avon, England within their description. The image below shows you where you&#8217;ll see the tags displayed on the finds record, as I&#8217;m into Classics, you&#8217;ll notice I label these with lower case Greek letters for bullets. Probably pretentious!  To get these tags is really very straightforward and can use another pretty simple YQL call, for example, this text is from the famous Moorlands Patera.</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym> toolbar="true" wraplines="true"]<br />
SELECT * FROM geo.placemaker WHERE documentContent = &quot;Only two other vessels with inscriptions naming forts on Hadrian’s Wall are known; the ‘Rudge Cup’ which was discovered in Wiltshire in 1725 (Horsley 1732; Henig 1995) and the ‘Amiens patera’ found in Amiens in 1949 (Heurgon 1951). Between them they name seven forts, but the Staffordshire patera is the first to include Drumburgh and is the only example to name an individual. All three are likely to be souvenirs of Hadrian’s Wall, although why they include forts on the western end of the Wall only is unclear&quot; AND documentType=&quot;text/plain&quot;[/html]</p>
<p>Which then produces this output in XML:</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym> toolbar="true"]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot; yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-05-05T04:26:57Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;matches&gt;<br />
            &lt;match&gt;<br />
                &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeId&gt;575961&lt;/woeId&gt;<br />
                    &lt;type&gt;Town&lt;/type&gt;<br />
                    &lt;name&gt;&lt;![CDATA[Amiens, Picardie, FR]]&gt;&lt;/name&gt;<br />
                    &lt;centroid&gt;<br />
                        &lt;latitude&gt;49.8947&lt;/latitude&gt;<br />
                        &lt;longitude&gt;2.29316&lt;/longitude&gt;<br />
                    &lt;/centroid&gt;<br />
                &lt;/place&gt;<br />
                &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeIds&gt;575961&lt;/woeIds&gt;<br />
                    &lt;start&gt;177&lt;/start&gt;<br />
                    &lt;end&gt;183&lt;/end&gt;<br />
                    &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                    &lt;text&gt;&lt;![CDATA[Amiens]]&gt;&lt;/text&gt;<br />
                    &lt;type&gt;plaintext&lt;/type&gt;<br />
                    &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                &lt;/reference&gt;<br />
                &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeIds&gt;575961&lt;/woeIds&gt;<br />
                    &lt;start&gt;201&lt;/start&gt;<br />
                    &lt;end&gt;207&lt;/end&gt;<br />
                    &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                    &lt;text&gt;&lt;![CDATA[Amiens]]&gt;&lt;/text&gt;<br />
                    &lt;type&gt;plaintext&lt;/type&gt;<br />
                    &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                &lt;/reference&gt;<br />
            &lt;/match&gt;<br />
            &lt;match&gt;<br />
                &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeId&gt;12602186&lt;/woeId&gt;<br />
                    &lt;type&gt;County&lt;/type&gt;<br />
                    &lt;name&gt;&lt;![CDATA[Wiltshire, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                    &lt;centroid&gt;<br />
                        &lt;latitude&gt;51.3241&lt;/latitude&gt;<br />
                        &lt;longitude&gt;-1.9257&lt;/longitude&gt;<br />
                    &lt;/centroid&gt;<br />
                &lt;/place&gt;<br />
                &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeIds&gt;12602186&lt;/woeIds&gt;<br />
                    &lt;start&gt;123&lt;/start&gt;<br />
                    &lt;end&gt;132&lt;/end&gt;<br />
                    &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                    &lt;text&gt;&lt;![CDATA[Wiltshire]]&gt;&lt;/text&gt;<br />
                    &lt;type&gt;plaintext&lt;/type&gt;<br />
                    &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                &lt;/reference&gt;<br />
            &lt;/match&gt;<br />
            &lt;match&gt;<br />
                &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeId&gt;12602189&lt;/woeId&gt;<br />
                    &lt;type&gt;County&lt;/type&gt;<br />
                    &lt;name&gt;&lt;![CDATA[Staffordshire, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                    &lt;centroid&gt;<br />
                        &lt;latitude&gt;52.8248&lt;/latitude&gt;<br />
                        &lt;longitude&gt;-2.02817&lt;/longitude&gt;<br />
                    &lt;/centroid&gt;<br />
                &lt;/place&gt;<br />
                &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeIds&gt;12602189&lt;/woeIds&gt;<br />
                    &lt;start&gt;276&lt;/start&gt;<br />
                    &lt;end&gt;289&lt;/end&gt;<br />
                    &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                    &lt;text&gt;&lt;![CDATA[Staffordshire]]&gt;&lt;/text&gt;<br />
                    &lt;type&gt;plaintext&lt;/type&gt;<br />
                    &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                &lt;/reference&gt;<br />
            &lt;/match&gt;<br />
            &lt;match&gt;<br />
                &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeId&gt;23509175&lt;/woeId&gt;<br />
                    &lt;type&gt;LandFeature&lt;/type&gt;<br />
                    &lt;name&gt;&lt;![CDATA[Hadrian's Wall, Bardon Mill, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                    &lt;centroid&gt;<br />
                        &lt;latitude&gt;54.9522&lt;/latitude&gt;<br />
                        &lt;longitude&gt;-2.32975&lt;/longitude&gt;<br />
                    &lt;/centroid&gt;<br />
                &lt;/place&gt;<br />
                &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                    &lt;woeIds&gt;23509175&lt;/woeIds&gt;<br />
                    &lt;start&gt;418&lt;/start&gt;<br />
                    &lt;end&gt;432&lt;/end&gt;<br />
                    &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                    &lt;text&gt;&lt;![CDATA[Hadrian’s Wall]]&gt;&lt;/text&gt;<br />
                    &lt;type&gt;plaintext&lt;/type&gt;<br />
                    &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                &lt;/reference&gt;<br />
            &lt;/match&gt;<br />
        &lt;/matches&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>In the above <acronym title="eXtensible Markup Language">XML</acronym> response, you can now see the matches that Placemaker has found in the text sent to their service. You can now parse this data and use it for tagging or any other purpose that you want to put the data to.  YQL has the added benefit of caching at the Yahoo! end and you can do multiple queries in one call as demonstrated by Chris Heilmann in his <a href="http://isithackday.com/geoplanet-explorer" title="Geoplanet explorer" class="liexternal">Geoplanet explorer.</a></p>
<h4>A YQL Multiquery example</h4>
<p>For example, I want to combine a placemaker call and also get some spatial information for a find spot where I only have the placename. To do this, I write this YQL query:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym> toolbar="true" wraplines="true"]<br />
select * from query.multi where queries=&#8217;<br />
select * from geo.placemaker where documentContent = &quot;Only two other vessels with inscriptions naming forts on Hadrian’s Wall are known the Rudge Cup which was discovered in Wiltshire in 1725 (Horsley 1732, Henig 1995) and the Amiens patera found in Amiens in 1949 (Heurgon 1951). Between them they name seven<br />
forts, but the Staffordshire patera is the first to include Drumburgh and is the only example to name an individual. All three are likely to be souvenirs of Hadrian’s Wall, although why they include forts on the western end of the Wall only is unclear&quot; and documentType=&quot;text/plain&quot; and appid=&quot;&quot;;<br />
select * from geo.places where text=&quot;staffordshire moorlands, staffordshire,uk&quot; &#8216;<br />
[/html]</p>
<p>The base <acronym title="Uniform Resource Locator">URL</acronym> to call this is the public version &#8211; http://query.yahooapis.com/v1/public/yql and as we are using one of the community tables, the call needs to be made with &amp;env=store://datatables.org/alltableswithkeys appended (urlencoded).<br />
This can be run in the <a href="http://y.ahoo.it/fx4bG5fJ" class="liexternal">console</a> and produces the following <a href="http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20query.multi%20where%20queries%3D" %20select%20*%20from%20geo.placemaker%20where%20documentContent%20%3D%20%22Only%20two%20other%20vessels%20with%20inscriptions%20naming%20forts%20on%20Hadrian%E2%80%99s%20Wall%20are%20known%20the%20Rudge%20Cup%20which%20was%20discovered%20in%20Wiltshire%20in%201725%20(Horsley%201732%2C%20Henig%201995)%20and%20the%20Amiens%20patera%20found%20in%20Amiens%20in%201949%20(Heurgon%201951).%20Between%20them%20they%20name%20seven%20forts%2C%20but%20the%20Staffordshire%20patera%20is%20the%20first%20to%20include%20Drumburgh%20and%20is%20the%20only%20example%20to%20name%20an%20individual.%20All%20three%20are%20likely%20to%20be%20souvenirs%20of%20Hadrian%E2%80%99s%20Wall%2C%20although%20why%20they%20include%20forts%20on%20the%20western%20end%20of%20the%20Wall%20only%20is%20unclear%22%20and%20documentType%3D%22text%2Fplain%22%20and%20appid%3D%22%22%3Bselect%20*%20from%20geo.places%20where%20text%3D%22staffordshire%20moorlands%2C%20staffordshire%2Cuk%22%20'&amp;env=store%3A%2F%2Fdatatables.org%2Falltableswithkeys" class="liexternal"><acronym title="eXtensible Markup Language">XML</acronym> response</a> &#8211; 4 place matches and the geo data for Staffordshire Moorlands.</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym> toolbar="true" wraplines="true"]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot;<br />
    yahoo:count=&quot;2&quot; yahoo:created=&quot;2010-09-30T11:44:08Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;results&gt;<br />
            &lt;matches&gt;<br />
                &lt;match&gt;<br />
                    &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeId&gt;575961&lt;/woeId&gt;<br />
                        &lt;type&gt;Town&lt;/type&gt;<br />
                        &lt;name&gt;&lt;![CDATA[Amiens, Picardie, FR]]&gt;&lt;/name&gt;<br />
                        &lt;centroid&gt;<br />
                            &lt;latitude&gt;49.8947&lt;/latitude&gt;<br />
                            &lt;longitude&gt;2.29316&lt;/longitude&gt;<br />
                        &lt;/centroid&gt;<br />
                    &lt;/place&gt;<br />
                    &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeIds&gt;575961&lt;/woeIds&gt;<br />
                        &lt;start&gt;196&lt;/start&gt;<br />
                        &lt;end&gt;202&lt;/end&gt;<br />
                        &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                        &lt;text&gt;&lt;![CDATA[Amiens]]&gt;&lt;/text&gt;<br />
                        &lt;type&gt;plaintext&lt;/type&gt;<br />
                        &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                    &lt;/reference&gt;<br />
                &lt;/match&gt;<br />
                &lt;match&gt;<br />
                    &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeId&gt;12602186&lt;/woeId&gt;<br />
                        &lt;type&gt;County&lt;/type&gt;<br />
                        &lt;name&gt;&lt;![CDATA[Wiltshire, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                        &lt;centroid&gt;<br />
                            &lt;latitude&gt;51.3241&lt;/latitude&gt;<br />
                            &lt;longitude&gt;-1.9257&lt;/longitude&gt;<br />
                        &lt;/centroid&gt;<br />
                    &lt;/place&gt;<br />
                    &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeIds&gt;12602186&lt;/woeIds&gt;<br />
                        &lt;start&gt;120&lt;/start&gt;<br />
                        &lt;end&gt;129&lt;/end&gt;<br />
                        &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                        &lt;text&gt;&lt;![CDATA[Wiltshire]]&gt;&lt;/text&gt;<br />
                        &lt;type&gt;plaintext&lt;/type&gt;<br />
                        &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                    &lt;/reference&gt;<br />
                &lt;/match&gt;<br />
                &lt;match&gt;<br />
                    &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeId&gt;12602189&lt;/woeId&gt;<br />
                        &lt;type&gt;County&lt;/type&gt;<br />
                        &lt;name&gt;&lt;![CDATA[Staffordshire, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                        &lt;centroid&gt;<br />
                            &lt;latitude&gt;52.8248&lt;/latitude&gt;<br />
                            &lt;longitude&gt;-2.02817&lt;/longitude&gt;<br />
                        &lt;/centroid&gt;<br />
                    &lt;/place&gt;<br />
                    &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeIds&gt;12602189&lt;/woeIds&gt;<br />
                        &lt;start&gt;271&lt;/start&gt;<br />
                        &lt;end&gt;284&lt;/end&gt;<br />
                        &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                        &lt;text&gt;&lt;![CDATA[Staffordshire]]&gt;&lt;/text&gt;<br />
                        &lt;type&gt;plaintext&lt;/type&gt;<br />
                        &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                    &lt;/reference&gt;<br />
                &lt;/match&gt;<br />
                &lt;match&gt;<br />
                    &lt;place xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeId&gt;23509175&lt;/woeId&gt;<br />
                        &lt;type&gt;LandFeature&lt;/type&gt;<br />
                        &lt;name&gt;&lt;![CDATA[Hadrian's Wall, Bardon Mill, England, <acronym title="Gigabyte">GB</acronym>]]&gt;&lt;/name&gt;<br />
                        &lt;centroid&gt;<br />
                            &lt;latitude&gt;54.9522&lt;/latitude&gt;<br />
                            &lt;longitude&gt;-2.32975&lt;/longitude&gt;<br />
                        &lt;/centroid&gt;<br />
                    &lt;/place&gt;<br />
                    &lt;reference xmlns=&quot;http://wherein.yahooapis.com/v1/schema&quot;&gt;<br />
                        &lt;woeIds&gt;23509175&lt;/woeIds&gt;<br />
                        &lt;start&gt;413&lt;/start&gt;<br />
                        &lt;end&gt;427&lt;/end&gt;<br />
                        &lt;isPlaintextMarker&gt;1&lt;/isPlaintextMarker&gt;<br />
                        &lt;text&gt;&lt;![CDATA[Hadrian&amp;rsquo;s Wall]]&gt;&lt;/text&gt;<br />
                        &lt;type&gt;plaintext&lt;/type&gt;<br />
                        &lt;xpath&gt;&lt;![CDATA[]]&gt;&lt;/xpath&gt;<br />
                    &lt;/reference&gt;<br />
                &lt;/match&gt;<br />
            &lt;/matches&gt;<br />
        &lt;/results&gt;<br />
        &lt;results&gt;<br />
            &lt;place xmlns=&quot;http://where.yahooapis.com/v1/schema.rng&quot;<br />
                xml:lang=&quot;en-US&quot; yahoo:<acronym title="Uniform Resource Identifier">URI</acronym>=&quot;http://where.yahooapis.com/v1/place/12696078&quot;&gt;<br />
                &lt;woeid&gt;12696078&lt;/woeid&gt;<br />
                &lt;placeTypeName code=&quot;10&quot;&gt;Local Administrative Area&lt;/placeTypeName&gt;<br />
                &lt;name&gt;Staffordshire Moorlands District&lt;/name&gt;<br />
                &lt;country code=&quot;<acronym title="Gigabyte">GB</acronym>&quot; type=&quot;Country&quot;&gt;United Kingdom&lt;/country&gt;<br />
                &lt;admin1 code=&quot;<acronym title="Gigabyte">GB</acronym>-ENG&quot; type=&quot;Country&quot;&gt;England&lt;/admin1&gt;<br />
                &lt;admin2 code=&quot;<acronym title="Gigabyte">GB</acronym>-STS&quot; type=&quot;County&quot;&gt;Staffordshire&lt;/admin2&gt;<br />
                &lt;admin3/&gt;<br />
                &lt;locality1/&gt;<br />
                &lt;locality2/&gt;<br />
                &lt;postal/&gt;<br />
                &lt;centroid&gt;<br />
                    &lt;latitude&gt;53.071468&lt;/latitude&gt;<br />
                    &lt;longitude&gt;-1.993490&lt;/longitude&gt;<br />
                &lt;/centroid&gt;<br />
                &lt;boundingBox&gt;<br />
                    &lt;southWest&gt;<br />
                        &lt;latitude&gt;52.916691&lt;/latitude&gt;<br />
                        &lt;longitude&gt;-2.211330&lt;/longitude&gt;<br />
                    &lt;/southWest&gt;<br />
                    &lt;northEast&gt;<br />
                        &lt;latitude&gt;53.226250&lt;/latitude&gt;<br />
                        &lt;longitude&gt;-1.775660&lt;/longitude&gt;<br />
                    &lt;/northEast&gt;<br />
                &lt;/boundingBox&gt;<br />
                &lt;areaRank&gt;6&lt;/areaRank&gt;<br />
                &lt;popRank&gt;0&lt;/popRank&gt;<br />
            &lt;/place&gt;<br />
        &lt;/results&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<h4>Concordance with other services</h4>
<p>One of the other things I am interested in, is finding concordance between WOEID and Geonames places. This is quite easy to do using another geo table. For example look up Amiens, Picardie by WOEID:</p>
<p>[<acronym title="HyperText Markup Language">HTML</acronym>]select * from geo.concordance where namespace=&quot;woeid&quot; and text=&quot;575961&quot;[/html]</p>
<p>Produces:</p>
<p>[<acronym title="eXtensible Markup Language">XML</acronym>]<br />
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;<br />
&lt;query xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot;<br />
    yahoo:count=&quot;1&quot; yahoo:created=&quot;2010-09-30T12:41:28Z&quot; yahoo:lang=&quot;en-US&quot;&gt;<br />
    &lt;results&gt;<br />
        &lt;concordance xml:lang=&quot;en-US&quot;<br />
            xmlns=&quot;http://where.yahooapis.com/v1/schema.rng&quot;<br />
            xmlns:yahoo=&quot;http://www.yahooapis.com/v1/base.rng&quot; yahoo:<acronym title="Uniform Resource Identifier">URI</acronym>=&quot;http://where.yahooapis.com/v1/concordance/woeid/575961&quot;&gt;<br />
            &lt;woeid&gt;575961&lt;/woeid&gt;<br />
            &lt;geonames&gt;3037854&lt;/geonames&gt;<br />
            &lt;locode&gt;FRAMI&lt;/locode&gt;<br />
        &lt;/concordance&gt;<br />
    &lt;/results&gt;<br />
&lt;/query&gt;<br />
[/xml]</p>
<p>So you now have a WOEID and a geonames ID. Amiens WOEID = 575961 and Geonames = 3037854. You can use the geonames id that is produced for linked data; for example: <a href="http://ws.geonames.org/rdf?geonameId=3037854" class="liexternal">http://ws.geonames.org/rdf?geonameId=3037854</a></p>
<h4>Problems using YQL for geodata</h4>
<p>Even though combining YQL with the power of Geoplanet is awesome, I did run into a few problems. None of these were really insurmountable:</p>
<ol>
<li>Hit rate limit constantly &#8211; Google&#8217;s indexing of our site was causing our server to make too many requests to YQL; fixed by changing caching model and switching to Oauth endpoint. Also I changed my code to ignore responses when the headers returned were: text/html;charset=UTF-8. The rate limit page thrown up by Yahoo! is <acronym title="HyperText Markup Language">HTML</acronym> and not an <acronym title="eXtensible Markup Language">XML</acronym> response.</li>
<li>Some places were pulled out of text when they were irrelevant &#8211; Copper Alloy, Tamil Nadu is one example. Fixed by creating a stop list</li>
<li>geonames <acronym title="Application Programming Interface">API</acronym> sometimes takes a while to respond and made application hang &#8211; changed cUrl settings</li>
<li>Took quite a long time to parse 400,000 records &#8211; can&#8217;t do much with that!</li>
</ol>
<p>However, I&#8217;d really recommend using YQL to extract geodata for your application. Hopefully, Yahoo! will maintain YQL and Geo as integral parts of their business model&#8230;. In the future, I would love to run the <a href="http://www.britishmuseum.org" class="liexternal">British Museum</a> collections data through these functions and see what cross-referencing I could find&#8230;.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/09/30/leveraging-geodata/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Six month review of new website performance</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/09/24/six-month-review/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/09/24/six-month-review/#comments</comments>
		<pubDate>Fri, 24 Sep 2010 14:13:46 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[Techie stuff]]></category>
		<category><![CDATA[Amazon S3]]></category>
		<category><![CDATA[Cloud storage]]></category>
		<category><![CDATA[search engine visibility]]></category>
		<category><![CDATA[Web statistics]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=990</guid>
		<description><![CDATA[The Scheme&#8217;s new website has been online now for 6 months and I&#8217;ve been looking at the performance and costs incurred during this period. We&#8217;ve had several large discoveries since the site went live &#8211; the Frome Hoard and the Crosby Garrett Roman Helmet for instance. However, they aren&#8217;t typical objects so we don&#8217;t get ... <a href="http://finds.org.uk/blogs/centralunit/2010/09/24/six-month-review/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p><img class="flow" title="The Crosby Garrett Helmet" src="http://finds.org.uk/documents/image/19269498b.jpg" alt="The Crosby Garrett Helmet" width="300" height="423" /></p>
<p>The Scheme&#8217;s new website has been online now for 6 months and I&#8217;ve been looking at the performance and costs incurred during this period. We&#8217;ve had several large discoveries since the site went live &#8211; the <a href="http://finds.org.uk/database/artefacts/record/id/387181" title="Frome Hoard record" class="liinternal">Frome Hoard</a> and the <a href="http://finds.org.uk/database/artefacts/record/id/404767" title="The Roman helmet record" class="liinternal">Crosby Garrett Roman Helmet</a> for instance. However, they aren&#8217;t typical objects so we don&#8217;t get the big spikes in referral from large news aggregators or providers daily. I&#8217;m a little disappointed that web traffic hasn&#8217;t grown significantly since we went live with the new site, but we&#8217;re still getting  a long period of activity/ pages viewed per visit. I&#8217;ve worked hard on search engine visibility (apart for a blip in July when I blocked all search engines via a typo in my robots.txt file &#8211; as the great Homer says, D&#8217;oh!) and we&#8217;re now seeing a surge in pages being added to Google&#8217;s index (nearly up to 50% of 400,000 publicly accessible pages now included according to webmaster tools).</p>
<h4>Web statistics</h4>
<p>All the web statistics are produced via Google Analytics, I haven&#8217;t bothered with the old logfile analysis.  The old stats that we used to return for the <acronym title="Department for Culture Media and Sport">DCMS</acronym> and quoted in our annual reports were heavily reliant on &#8216;hits&#8217;, a metric I always hated.  Some simple observations:</p>
<ul>
<li> We get a trend of heavy weekday usage, with noticeable dips at weekends when recording isn&#8217;t as prevalent.
<p><div id="attachment_1006" class="wp-caption alignnone" style="width: 310px"><a href="http://finds.org.uk/blogs/centralunit/files/2010/09/pattern.jpg" class="liimagelink" rel="lightbox[990]"><img class="size-medium wp-image-1006" title="Typical weekly pattern" src="http://finds.org.uk/blogs/centralunit/files/2010/09/pattern-300x44.jpg" alt="Typical weekly pattern" width="300" height="44" /></a><p class="wp-caption-text">Typical weekly pattern</p></div></li>
<li>We don&#8217;t get a huge audience, our topic is pretty niche, but hopefully it will keep increasing.</li>
<li>Overall visitors average 10mins 59 seconds on site and view nearly 14 pages a visit, with a bounce rate of 37.46%.</li>
<li>Those visits that are mainly within the confines of the database module average 21 pages per visit and around 17 mins 17 seconds, with a bounce rate of 23.62%</li>
<li>We had significant surges in traffic on the days that Frome and Crosby Garrett were announced (8th July and 14th September)</li>
<li>14% of our users who are stuck with <acronym title="Internet Explorer - it sucks">IE</acronym> use version 6. Guess where the majority of these poor people are based&#8230; Government sector offices.</li>
<li>149 countries are representing as having visited; the top two countries are the UK (76% of total) and USA (7%) which account. I assume, this is mainly because our subject material is mainly centred on England &amp; Wales. It would be great if we could penetrate the archaeological syllabus in other countries as we have such a mass of data to play with.</li>
<li>We have now consolidated our domains down to one so our previous webstats definitely gave a false measure of usage of our resources.</li>
<li>We have 66 partner organisations and 3 main funders/hosting organisations; <acronym title="Museums, Libraries and Archives Council">MLA</acronym>, British Museum and <acronym title="Department for Culture Media and Sport">DCMS</acronym>. We get very little referral traffic from any of these as shown here: <acronym title="The British Museum">BM</acronym> &#8211; 2,495 referrals, <acronym title="Museums, Libraries and Archives Council">MLA</acronym> &#8211; 64 referrals, <acronym title="Department for Culture Media and Sport">DCMS</acronym> &#8211; 60 referrals. I think it is a shame a flagship project doesn&#8217;t get more click through, but then it is hard to position us higher on these sites as there is so much culture to promote. However, <acronym title="Museums, Libraries and Archives Council">MLA</acronym>&#8217;s description of our project is rather out of date.</li>
<li>Google accounts for 45.88% of the originating point for traffic to our site, Yahoo for 0.84% and Bing 0.80%</li>
<li>In the 6 month period, we have had 130,235 visits;  1,788,580 page views; 65,531 Visitors. Compared to the same period last year, (which coincidentally ends with the day that the Staffordshire Hoard was announced, we had 95,902 visits; 514,341 page views; 57,990 visitors &#8211; all figures for finds.org.uk and for findsdatabase.org.uk we had: 48,786 visits; 1,185,537 page views; 17,767 visitors). All these figures are devoid of usage of <acronym title="eXtensible Markup Language">XML</acronym>/JSON/KML functions and feeds.</li>
<li>A more detailed breakdown can be found in <a href="http://finds.org.uk/blogs/centralunit/files/2010/09/findsorguk.pdf" class="lipdf">this <acronym title="Portable Document Format">PDF</acronym></a></li>
</ul>
<h4>New functions</h4>
<p>Since launch, we&#8217;ve  released lots of new features, all based on <a href="http://framework.zend.com" class="liexternal">Zend framework</a> code:</p>
<ul>
<li>More extensive mining of <a href="http://www.theyworkforyou.com" class="liexternal">theyworkforyou</a> for Parliamentary data
<ul>
<li>Finds by constituency boundary, for example the <a href="http://finds.org.uk/news/theyworkforyou/finds/constituency/Arundel+and+South+Downs" class="liinternal">Arundel consituency</a></li>
<li>Data on local MP, for example <a href="http://finds.org.uk/news/theyworkforyou/mp/id/10777" title="David Cameron's details" class="liinternal">David Cameron</a></li>
<li>Number of Scheduled monuments within boundary</li>
</ul>
</li>
<li>Heavy use of YQL throughout the website
<ul>
<li><a href="http://www.finds.org.uk/flickr" class="liinternal">Flickr images</a> pulled in</li>
<li>Oauth YQL calls to make use of Yahoo! geo functions</li>
</ul>
</li>
<li>Created a load of YQL tables for Museum and heritage website <acronym title="Application Programming Interface">API</acronym> and opensearch modules</li>
<li>Integrated Geoplanet&#8217;s data into database backend from their data dump</li>
<li>Added old OS maps from the National Library of Scotland (these are great and easy to implement) to most of our maps, for example a search for &#8216;<a href="http://finds.org.uk/database/search/map/description/sompting" title="Sompting finds mapped" class="liinternal">Sompting</a>&#8216; axeheads and click on &#8216;historical&#8217;</li>
<li>Integrated the <a href="http://finds.org.uk/blogs/centralunit/2010/05/24/os150k/" class="liinternal">Ordnance Survey 1:50K dataset</a> for antiquities and Roman sites</li>
<li>Integrated the English Heritage Scheduled Monuments dataset (only available to higher level users.)</li>
<li>Pulled in data from Amazon for our references (prices, book cover art etc) for example <a href="http://finds.org.uk/database/publications/publication/id/1390" title="View a reference with Amazon data pulled in" class="liinternal">&#8216;Toys, trifles and trinkets&#8217;</a> by Egan and Forsyth</li>
<li>Mined the Guardian <acronym title="Application Programming Interface">API</acronym> for news relating to the Scheme</li>
<li>Created functions for the public to record their own objects and find previously recorded ones easily. This has been quite well received, see <a href="http://finds.org.uk/blogs/centralunit/2010/09/20/my-experience-of-self-recording-on-the-database/" class="liinternal">Garry Crace&#8217;s article</a> on how he found it.</li>
<li>Used some semantic techniques (<acronym title="Friend Of A Friend is a RDF dialect for describing relationships">FOAF</acronym> for example &#8211; our <a href="http://www.finds.org.uk/contacts/" class="liinternal">contacts</a> page uses this in rdfa)</li>
<li>Context switched formats for a wide array of pages across the site</li>
<li>Got <a href="http://www.finds.org.uk/database/oai" title="Get access to our oai interface" class="liinternal">OAI access</a> working</li>
<li>Created extensive <a href="http://www.finds.org.uk/info/sitemap" title="Our sitemap index file" class="liinternal">sitemaps</a> for search indexing</li>
</ul>
<h4>Database statistics</h4>
<p>Some raw statistics of progress with the new database can be seen below:</p>
<p>24601 records have been created which documents the discovery and recording of 94,978 objects (one hoard of coins adds 52,503 objects alone &#8211; so remove these and you get  42475 objects). We also released functions that allowed the public to record their own objects, and this has resulted in the addition of 740 records from 32 recorders. We expect this number to increase following the release of an instructional guide produced by our Kent FLA and <acronym title="Finds Liaison Officer">FLO</acronym> &#8211; (Jess Bryan and <a href="http://finds.org.uk/contacts/staff/profile/id/123" title="Jen's profile" class="liinternal">Jen Jackson</a>).</p>
<h4>Users</h4>
<p>User accounts created: 855 with no spam accounts created so far.</p>
<ul>
<li>2 Finds Adviser status</li>
<li>38	Finds Liaison Officer status</li>
<li>13	Historic Environment Officer status</li>
<li>745	ordinary members</li>
<li>57	Research status accounts</li>
</ul>
<p>In the previous existence of our database over at <a href="http://www.findsdatabase.org.uk" class="liexternal">findsdatabase.org.uk</a>, we had 1135 accounts created in 7 years.</p>
<h4>Research</h4>
<p>58 new research projects have been added to our research register with the following levels of activity:</p>
<ul>
<li><a href="http://finds.org.uk/research/projects/level/1/Undergraduate" class="liinternal">7	Undergraduate</a></li>
<li><a href="http://finds.org.uk/research/projects/level/2/Masters+degree" class="liinternal">20	Masters degree</a></li>
<li><a href="http://finds.org.uk/research/projects/level/3/PhD+level+research" class="liinternal">12	PhD level research</a></li>
<li><a href="http://finds.org.uk/research/projects/level/4/Large+scale+research+AHRC" class="liinternal">3	Large scale research AHRC</a></li>
<li><a href="http://finds.org.uk/research/projects/level/5/Major+publication" class="liinternal">3	Major publication</a></li>
<li><a href="http://finds.org.uk/research/projects/level/6/Magazine+journal+article" class="liinternal">1	Magazine/journal article</a></li>
<li><a href="http://finds.org.uk/research/projects/level/7/Desk+based+assessment" class="liinternal">1	Desk based assessment</a></li>
<li><a href="http://finds.org.uk/research/projects/level/9/Personal+research+project" class="liinternal">10	Personal research project</a></li>
<li><a href="http://finds.org.uk/research/projects/level/10/Archaeology+society+project" class="liinternal">1	Archaeology society project</a></li>
</ul>
<p>962,601 searches have been performed since relaunch. We&#8217;ve had 132 reports of incorrect data being published on our data (undoubtedly, there are more errors, people are just shy!) and 250-ish comments on records. These functions are both protected by reCaptchas and akismet and we&#8217;ve had 5 spam submissions in 6 months.</p>
<h4>Contributors of data</h4>
<p>943 new contributors have offered data for recording or become involved by recording or researching. I&#8217;m tidying up the database so that we can do better analysis of what people use our facility for. We now collect primary activity and postcodes, so that we can do some better statistical analysis.</p>
<h4>Running costs for following domains:</h4>
<p><a href="http://www.finds.org.uk" class="liinternal">www.finds.org.uk</a><br />
<a href="http://www.findsdatabase.org.uk" class="liexternal">www.findsdatabase.org.uk</a><br />
<a href="http://www.staffordshirehoard.org.uk" class="liexternal">www.staffordshirehoard.org.uk</a><br />
<a href="http://www.pastexplorers.org.uk" class="liexternal">www.pastexplorers.org.uk</a></p>
<p>Server farm hosting fee: £828<br />
Bandwidth cost for excess load: £234<br />
Remote backup space: £900 (350GB images)<br />
Amazon S3 backup space: £0.27 ($0.42) for (11GB data transfer of <acronym title="MySQL database">MySQL</acronym> backups)<br />
Flickr licence: £15.30 ($24)<br />
Get satisfaction account: £36.38 ($57) which I cancelled after 3 months due to the fact it was underused.</p>
<p>Development costs: Covered by my salary, not revealing that.</p>
<p>Total IT cost for running: £2013.95 (or around 8p per record or a more meaningless statistic because of the huge hoard, of circa 2p per object)<br />
We plan to make this reduce further by switching backup to S3 for images as well or renegotiating with our excellent providers at Dedipower in Reading. Since the demise of Oxford ArchDigital, we&#8217;ve already made IT cost savings of c. £15,000 per annum in support fees and also all development work has been taken on in house.</p>
<p>Hopefully people are finding our new site much more useful, we&#8217;ve got more stuff to come&#8230;.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/09/24/six-month-review/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Digging for Britain&#8217;s viewing figures</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/09/24/digging-for-britains-viewing-figures/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/09/24/digging-for-britains-viewing-figures/#comments</comments>
		<pubDate>Fri, 24 Sep 2010 08:08:33 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[archaeology]]></category>
		<category><![CDATA[Archaeology in the media]]></category>
		<category><![CDATA[Television]]></category>
		<category><![CDATA[BBC Two]]></category>
		<category><![CDATA[Britain]]></category>
		<category><![CDATA[Broadcasters' Audience Research Board]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=987</guid>
		<description><![CDATA[The recent BBC2 series on archaeology, &#8216;Digging for Britain&#8217;, was relatively well received in terms of viewer numbers. The Broadcasters&#8217; Audience Research Board figures show the following figures (all figures are in millions of viewers): BBC2 w/e 22 Aug 2010 MATCH OF THE DAY (SUN 2202) 3.42 DRAGONS&#8217; DEN (MON 2102) 3.11 COAST (WED 2000) ... <a href="http://finds.org.uk/blogs/centralunit/2010/09/24/digging-for-britains-viewing-figures/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p><img class="flow" title="Alice Roberts in PAS towers" src="http://www.bbc.co.uk/blogs/tv/100811_Coins_300.jpg" alt="Alice Roberts in PAS towers" width="300" height="400" />The recent BBC2 series on archaeology, &#8216;Digging for Britain&#8217;, was relatively well received in terms of viewer numbers. The Broadcasters&#8217; Audience Research Board <a href="http://www.barb.co.uk/report/weeklyTopProgrammesOverview?" class="liexternal">figures</a> show the following figures (all figures are in millions of viewers):</p>
<p>BBC2 w/e 22 Aug 2010</p>
<ol>
<li>MATCH OF THE DAY (SUN 2202)	3.42</li>
<li>DRAGONS&#8217; DEN (MON 2102)	3.11</li>
<li>COAST (WED 2000)	2.84</li>
<li>THE NORMANS (WED 2101)	2.82</li>
<li><strong>DIGGING FOR BRITAIN (THU 2101)	2.75 &#8211; Romans, with lots of <acronym title="Portable Antiquities Scheme">PAS</acronym> stuff</strong></li>
<li>UNIVERSITY CHALLENGE (MON 2001)	2.49</li>
<li>THE GREAT BRITISH BAKE OFF (TUE 2001)	2.24</li>
<li>THE NATURAL WORLD (THU 2001)	2.19</li>
<li>VEXED (SUN 2102)	2.09</li>
<li>HAVE I GOT A LITTLE BIT MORE NEWS FOR YO (SAT 2101)	1.99</li>
</ol>
<p>BBC2 w/e 22 Aug 2010</p>
<ol>
<li>DRAGONS&#8217; DEN (MON 2102)	3.17</li>
<li>MATCH OF THE DAY (SUN 2201)	3.12</li>
<li>THE GREAT BRITISH BAKE OFF (TUE 2000)	3.00</li>
<li>COAST (WED 2001)	2.94</li>
<li>UNIVERSITY CHALLENGE (MON 2000)	2.59</li>
<li><strong>DIGGING FOR BRITAIN (THU 2101)	2.34 &#8211; Prehistory featuring Ben Roberts lovefest</strong></li>
<li>HAVE I GOT A LITTLE BIT MORE NEWS FOR YO (SAT 2103	2.29</li>
<li>DAD&#8217;S ARMY (SAT 2032)	2.23</li>
<li>EGGHEADS (THU 1800)	2.16</li>
<li>EGGHEADS (WED 1759)	2.13</li>
</ol>
<p>BBC2 w/e 5 Sep 2010</p>
<ol>
<li>COAST (WED 2002)	3.42</li>
<li>THE GREAT BRITISH BAKE OFF (TUE 2002)	3.00</li>
<li>DRAGONS&#8217; DEN (MON 2102)	2.98</li>
<li>ALEX HIGGINS: THE PEOPLE&#8217;S CHAMPION (WED 2102)	2.97</li>
<li>UNIVERSITY CHALLENGE (MON 2002)	2.78</li>
<li><strong>DIGGING FOR BRITAIN (THU 2101)	2.45 &#8211; Anglo-Saxons</strong></li>
<li>ANTIQUES MASTER (MON 2032)	2.12</li>
<li>E NUMBERS: AN EDIBLE ADVENTURE (THU 2001)	1.98</li>
<li>EGGHEADS (MON 1800)	1.96</li>
<li>EGGHEADS (WED 1800)	1.94</li>
</ol>
<p>The only programme I can&#8217;t find figures for, is the last on the Tudors. That didn&#8217;t seem to be as strong and was shifted to a Friday night slot. (I fell asleep in it). The figures of over 2 million viewers consistently, may give hope for a second series being recommissioned; however, can it sustain the current format of a period per show? Will it rely on Alice Roberts as a presenter?</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/09/24/digging-for-britains-viewing-figures/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>My experience of self-recording on the database</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/09/20/my-experience-of-self-recording-on-the-database/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/09/20/my-experience-of-self-recording-on-the-database/#comments</comments>
		<pubDate>Mon, 20 Sep 2010 08:13:48 +0000</pubDate>
		<dc:creator>Garry Crace</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[portable antiquities]]></category>
		<category><![CDATA[Databases]]></category>
		<category><![CDATA[Sussex]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=952</guid>
		<description><![CDATA[Well the long awaited new PAS database has landed and users out there in the land of archaeology and historical research are busying themselves adding new artefacts and data mining this fantastic and unique historical resource.  Dan the database builder man has received some well deserved plaudits for his new creation; a work of love ... <a href="http://finds.org.uk/blogs/centralunit/2010/09/20/my-experience-of-self-recording-on-the-database/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>Well the long awaited new <a href="http://www.finds.org.uk/database" title="View database of Antiquities" class="liinternal"><acronym title="Portable Antiquities Scheme">PAS</acronym> database</a> has landed and users out there in the land of archaeology and historical research are busying themselves adding new artefacts and data mining this fantastic and unique historical resource.  <a href="http://www.finds.org.uk/contacts/staff/profile/id/3" title="Dan's profile on the database" class="liinternal">Dan</a> the database builder man has received some well deserved plaudits for his new creation; a work of love if ever there was one, created entirely on a shoestring with fewer servers than Wimbledon in the closed season!</p>
<p>Time has elapsed since the beta launch and users have started to settle in to the day to day interaction using established as well as the new features it has to offer.  One of the principal benefits of the new database is the ability Joe Public now has to self-record any qualifying discoveries made.</p>
<p>I belong to a trio of detectorists called the Sussex Pastfinders, like many, our ethos is to give identity,  location and historical context to what we find, such that landowners, farmers, archaeologists, historians, scholars and the public alike can all benefit from the results.  As such we undertake a variety of local history projects, with all our qualifying finds being recorded with the <acronym title="Portable Antiquities Scheme">PAS</acronym> and each project illustrated and formally written up.  Whilst the majority of what we find we can identify ourselves, often the finer points elude us, and very occasionally we are closer to clueless.  In the peak detecting season we would see our heavily worked <acronym title="Finds Liaison Officer">FLO</acronym> starting to drown in the flood of recovered objects from across Sussex.  Given our reliance on the <acronym title="Portable Antiquities Scheme">PAS</acronym> to help complete our project reports, and with us working to promised landowner deadlines, we would often create pressure on the system and develop a backlog of finds for recording.  The new self-recording feature therefore now enables us to give some assistance in getting our finds landed professionally on the database.</p>
<p>As a self-recorder there is a wide spectrum of find data entry for the individual to get involved in.  At its most basic only the <em>object type</em> and <em>broad period</em> have to be completed before the record can be saved.  The system automatically generates a unique “PUBLIC” find number.  Keeping this number together with the find when handing it over to the <acronym title="Finds Liaison Officer">FLO</acronym> will help facilitate and smooth the recording process considerably and improve process efficiently.  The only kit required to do this is a computer with web access.  Subsequently the <acronym title="Finds Liaison Officer">FLO</acronym> will complete the required database fields and “promote” the object to be visible to all.  At the high-level end of the self-recording spectrum is the full identification, annotation and illustration of the find.  If this is done to the necessary <acronym title="Portable Antiquities Scheme">PAS</acronym> standard in the first instance, then with a ‘rubber-stamp’ of approval from the <acronym title="Finds Liaison Officer">FLO</acronym> the find is promoted to full view.</p>
<p><img style="float: right;" src="http://www.finds.org.uk/images/thumbnails/288126.jpg" alt="PUBLIC-E92C88" /><acronym title="The Portable Antiquities Scheme"><acronym title="Portable Antiquities Scheme">PAS</acronym></acronym> record number: PUBLIC-E92C88<br />
Object type: Scraper (tool)<br />
Broadperiod: Neolithic<br />
County of discovery: East Sussex<br />
Stable url: <a href="http://www.finds.org.uk/database/artefacts/record/id/391660" title="PUBLIC-E92C88: a Neolithic Scraper (tool)" class="liinternal">http://www.finds.org.uk/database/artefacts/record/id/391660</a></p>
<h4>Fig 1: An example record I recorded on the Scheme database.</h4>
<p>However, this Full-Monty recording does require access to comprehensive <a href="http://www.finds.org.uk/database/publications" title="A list of reference material for recording finds" class="liinternal">reference material</a>, a balance accurate to a hundredth of a gram, a vernier gauge, and a reasonable macro photography set-up.  There are of course all points in between the two extremes.  The database entry is very intuitive, most of the fields are not free-form but simple to use drop down boxes, and if an error is made there is a simple edit option that allows the record to be corrected.  The arrangement I have with <a href="http://www.finds.org.uk/contacts/staff/profile/id/119" title="Laura's profile on the Scheme database" class="liinternal">Laura</a> our Sussex <acronym title="Finds Liaison Officer">FLO</acronym> is that if there are any gaps or clarification points in a record I have created then a few words of explanation are placed in the notes section of the record.  These are spotted on review, the record adjusted and the discussion notes deleted before it is promoted on the database.</p>
<p>Full Monty recording is a bit of an eye opener as to the required intricacies of find identification and recording procedures.  Clearly in a database of this size with many individuals inputting data, accuracy and consistency are paramount.  Researchers and the like are searching against various entry fields and if the recorders are logging objects differently the search function will not work accurately.  Following a day’s training from Laura I came to realise the conveyor belt of find identification moves at a speed required to ensure standards are upheld; moreover the standards are high and as you would expect professional.  <strong>If you don’t know the exact Parish you don’t guess you find out.</strong> If you can’t remember the exact object reference, then being vague will not do.  There is also a comprehensive guideline document that is issued to ensure overriding principles are followed and a ‘<a href="http://www.finds.org.uk/database/terminology/" title="The Scheme's controlled vocabulary" class="liinternal">controlled vocabulary</a>’ is published on the database itself as a reference to help ensure consistency of language.  The job done by our FLOs is sometimes unsung, seeing what’s involved makes you realise that what they do, for many if not all, is a vocation rather than a job, done for love not money – well done guys –much respect.</p>
<p>The biggest challenge I have found in self-recording on the database is the proper description of the object.  The guidelines are there to be followed but people express themselves in different ways.  There is obviously some latitude but the aim is to make the description self-contained.  Having produced a masterpiece of language without disappearing up your own dangling participle, the acid test is that given only the finished written description, could the find be fully understood and interpreted by the reader &#8211; it’s tougher to achieve than you think, especially when your spectacle buckles sound like bifocals!</p>
<p>With the two ends of the self-recording spectrum and indeed with all points in between, being able to personally contribute to a national database of this standing is unparalleled.  For me there is a satisfaction and pride to be taken in helping to see the whole process through from beginning to end, finishing in the knowledge that prior to your actions an historic prospective-find that was degrading somewhere in a field, and that perhaps in a few years time there would be nothing more than a stain left in the ground to betray its former presence.  Along you came, researched the location avoiding any archaeological sensitivity, land designations or schemes, found out who owned the land, gained their precious permission and that of the tenant farmer, spent hours searching and finally made the find.  It seems only fitting then to want to participate in completing the job by fully identifying and recording it.  So instead of just an anonymous stain in the ground, a historical object is saved from that oblivion, correctly identified, and has the best possible context restored to it for all to see, access, enjoy, and draw conclusions from.</p>
<p>At the time of writing there are over 700 <strong>PUBLIC</strong> recorded finds on the database, a number which is growing all the time (you can only view the ones that are promoted to public view &#8211; for example this <a href="http://www.finds.org.uk/database/artefacts/index/old_findID/PUBLIC/" title="View all public records that are available" class="liinternal">search result</a>.  If you would like to become a self-recorder at whatever level then do have a chat with your <a href="http://www.finds.org.uk/contacts" title="Find your local FLO's details" class="liinternal"><acronym title="Finds Liaison Officer">FLO</acronym></a> and come to your own mutually agreeable arrangement as to how to record your finds.  If training is required they will I know be happy to oblige.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/09/20/my-experience-of-self-recording-on-the-database/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Digging for Britain &#8211; BBC2</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/08/16/digging-for-britain-bbc2/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/08/16/digging-for-britain-bbc2/#comments</comments>
		<pubDate>Mon, 16 Aug 2010 13:08:50 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Alice Roberts]]></category>
		<category><![CDATA[BBC Two]]></category>
		<category><![CDATA[The Telegraph]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=969</guid>
		<description><![CDATA[This week sees the beginning of the new BBC2 series entitled &#8216;Digging for Britain&#8217;; it is presented by Alice Roberts and produced by 360 Production and sees heavy involvement from the Scheme and features several high profile discoveries. The screening dates are: Episode 1 Romans – Thursday 19/08/10 21:00 BBC2 Episode 2 Pre-history – Thursday ... <a href="http://finds.org.uk/blogs/centralunit/2010/08/16/digging-for-britain-bbc2/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>This week sees the beginning of the new BBC2 series entitled &#8216;Digging for Britain&#8217;; it is presented by Alice Roberts and produced by <a href="http://www.360production.com/index.php/2010/04/digging-for-britain/" title="360 Production's website" class="liexternal">360 Production</a> and sees heavy involvement from the Scheme and features several high profile discoveries. The screening dates are:</p>
<ul>
<li>Episode 1 Romans – Thursday 19/08/10 21:00 BBC2</li>
<li>Episode 2 Pre-history – Thursday 26/08/10 21:00 BBC2</li>
<li>Episode 3 Anglo-Saxon – Thursday 02/09/10 21:00 BBC2</li>
<li>Episode 4 Tudors – Thursday 09/09/10 21:00 BBC2</li>
</ul>
<p>The preview videos from 360 Production below, gives you some more details about what the series will feature, the first introduces the series and makes reference to the 360 production website; the second features one of the Scheme&#8217;s alumni, Caroline McDonald:<br />
<object id="flashObj" classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="480" height="270" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="bgcolor" value="#FFFFFF" /><param name="flashVars" value="videoId=97158122001&amp;playerID=69701127001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" /><param name="base" value="http://admin.brightcove.com" /><param name="seamlesstabbing" value="false" /><param name="allowFullScreen" value="true" /><param name="swLiveConnect" value="true" /><param name="allowScriptAccess" value="always" /><param name="src" value="http://c.brightcove.com/services/viewer/federated_f9?isVid=1&amp;isUI=1" /><param name="name" value="flashObj" /><param name="flashvars" value="videoId=97158122001&amp;playerID=69701127001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" /><param name="allowfullscreen" value="true" /><embed id="flashObj" type="application/x-shockwave-flash" width="480" height="270" src="http://c.brightcove.com/services/viewer/federated_f9?isVid=1&amp;isUI=1" name="flashObj" allowscriptaccess="always" swliveconnect="true" allowfullscreen="true" seamlesstabbing="false" base="http://admin.brightcove.com" flashvars="videoId=97158122001&amp;playerID=69701127001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" bgcolor="#FFFFFF"></embed></object></p>
<p><object id="flashObj" classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="480" height="270" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="bgcolor" value="#FFFFFF" /><param name="flashVars" value="videoId=97158157001&amp;playerID=69701126001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" /><param name="base" value="http://admin.brightcove.com" /><param name="seamlesstabbing" value="false" /><param name="allowFullScreen" value="true" /><param name="swLiveConnect" value="true" /><param name="allowScriptAccess" value="always" /><param name="src" value="http://c.brightcove.com/services/viewer/federated_f9?isVid=1&amp;isUI=1" /><param name="name" value="flashObj" /><param name="flashvars" value="videoId=97158157001&amp;playerID=69701126001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" /><param name="allowfullscreen" value="true" /><embed id="flashObj" type="application/x-shockwave-flash" width="480" height="270" src="http://c.brightcove.com/services/viewer/federated_f9?isVid=1&amp;isUI=1" name="flashObj" allowscriptaccess="always" swliveconnect="true" allowfullscreen="true" seamlesstabbing="false" base="http://admin.brightcove.com" flashvars="videoId=97158157001&amp;playerID=69701126001&amp;playerKey=AQ%2E%2E,AAAAD0_ZRwk%2E,IdD7rBQ-Sp80c4RSCkREBK5OUDtPKYlN&amp;domain=embed&amp;dynamicStreaming=true" bgcolor="#FFFFFF"></embed></object></p>
<p>You can read more about this production on 360&#8242;s <a href="http://www.360production.com/index.php/2010/08/digging-for-britain-bbc2/" class="liexternal">blog</a> and there&#8217;s a few newspaper articles already floating around (listed below):</p>
<ul>
<li><a href="http://www.telegraph.co.uk/culture/tvandradio/bbc/7944849/Digging-for-history...-but-its-not-Time-Team.html" class="liexternal">The Telegraph</a></li>
</ul>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/08/16/digging-for-britain-bbc2/feed/</wfw:commentRss>
		<slash:comments>11</slash:comments>
		</item>
		<item>
		<title>Adding old OS maps to findspot maps</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/08/06/adding-old-os-maps-to-findspot-maps/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/08/06/adding-old-os-maps-to-findspot-maps/#comments</comments>
		<pubDate>Fri, 06 Aug 2010 16:32:16 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[Geospatial]]></category>
		<category><![CDATA[Techie stuff]]></category>
		<category><![CDATA[David Haskiya]]></category>
		<category><![CDATA[JavaScript]]></category>
		<category><![CDATA[National Library of Scotland]]></category>
		<category><![CDATA[United Kingdom]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=956</guid>
		<description><![CDATA[Today on Twitter, David Haskiya alerted me to a set of old Ordnance Survey maps that have been scanned by the National Library of Scotland and turned into the  &#8216;NLS Maps API: Historic map of Great Britain for use in mashups&#8217;. These old maps are really useful (they cover England and Wales as well as ... <a href="http://finds.org.uk/blogs/centralunit/2010/08/06/adding-old-os-maps-to-findspot-maps/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>Today on Twitter, David Haskiya <a href="http://twitter.com/DavidHaskiya/status/20468427452" class="liexternal">alerted me</a> to a set of old Ordnance Survey maps that have been scanned by the National Library of Scotland and turned into the  &#8216;<a href="http://geo.nls.uk/maps/api/" title="Detailed instructions on how to use the NLS api" class="liexternal">NLS Maps <acronym title="Application Programming Interface">API</acronym></a>: Historic map of Great Britain for use in mashups&#8217;. These old maps are really useful (they cover England and Wales as well as Scotland!) for the work that our Finds Liaison Officers do, or for researchers using our database. Low level phenomenological research can be conducted.  Their instructions are pretty straightforward to follow and I have now added this layer to our findspot mapping (at the moment just for higher level users). The image below gives an example of the embedded Googlemap that we can produce from these OS tiles:</p>
<p><a href="http://finds.org.uk/blogs/centralunit/files/2010/08/oldmap.jpg" class="liimagelink" rel="lightbox[956]"><img class="alignnone size-full wp-image-957" title="Old Map from NLS" src="http://finds.org.uk/blogs/centralunit/files/2010/08/oldmap.jpg" alt="Old Map from NLS" width="763" height="465"  rel="lightbox"/></a></p>
<p>Our maps now have the following layers:</p>
<ul>
<li>Satellite</li>
<li>Terrain</li>
<li>Openstreetmap</li>
<li>Google Earth</li>
<li>Basic map</li>
<li>Hybrid</li>
<li>Historical</li>
</ul>
<p>To implement this layer all you need to do is the following (I have Jquery as my javascript framework), firstly add the Javascript file that runs their tileserver to either your head tags or before the closing body tag of your <acronym title="HyperText Markup Language">HTML</acronym> document.</p>
<p>[javascript]<br />
&lt;script type=&quot;text/javascript&quot; src=&quot;http://nls.tileserver.com/api.js&quot;&gt;&lt;/script&gt;<br />
[/javascript]</p>
<p>Then you need to initiate the layer and add the historical map button and copyright layer:</p>
<p>[javascript]</p>
<p>var copyright = new GCopyright(1, new GLatLngBounds(new GLatLng(-90, -180),new GLatLng(90, 180)), 1,<br />
&quot;Historical maps from &lt;a href=&#8217;http://geo.nls.uk/maps/api/&#8217;&gt;NLS Maps <acronym title="Application Programming Interface">API</acronym>&lt;\/a&gt;&quot;);<br />
var copyrightCollection = new GCopyrightCollection();<br />
copyrightCollection.addCopyright(copyright);var tilelayer = new GTileLayer(copyrightCollection, 1, NLSTileUrlOS(&#8216;MAXZOOM&#8217;));<br />
tilelayer.getTileUrl = NLSTileUrlOS;</p>
<p>var nlsmap = new GMapType([tilelayer], G_NORMAL_MAP.getProjection(), &quot;Historical&quot;);<br />
[/javascript]</p>
<p>You will then need to add the map type to your mapping script by adding the following javascript:</p>
<p>[javascript]</p>
<p>map.addMapType(nlsmap);</p>
<p>[/javascript]</p>
<p>So for example my code for running our map looks like the below (and I add this before the closing body tags, and using Zend Framework&#8217;s inlineScript syntax within my <acronym title="Hypertext PreProcessing">PHP</acronym> script:</p>
<p>[javascript]<br />
&lt;script type=&quot;text/javascript&quot; src=&quot;&lt;a href=&quot;http://nls.tileserver.com/api.js&quot;&gt;http://nls.tileserver.com/api.js&lt;/a&gt;&quot;&gt;&lt;/script&gt;<br />
&lt;script type=&quot;text/javascript&quot; src=&quot;&lt;a href=&quot;http://maps.google.com/maps?file=<acronym title="Application Programming Interface">API</acronym>&amp;amp;v=2.x&amp;key=ABQIAAAAasv4kXXJ0jQKvwOWfHsLjBSlEYz08iyooQyuh_EGbYeUie1elhTVaZDZHd9xfLdYKWAVz9b3bDuvKA&quot;&gt;http://maps.google.com/maps?file=<acronym title="Application Programming Interface">API</acronym>&amp;amp;amp;v=2.x&amp;amp;key={key}&lt;/a&gt;&quot;&gt;&lt;/script&gt;<br />
&lt;script type=&quot;text/javascript&quot; src=&quot;&lt;a href=&quot;http://gmaps-utility-library.googlecode.com/svn/trunk/mapiconmaker/1.0/src/mapiconmaker.js&quot;&gt;http://gmaps-utility-library.googlecode.com/svn/trunk/mapiconmaker/1.0/src/mapiconmaker.js&lt;/a&gt;&quot;&gt;&lt;/script&gt;<br />
&lt;script type=&quot;text/javascript&quot;&gt;<br />
    //&lt;![CDATA[<br />
$(document).ready(function() {</p>
<p>if (GBrowserIsCompatible()) {</p>
<p>//Set up the NLS layer</p>
<p>var copyright = new GCopyright(1, new GLatLngBounds(new GLatLng(-90, -180),new GLatLng(90, 180)), 1,<br />
	&quot;Historical maps from &lt;a href='http://geo.nls.uk/maps/api/'&gt;NLS Maps <acronym title="Application Programming Interface">API</acronym>&lt;\/a&gt;&quot;);<br />
var copyrightCollection = new GCopyrightCollection();<br />
copyrightCollection.addCopyright(copyright);<br />
var tilelayer = new GTileLayer(copyrightCollection, 1, NLSTileUrlOS('MAXZOOM'));<br />
tilelayer.getTileUrl = NLSTileUrlOS;<br />
var nlsmap = new GMapType([tilelayer], G_NORMAL_MAP.getProjection(), &quot;Historical&quot;);</p>
<p>//Set up the openstreet map layer</p>
<p>var copyOSM = new GCopyrightCollection(&#8216;&lt;a href=&quot;http://www.openstreetmap.org/&quot;&gt;OpenStreetMap&lt;/a&gt;&#8217;);<br />
  copyOSM.addCopyright(new GCopyright(1,<br />
    new GLatLngBounds(new GLatLng(-90, -180), new GLatLng(90, 180)),<br />
    0, // minimum zoom level<br />
    &#8216; &#8216; // no additional copyright message, but empty string hides entire copyright<br />
  ));<br />
var osmLayer = new GTileLayer(copyOSM, 0, 18, {<br />
		tileUrlTemplate: &#8216;http://b.tile.cloudmade.com/BC9A493B41014CAABB98F0471D759707/998/256/{Z}/{X}/{Y}.png&#8217;,<br />
		isPng: true,<br />
		opacity: 1.0<br />
		});</p>
<p>var osmMap = new GMapType(<br />
		[osmLayer], // list of layers<br />
		G_NORMAL_MAP.getProjection(), // borrow the Mercator projection from the standard map<br />
		&#8216;OSM&#8217; // name should be short enough to fit in button<br />
	  );</p>
<p>//Initiate the map for the div with id of &quot;map&quot; &#8211; random Lat/lon pair used here &#8211; not a findspot!<br />
var map = new GMap2(document.getElementById(&quot;map&quot;));<br />
     map.setUIToDefault();<br />
     map.addControl(new GMapTypeControl());<br />
     map.setCenter(new GLatLng(51.263722,0.68009),11);<br />
//Add your map types &#8211; here I have added OSM, NLS, Earth and Terrain<br />
     map.addMapType(osmMap);<br />
     map.addMapType(nlsmap);<br />
     map.addMapType(G_SATELLITE_3D_MAP);<br />
     map.addMapType(G_PHYSICAL_MAP);<br />
//Set your default map type<br />
     map.setMapType(G_PHYSICAL_MAP);<br />
     map.disableScrollWheelZoom();<br />
     map.enableRotation();</p>
<p>//Set up my icons<br />
var tinyIcon = new GIcon();<br />
		tinyIcon.image = &quot;http://labs.google.com/ridefinder/images/mm_20_red.png&quot;;<br />
		tinyIcon.shadow = &quot;http://labs.google.com/ridefinder/images/mm_20_shadow.png&quot;;<br />
		tinyIcon.iconSize = new GSize(12, 20);<br />
		tinyIcon.shadowSize = new GSize(22, 20);<br />
		tinyIcon.iconAnchor = new GPoint(6, 20);<br />
		tinyIcon.infoWindowAnchor = new GPoint(5, 1);<br />
	markerOptions = { icon:tinyIcon };</p>
<p>	var findIcon = new GIcon();<br />
		findIcon.image = &quot;http://labs.google.com/ridefinder/images/mm_20_blue.png&quot;;<br />
		findIcon.shadow = &quot;http://labs.google.com/ridefinder/images/mm_20_shadow.png&quot;;<br />
		findIcon.iconSize = new GSize(12, 20);<br />
		findIcon.shadowSize = new GSize(22, 20);<br />
		findIcon.iconAnchor = new GPoint(6, 20);<br />
		findIcon.infoWindowAnchor = new GPoint(5, 1);</p>
<p>		findOptions = { icon:findIcon };</p>
<p>	var point = new GLatLng(51.263722,0.68009);</p>
<p>	var marker = new GMarker(point, markerOptions);<br />
        GEvent.addListener(marker, &quot;click&quot;, function () {<br />
	      marker.openInfoWindowHtml(&quot;Findspot location&quot;);<br />
        });<br />
        map.addOverlay(marker);</p>
<p>    }</p>
<p>});<br />
    //]]&gt;<br />
&lt;/script&gt;<br />
[/javascript]</p>
<p>So really simple to integrate and get running on your site.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/08/06/adding-old-os-maps-to-findspot-maps/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Another milestone reached</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/07/26/another-milestone-reached/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/07/26/another-milestone-reached/#comments</comments>
		<pubDate>Mon, 26 Jul 2010 20:34:23 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[Techie stuff]]></category>
		<category><![CDATA[Coin]]></category>
		<category><![CDATA[Tom Brindle]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=944</guid>
		<description><![CDATA[On the 26th July 2010, the Scheme recorded the 400,000 record on the database; another Roman coins, this time a nummus of the House of Constantine. We had an internal challenge, with the Deputy Head down to buy the person who recorded this object, a bottle of sparkling wine. The landmark object is show below ... <a href="http://finds.org.uk/blogs/centralunit/2010/07/26/another-milestone-reached/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>On the 26th July 2010, the Scheme recorded the 400,000 record on the database; another Roman coins, this time a nummus of the House of Constantine. We had an internal challenge, with the Deputy Head down to buy the person who recorded this object, a bottle of sparkling wine. The landmark object is show below and was recorded by Tom Brindle, our acting <acronym title="Finds Liaison Officer">FLO</acronym> for Staffordshire and the West Midlands.</p>
<p><img style="float: right;" src="http://www.finds.org.uk/images/thumbnails/290816.jpg" alt="WMID-D6D183" /><acronym title="The Portable Antiquities Scheme"><acronym title="Portable Antiquities Scheme">PAS</acronym></acronym> record number: WMID-D6D183<br />
Object type: Coin<br />
Broadperiod: Roman<br />
County of discovery: Shropshire<br />
Stable url: <a href="http://www.finds.org.uk/database/artefacts/record/id/400298" title="WMID-D6D183: a Roman Coin" class="liinternal">http://www.finds.org.uk/database/artefacts/record/id/400298</a></p>
<p>Several FLOs expressed dismay, that the object was a Roman coin and a metal detector find, I think they were hoping for a lithic or something else found by a fieldwalker for a change&#8230; However, coins and metal detectorists are the best represented on our database&#8230;.</p>
<table id="table_results" border="0" cellspacing="1" cellpadding="2">
<thead>
<tr>
<th>Records</th>
<th>Finds recorded</th>
<th>Year of recording</th>
</tr>
</thead>
<tbody>
<tr>
<td align="right" valign="top" bgcolor="#FFCC99">3476</td>
<td align="right" valign="top" bgcolor="#FFCC99">4588</td>
<td align="right" valign="top" bgcolor="#FFCC99">1998</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">6128</td>
<td align="right" valign="top" bgcolor="#E5E5E5">8201</td>
<td align="right" valign="top" bgcolor="#E5E5E5">1999</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#FFCC99">11323</td>
<td align="right" valign="top" bgcolor="#FFCC99">18106</td>
<td align="right" valign="top" bgcolor="#FFCC99">2000</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">11481</td>
<td align="right" valign="top" bgcolor="#E5E5E5">16368</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2001</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">8164</td>
<td align="right" valign="top" bgcolor="#D5D5D5">11996</td>
<td align="right" valign="top" bgcolor="#D5D5D5">2002</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">14657</td>
<td align="right" valign="top" bgcolor="#E5E5E5">21684</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2003</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">26383</td>
<td align="right" valign="top" bgcolor="#D5D5D5">39000</td>
<td align="right" valign="top" bgcolor="#D5D5D5">2004</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">33919</td>
<td align="right" valign="top" bgcolor="#E5E5E5">52202</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2005</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">37502</td>
<td align="right" valign="top" bgcolor="#D5D5D5">58311</td>
<td align="right" valign="top" bgcolor="#D5D5D5">2006</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">49308</td>
<td align="right" valign="top" bgcolor="#E5E5E5">79052</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2007</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">37455</td>
<td align="right" valign="top" bgcolor="#D5D5D5">56449</td>
<td align="right" valign="top" bgcolor="#D5D5D5">2008</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">39981</td>
<td align="right" valign="top" bgcolor="#E5E5E5">66481</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2009</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#CCFFCC">112893</td>
<td align="right" valign="top" bgcolor="#CCFFCC">190091</td>
<td align="right" valign="top" bgcolor="#CCFFCC">2010</td>
</tr>
</tbody>
</table>
<p>You might wonder why these figures don&#8217;t always match the Annual Reports; well, the database is constantly being worked on, errors corrected, finds removed if duplicate records  and so on. There&#8217;s some blips in the figures being recorded &#8211; 2002 for example being foot and mouth hit, in 2003 the Scheme went National and we phased in our new database and in March 2010 we imported 2 large datasets from IARCW and CCI (and you might have heard about 52,503 coins found in Somerset &#8211; only 1 record of those though &#8211; April). However the 2010 figures are encouraging when you look at the statistics for recording since we went live with our new database (shown below with a comparison to 2009, same period).</p>
<table id="table_results" border="0" cellspacing="1" cellpadding="2">
<caption>Statistics for 2009</caption>
<thead>
<tr>
<th>Records</th>
<th>Objects</th>
<th>Month</th>
</tr>
</thead>
<tbody>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">3638</td>
<td align="right" valign="top" bgcolor="#D5D5D5">4395</td>
<td align="right" valign="top" bgcolor="#D5D5D5">1</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">2694</td>
<td align="right" valign="top" bgcolor="#E5E5E5">5410</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">2842</td>
<td align="right" valign="top" bgcolor="#D5D5D5">3414</td>
<td align="right" valign="top" bgcolor="#D5D5D5">3</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">3191</td>
<td align="right" valign="top" bgcolor="#E5E5E5">6284</td>
<td align="right" valign="top" bgcolor="#E5E5E5">4</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">3768</td>
<td align="right" valign="top" bgcolor="#D5D5D5">5229</td>
<td align="right" valign="top" bgcolor="#D5D5D5">5</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">3307</td>
<td align="right" valign="top" bgcolor="#E5E5E5">4429</td>
<td align="right" valign="top" bgcolor="#E5E5E5">6</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#CCFFCC">3152</td>
<td align="right" valign="top" bgcolor="#CCFFCC">3819</td>
<td align="right" valign="top" bgcolor="#CCFFCC">7</td>
</tr>
</tbody>
</table>
<table id="table_results" border="0" cellspacing="1" cellpadding="2">
<caption>Statistics for 2010</caption>
<thead>
<tr>
<th>Records</th>
<th>Objects</th>
<th>Month</th>
</tr>
</thead>
<tbody>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">4290</td>
<td align="right" valign="top" bgcolor="#D5D5D5">12274</td>
<td align="right" valign="top" bgcolor="#D5D5D5">1</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">3509</td>
<td align="right" valign="top" bgcolor="#E5E5E5">5526</td>
<td align="right" valign="top" bgcolor="#E5E5E5">2</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">88596</td>
<td align="right" valign="top" bgcolor="#D5D5D5">90380</td>
<td align="right" valign="top" bgcolor="#D5D5D5">3</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">4191</td>
<td align="right" valign="top" bgcolor="#E5E5E5">57775</td>
<td align="right" valign="top" bgcolor="#E5E5E5">4</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">3957</td>
<td align="right" valign="top" bgcolor="#D5D5D5">5255</td>
<td align="right" valign="top" bgcolor="#D5D5D5">5</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#E5E5E5">4490</td>
<td align="right" valign="top" bgcolor="#E5E5E5">14518</td>
<td align="right" valign="top" bgcolor="#E5E5E5">6</td>
</tr>
<tr>
<td align="right" valign="top" bgcolor="#D5D5D5">3860</td>
<td align="right" valign="top" bgcolor="#D5D5D5">4363</td>
<td align="right" valign="top" bgcolor="#D5D5D5">7</td>
</tr>
</tbody>
</table>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/07/26/another-milestone-reached/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Using our data to place a google map on your own site (without the api)</title>
		<link>http://finds.org.uk/blogs/centralunit/2010/07/09/embed-map/</link>
		<comments>http://finds.org.uk/blogs/centralunit/2010/07/09/embed-map/#comments</comments>
		<pubDate>Fri, 09 Jul 2010 13:32:03 +0000</pubDate>
		<dc:creator>Daniel Pett</dc:creator>
				<category><![CDATA[Database]]></category>
		<category><![CDATA[Geography]]></category>
		<category><![CDATA[Google Earth]]></category>
		<category><![CDATA[Techie stuff]]></category>
		<category><![CDATA[Atom]]></category>
		<category><![CDATA[online mapping programmes]]></category>
		<category><![CDATA[South Cambridgeshire]]></category>
		<category><![CDATA[South Cambridgeshire,Cambridgeshire,United Kingdom]]></category>

		<guid isPermaLink="false">http://finds.org.uk/blogs/centralunit/?p=903</guid>
		<description><![CDATA[This post is just a short overview of how you can get our data onto your website without being uber-geeky and knowing how to play with our Applications Programming Interface (API &#8211; more on this over the next month or so.)  The Scheme&#8217;s website can now serve up various different flavours of content by means ... <a href="http://finds.org.uk/blogs/centralunit/2010/07/09/embed-map/">Continue Reading  &#8594;</a>]]></description>
				<content:encoded><![CDATA[<p>This post is just a short overview of how you can get our data onto your website without being uber-geeky and knowing how to play with our Applications Programming Interface (<acronym title="Application Programming Interface">API</acronym> &#8211; more on this over the next month or so.)  The Scheme&#8217;s website can now serve up various different flavours of content by means of context switching. You can now get:</p>
<ol>
<li><acronym title="Really Simple Syndication">RSS</acronym></li>
<li>ATOM</li>
<li><acronym title="eXtensible Markup Language">XML</acronym> (finds lists and searches are returned in MIDAS format, other pages just plain <acronym title="eXtensible Markup Language">XML</acronym> responses)</li>
<li>JSON</li>
<li>KML</li>
<li>CSV</li>
</ol>
<p>To find out what versions of the content you can retrieve for a page is pretty simple. If you scroll towards the foot of any page on our website, look for the text:</p>
<blockquote><p>This page is available in: {contexts available} representations.</p></blockquote>
<p>This makes use of the Zend Framework context switch parameter -format. So any <acronym title="Uniform Resource Locator">URL</acronym> that has an alternative representation just needs appending format/{context}. So for example, you want to view all finds for Essex in ATOM format you would call this url:</p>
<p><a href="http://www.finds.org.uk/database/search/results/county/ESSEX/format/atom" title="Atom feed for finds" class="liinternal">http://www.finds.org.uk/database/search/results/county/ESSEX/format/atom</a></p>
<p>You can now use this output within your own site using simple software tools such as widgets, simplepie etc. However, what is probably of more interest to many people is getting a map of objects found locally to them. So for example, you run a parish council and you want all objects found in the district. Let&#8217;s try my home district of South Cambridgeshire. If you go to our advanced search facility and scroll to the bottom and choose county as Cambridgeshire and district as South Cambridgeshire, then submit the form and wait a second for the search to complete.</p>
<p>Now that the results are there, look at the page foot for the representations available and you&#8217;ll see the letters KML. If you click on this, you can now get data in the format that can be used in many online mapping programmes and Google Earth. So if you want to see this on the map, copy the <acronym title="Uniform Resource Locator">URL</acronym> generated; in this case:</p>
<p><a href="http://www.finds.org.uk/database/search/results/county/CAMBRIDGESHIRE/district/SOUTH+CAMBRIDGESHIRE/format/kml" title="South Cambs finds" class="liinternal">http://www.finds.org.uk/database/search/results/county/CAMBRIDGESHIRE/district/SOUTH+CAMBRIDGESHIRE/format/kml</a></p>
<p><a href="http://www.finds.org.uk/database/search/results/county/CAMBRIDGESHIRE/district/SOUTH+CAMBRIDGESHIRE/format/kml" title="South Cambridgeshire KML" class="liinternal"></a></p>
<p>Now head over to <a href="http://maps.google.com" title="Google maps" class="liexternal">http://maps.google.com</a>.</p>
<p>In the search bar, paste the <acronym title="Uniform Resource Locator">URL</acronym> that you copied and press search.</p>
<p><img title="search" src="http://finds.org.uk/blogs/centralunit/files/2010/07/search-300x20.png" alt="Google maps search bar with url pasted in" width="300" height="20" /></p>
<p>The map should now change to show pins for degraded findspot locations. These pins are only provided when the &#8216;to be known as&#8217; field has not been filled in and the actual points are taken from the 1km grid reference (4 figure). So the map should now render like the below image:</p>
<p><a href="http://finds.org.uk/blogs/centralunit/files/2010/07/map.png" class="liimagelink" rel="lightbox[903]"><img class="alignnone size-medium wp-image-909" title="map" src="http://finds.org.uk/blogs/centralunit/files/2010/07/map-300x148.png" alt="Google map generated from the KML " width="300" height="148" /></a></p>
<p>Now you have generated this map, you can grab either the link for the map and send directly to some one, or you can grab the <acronym title="HyperText Markup Language">HTML</acronym> code to embed the map into a webpage. Look in the top corner of the map for the control labelled embed and click this; you then get the layer appearing which looks like the image below:</p>
<p><img src="http://finds.org.uk/blogs/centralunit/files/2010/07/link.png" alt="Link box from google" title="link" width="405" height="176" class="alignnone size-full wp-image-917" /></p>
<p>As this post deals with embedding the map on your own webpage, it is assumed that you can enter raw <acronym title="HyperText Markup Language">HTML</acronym> directly. Copy the text which is contained in the box labelled &#8220;Paste <acronym title="HyperText Markup Language">HTML</acronym> to embed in website&#8221;. This looks like:<br />
[sourcecode]<br />
&lt;iframe width=&quot;425&quot; height=&quot;350&quot; frameborder=&quot;0&quot; scrolling=&quot;no&quot; marginheight=&quot;0&quot; marginwidth=&quot;0&quot;<br />
src=&quot;http://maps.google.com/maps?f=q&amp;amp;source=s_q&amp;amp;hl=en&amp;amp;geocode=&amp;amp;q=http:%2F%2Fwww.finds.org.uk%2Fdatabase%2Fsearch%2Fresults%2Fcounty%2FCAMBRIDGESHIRE%2Fdistrict%2FSOUTH%2BCAMBRIDGESHIRE%2Fformat%2Fkml&amp;amp;sll=37.0625,-95.677068&amp;amp;sspn=47.885545,114.169922&amp;amp;<acronym title="Internet Explorer - it sucks">IE</acronym>=UTF8&amp;amp;ll=52.257917,-0.000189&amp;amp;spn=0.72983,0.782087&amp;amp;iwloc=lyrftr:kml:cF4oaez0SXhtHIuPUpXMoJUR9uPk2SiORITteHHHGjS0fvow5su0kSjIVdHy4TwDOfCcxM4bseHHEGTe2fPgy5si2VKsJEzIMAg,gf42aba810981b24d,52.065156,0.171661,0,-32&amp;amp;output=embed&quot;&gt;&lt;/iframe&gt;<br />
&lt;br /&gt;&lt;small&gt;<br />
&lt;a href=&quot;http://maps.google.com/maps?f=q&amp;amp;source=embed&amp;amp;hl=en&amp;amp;geocode=&amp;amp;q=http:%2F%2Fwww.finds.org.uk%2Fdatabase%2Fsearch%2Fresults%2Fcounty%2FCAMBRIDGESHIRE%2Fdistrict%2FSOUTH%2BCAMBRIDGESHIRE%2Fformat%2Fkml&amp;amp;sll=37.0625,-95.677068&amp;amp;sspn=47.885545,114.169922&amp;amp;<acronym title="Internet Explorer - it sucks">IE</acronym>=UTF8&amp;amp;ll=52.257917,-0.000189&amp;amp;spn=0.72983,0.782087&amp;amp;iwloc=lyrftr:kml:cF4oaez0SXhtHIuPUpXMoJUR9uPk2SiORITteHHHGjS0fvow5su0kSjIVdHy4TwDOfCcxM4bseHHEGTe2fPgy5si2VKsJEzIMAg,gf42aba810981b24d,52.065156,0.171661,0,-32&quot; style=&quot;color:#0000FF;text-align:left&quot;&gt;View Larger Map&lt;/a&gt;<br />
&lt;/small&gt;<br />
[/sourcecode]</p>
<p>Then once you have pasted this code into your webpage, saved it and if you aren&#8217;t using a content management system, upload it to your website and then the map will be embedded as shown below:<br />
<iframe width="100%" height="350" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" src="http://maps.google.com/maps?f=q&amp;source=s_q&amp;hl=en&amp;geocode=&amp;q=http:%2F%2Fwww.finds.org.uk%2Fdatabase%2Fsearch%2Fresults%2Fcounty%2FCAMBRIDGESHIRE%2Fdistrict%2FSOUTH%2BCAMBRIDGESHIRE%2Fformat%2Fkml&amp;sll=37.0625,-95.677068&amp;sspn=47.885545,114.169922&amp;ie=UTF8&amp;ll=52.257917,-0.000189&amp;spn=0.72983,0.782087&amp;iwloc=lyrftr:kml:cF4oaez0SXhtHIuPUpXMoJUR9uPk2SiORITteHHHGjS0fvow5su0kSjIVdHy4TwDOfCcxM4bseHHEGTe2fPgy5si2VKsJEzIMAg,gf42aba810981b24d,52.065156,0.171661,0,-32&amp;output=embed"></iframe><br /><small><a href="http://maps.google.com/maps?f=q&amp;source=embed&amp;hl=en&amp;geocode=&amp;q=http:%2F%2Fwww.finds.org.uk%2Fdatabase%2Fsearch%2Fresults%2Fcounty%2FCAMBRIDGESHIRE%2Fdistrict%2FSOUTH%2BCAMBRIDGESHIRE%2Fformat%2Fkml&amp;sll=37.0625,-95.677068&amp;sspn=47.885545,114.169922&amp;ie=UTF8&amp;ll=52.257917,-0.000189&amp;spn=0.72983,0.782087&amp;iwloc=lyrftr:kml:cF4oaez0SXhtHIuPUpXMoJUR9uPk2SiORITteHHHGjS0fvow5su0kSjIVdHy4TwDOfCcxM4bseHHEGTe2fPgy5si2VKsJEzIMAg,gf42aba810981b24d,52.065156,0.171661,0,-32" style="color:#0000FF;text-align:left" class="liexternal">View Larger Map</a></small></p>
<p>In the infowindow bubbles that come up when you click on a findspot location, you will see this text:</p>
<blockquote><p>This findspot has been produced from the 4 figure reference. It is not the precise findspot.</p></blockquote>
<p>As mentioned above, due to findspot security/ landowner privacy, and an agreement we have with the major body that gives us artefact spatial information, we cannot publish co-ordinates publicly at a precision greater than parish or 1km square (4 figure grid reference) and we also hold back from view finds that have had the &#8220;to be known as&#8221; field. Therefore, the map you get from this is not 100% accurate! <strong>This is not something we can change.</strong></p>
<p>A couple of weeks ago, we sent a mailshot out to all MPs for England and Wales, detailing how they could get finds for their constituency onto their own webpages. This is done in exactly the same way as the above and constituency finds feeds can be obtained from the news section of the website under (and powered by <a href="http://github.com/portableant/yql-tables/tree/master/twfy/" class="liexternal">YQL</a> calls of the <a href="http://www.theyworkforyou.com/api/" class="liexternal">theyworkforyou</a> <acronym title="Application Programming Interface">API</acronym>):</p>
<p><a href="http://finds.org.uk/news/theyworkforyou/constituencies" class="liinternal">http://finds.org.uk/news/theyworkforyou/constituencies</a></p>
<p>Two examples with finds in their constituencies are the coalition leaders (the Roman coin hoard from Frome announced on the 8th July, had a colalition type coin inside). David Cameron&#8217;s <a href="http://finds.org.uk/news/theyworkforyou/finds/constituency/Witney" class="liinternal">constituency of Witney</a>  shows this map:</p>
<p><iframe width="100%" height="350" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" src="http://maps.google.com/maps?f=q&amp;source=s_q&amp;hl=en&amp;geocode=&amp;q=http:%2F%2Ffinds.org.uk%2Fnews%2Ftheyworkforyou%2Ffinds%2Fconstituency%2FWitney%2Fformat%2Fkml&amp;sll=52.242938,0.281525&amp;sspn=0.58273,1.783905&amp;ie=UTF8&amp;ll=51.837225,-1.508125&amp;spn=0.313857,0.436724&amp;output=embed"></iframe></p>
<p>And Nick Clegg&#8217;s <a href="http://finds.org.uk/news/theyworkforyou/finds/constituency/Sheffield+Hallam" class="liinternal">Sheffield Hallam constituency</a> shows this map:<br />
<iframe width="100%" height="350" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" src="http://maps.google.com/maps?f=q&amp;source=s_q&amp;hl=en&amp;geocode=&amp;q=http:%2F%2Ffinds.org.uk%2Fnews%2Ftheyworkforyou%2Ffinds%2Fconstituency%2FSheffield%2BHallam%2Fformat%2Fkml&amp;sll=51.837225,-1.508125&amp;sspn=0.58804,1.783905&amp;ie=UTF8&amp;ll=53.383646,-1.603335&amp;spn=0.098465,0.19546&amp;output=embed"></iframe></p>
<p>Once geoRSS is enabled and working properly, you can also do the above using any of the feeds for finds where the context switch called is ATOM. This will be done by the middle of next week, alongside ATOM paging.</p>]]></content:encoded>
			<wfw:commentRss>http://finds.org.uk/blogs/centralunit/2010/07/09/embed-map/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
