Being asked to judge a competition is, to be frank, a terrifying experience and one for which I never quite feel up to the task. As the deadline for submitting my marks approaches my anxiety levels climb until I end up wondering whether asking my next-door neighbour to do it for me is a feasible and/or ethical option. And then, finally, I sit down with the judging criteria and the scoring sheet in front of me and everything starts to flow in an orderly and quietly magical way. I look at each entry in turn and give them marks and make supporting comments based on the judging criteria and my personal perspective. For a couple of hours I give my full attention to the competition entries in front of me and don’t let any thoughts about the rest of the world (particularly the rest of the judging panel or the competition entrants themselves) enter my head. Once I’ve scored every entry, I spend a very short amount of time checking that the scores I’ve given still make sense when I take a step back and look at them in relation to each other. Then I submit my scoring sheet and celebrate with a cup of tea. And then I start worrying again but only until I see the announcement of the winning entries and can feel reassured that my personal perspective was not so very far off the perspectives of the other judges.
Anyhow, this blogpost wasn’t meant to be a blow by blow account of the trials and tribulations of being a competition judge – what I really want to do is share some of my thoughts about the competition entries. What struck me straight off was the wide range of use cases, the deep originality demonstrated by the 11 entries and the potential many of them had for being turned into real-world applications with relatively little redevelopment work. In face I gave six of the entries top marks for the ‘What potential does it have’ score because using them instantly sparked my imagination and I could see how the applications either opened up possibilities for other applications or had the potential to bring a new audience to a particular dataset. For instance, one of the winning entrants ‘What’s About’ uses your current location to reveal nearby English Heritage ‘nationally important places’ by visualising them on a Google Map. Straight away I could see that this could be useful for helping individual users discover places of interest on their doorstep that they might not be aware of. With very little further development I could imagine this being useful as ‘virtual fieldtrip’ tool in geography or history classes. Or as a pre- and/or post-school trip tool that allows students to explore the actual site of the visit (via Google Streetview) and read related books via the link to the British Library dataset. Or as a leisure and tourism search tool that could draw tourists to lesser known sites of interest. The list goes on and on.
One of my areas of expertise is usability so I was particularly interested in how easy each entry was to use. In some ways this was not a simple thing to judge because the entries ranged from those aimed squarely at folks with technical expertise, such as Mark van Harmelen’s ‘Command Line Ruby Database-free Processor’ through to applications aimed at end users with no technical or specialist knowledge, such as Alex Parker’s Timeline application, and others which had a foot in both camps, such as Thomas Meehan’s Lodopac. Also, the nature of the entries themselves varied greatly from fully functioning user interfaces through to more conceptual demonstrator style entries. The only way for me to score the entries fairly was to take each application on its own merit. Generally speaking though I gave entries a higher score if they were easy to use on first view and gave lower marks if the applications couldn’t be used without referring to the supporting notes or if it was aimed at a non-technical end user but, in practice, that user would need some technical expertise in order to get to grips with it. I wasn’t worried or adversely influenced by the odd technical glitch as long as it wasn’t obviously linked to a deeper user experience problem.
As a member of the JISC Activity Data programme synthesis team it was gratifying to see the OpenURL router dataset being utilised by four of the entries (one of which was from the team at EDINA who actually originated the data as part of their JISC AD project).
– OpenURL Router Data Prototype Recommender [EDINA entry]
Two of the OpenURL entries were also notable for their potential as serendipity/distraction engines. Namely the applications submitted by EDINA and Chris Keene which very quickly lead me to intriguing looking articles within one or two clicks of their respective interfaces. [Can I interest anyone else in Vogel et al’s Acoustic analysis of the effects of sustained wakefulness on speech or maybe in Benatar’s Why it is Better Never to Come Into Existence?]
Looking back at the accompanying notes I submitted here’s a selection of my verbatim comments which highlight a few points of personal interest:
- Composed impressed me with how tightly Owen Stephens had integrated the display of the MusicNet record within the relevant Copac record. My comment: “[…] the way the bookmarklet returns the results into the blank space on the right of the Copac record seems nothing short of magical. It would be good to explore how it could be expanded to work for non-music records.”
- Timeline had me doing virtual cartwheels in the comment box. A subset of my comments: “A small amount of additional development would make it endlessly browseable, something I could get lost in for hours. [..] A really elegant interface which could be used as another route to discovering items of interest in any visual collection […].” I could also see potential for Alex’s interface to be combined with Yogesh Patel’s Discovery Map to add a geographical element to the interface.
- Using Gource to Visualise OpenURL Router Data stood out for me because Tony Hirst’s use of visualisations “[…] elevate[s] data to something that is potentially engaging for an audience.” Not only are tools like Gource helping us to, literally, see data in a new way but visualisations present data in a way that, I would argue, increases its shareability to a wider audience [see websites like http://infosthetics.com/ and http://dailyinfographic.com/ for example].
Reflecting on the entries as a whole I was impressed by the quality of lots of the entries’ supporting notes (which made my job as a judge much easier) and greatly inspired by the possibilities that these competition entries open up in their wake. It’s worth mentioning that all the entries are open source (as a central condition of the competition) so I’ll be watching with interest to see what new applications and use cases emerge in response to the competition entries in the forthcoming months and beyond.