In this blog entry we discuss how we tackled the development of the nature locator mobile applications; why we made the decisions we did and what architectures we finally adopted for both the mobile apps and server-side technology. Continue Reading »

Final Product Post

NatureLocator: Leaf Watch

Strapline: A geospatial smart phone application enabling public engagement in
biological survey work via the crowd sourcing of data collection and data validation

Primary University Users: Researchers and students

Primary Other Users:  Anyone interested in collecting or providing crowd-sourced, geotagged photographic data

NatureLocator’s Leaf Watch app provides a cross-platform solution for crowd sourcing the collection of geospatially tagged, photographic data.  The project has also integrated the crowd sourcing of data validation so that the data collected can be checked and verified by the general public.

Why we created the Leaf Watch app

The Leaf Watch app was developed in order to augment an existing project, Conker Tree Science, which aims to collect as much information as possible about the current and changing distribution of the horse chestnut leaf miner moth.  Prior to the app’s production, data collection had been crowd sourced but the Conker Tree Science project was reliant on people submitting their data using a website form.  Submissions over the season numbered circa 500 or so and were text based only.  Verification of records, therefore, was not possible and the location of affected trees had to be recorded using an OS map.

The app has greatly facilitated the data collection and submission process (by making it portable) while simultaneously increasing data accuracy by incorporating a GPS tagged photographic image of the subject.  The convenience factor which the app provides has encouraged many more people to participate in the study and yielded a much larger data set; some 5200 data submissions.  One such user, Laura Illsley, keeps her eyes open for affected horse chestnut trees when out walking her dog.  Laura generally has her phone with her when she’s out walking which means there is little effort involved in recording stricken trees.  Laura is an example of a large group of data collectors that would not ordinarily have participated in the study but that have contributed valuable data.

View the NatureLocator Leaf Watch website here:

http://leafwatch.naturelocator.org/

This site contains information on the app itself but also hosts a web application we have built in order to crowd source the validation of the data collected.

View the Validation page here:

http://leafwatch.naturelocator.org/validate

The Leaf Watch App

The app itself has been designed to be very simple to use whilst still collecting valid biological data.  It is available free for both the iPhone and Android platforms and, once downloaded, can be used immediately without any registration.

App usage sequence

After starting the app it’s very straight forward to submit a record.

Clicking on “Add new record”  takes you to the “New Record” screen where you follow a sequence of tasks:

  • Take a photo of a typical leaf
  • Give the leaf a damage score
  • Use your phone’s GPS to add the location (or if no GPS, you can put in a text based location)
  • Assess the type of ground cover

app sequence #2

You can also add your e-mail address if you want to be contacted by the team information on the results and future projects etc.

Once all fields are completed, you can the send the record in.

To download the app for the iPhone or iPad visit the App Store: http://itunes.apple.com/gb/app/conker-tree-science-leaf-watch/id445371129?mt=8

To download the app for the Android platform visit the Android Market: https://market.android.com/details?id=uk.ac.bris.ilrt.leafwatch

The Data Validation Web Application

The validation web application adds a valuable extra level of functionality.  As a tool for research both products can be seen as providing a rounded “service”.  Designed as a mechanism by which large quantities of data can be checked and verified by the general public, the validation process is based around the same concept as a Galaxy Zoo.  It also provides some element of “gamification” in the form of a “Validator’s Leaderboard” to encourage a degree of gentle competition.

Importantly, the website also features a Results page where we are feeding back information gathered by the app to the public in a visual form.  We have an interactive map to enable people to track results over time so they can get a feel of how their data has contributed to the overall picture.

http://leafwatch.naturelocator.org/results

Feeling like a bit of validation tonight….??

Information is provided on how to log in to the validation application.  In addition, comprehensive information regarding the accurate evaluation of the image data is provided.  This means that even if you’ve never set eyes on a horse-chestnut tree before you will still be able to take part and contribute valuable data.  We will be measuring the amalgamated accuracy of the publics’ scoring  against an expert’s in order to gauge the accuracy of this type of crowd sourcing.  We’ll use the results to inform decisions about employing it in future projects.

The first screen allows the user to login via one of 3 different, authenticated accounts: Google, Facebook or Twitter.  This provides us with a username for a leaderboard and also enables us to match sessions against individual IDs in case of abuse.  Users with none of these accounts are given instructions on how to sign up for a Google account.

Crowd sourcing validation web application

 

The second screen is simply an authentication notice from the service you have chosen to log in by.

Authentification screen

 

Once into the actual web application itself, first time users will be presented with a message which links to information to help them in the validation process:

web application first time access message

Users can then start applying leaf damage ratings to the images presented to them by the web app.  There is an “Invalid” option to say that the leaf isn’t a horse chestnut leaf and also a “Don’t know” option should the image be unclear.

Leaf damage scoring

 

How the images are presented by the web app

After a deal of discussion we decided that presenting images to users in a standardised order made the most sense on balance.  This was to make the stats we gather as useful as possible since it is likely that few people, if anyone, will validate all 5200 records (go on, I dare you).  Therefore, if 10 people do 1000, at least we have a good number of images all evaluated multiple times to check accuracy on.

 

What we hope to do next

The team are very excited about the potential to further develop the app.  The type of things we are thinking about include the following:

  • User feedback – e.g. data could be pushed to the phone based on the user’s location, when required or opted for.  In this fashion the app could alert you to “hotspots” (areas of particular interest to the user or biologist).  This would enable recording effort to be focused or give people a good idea of where to look for a particular species.
  • Dynamic mapping, to show distribution of records to app users.  They can see their own submitted records immediately and those of others.
  • Data management enhancements to the backend to facilitate analysis of data “on the fly”.  Enhancements might include a user friendly interface with tools to enable non-technical people to access and use the data effectively and efficiently.
  • Additional platform support to include Blackberry and Windows OS
  • Templates to assist with optimal recording of photographic images (one problem we had was people submitting images that weren’t appropriately taken and couldn’t be verified)
  • Facility to “share” app with friends (to facilitate viral spread of app)

 

Meet the people behind Leaf Watch: http://naturelocator.ilrt.bris.ac.uk/about/

The NatureLocator team will ensure that the app and website remain available for at least three years.  The Conker Tree Science project itself looks set to remain operational for the foreseeable future ensuring that the app and website will be well utilised.

The code for the app will be made available under the following licences and people are free to adapt them to meet their own objectives.

Phone App:  Modified BSD

Website App: Modified BSD

Data:  Available September 2012* with a cc zero licence

* The scientists involved in the project will still be busily working away on the data until that point.

 

Table of Contents of Posts

About the Project, Progress, the App and Team

 

Publicity, Presentations etc

Ecological

Project Admin

 

 

 

Alongside the validation widget we’ve included a small degree of gamification.  That is to say, we’ve attempted to try to stimulate participation by turning the validation process into a game.  In order to do this we thought that simple is best and we opted for a leader board.  Only the top five validators are shown but your position, and total of validated records, is always shown.

It’s an interesting question to ask whether the benefit providing a small incentive like this outweighs the cost.  The main benefit is that people are motivated to compete and they feel rewarded for their efforts by appearing on the leader board.  The possible costs include:

  • that latecomers to the process may feel turned off by seeing the apparently insurmountable mountain in front of them
  • that those who are highly competitive may put quantity ahead of quality showing less attention to detail, resulting in low accuracy.

With any luck we’ll be able to analyse the results and assess whether those further up the leader board were more or less accurate than those further down.

Rather than becoming addicted to validating records I seem to have become rather addicted to watching the escalating number of records being validated (that’s my excuse anyway!).  Long may it continue!

We’ve been mightily pleased with the response to our new website and, in particular, with the number of people that have taken part in validating the data.  In just two days we have had 230 people sign in and start checking records for us.

Quite a few of these generous souls have shown a tenacity beyond that possessed by the NatureLocator team.  Top of the leader board currently is Mark Estdale who has checked a whopping 720 records for us!!  Not far behind are; Paul Dixon: 600 records, Tim Alexander: 565 records, Wendy Easton: 560 records and Pavel Douglas: 555 record.  You may now be sick of the sight of horse-chestnut leaves but to everyone that’s taken part so far we’d like to say a big “Thank You!”

The new website is live!

Well, the brand new website for the Nature Locator: Leaf Watch project went live today.

http://leafwatch.naturelocator.org

Actually, it’s been live for about a week but in order to check it thoroughly and put it through its paces we decided not to advertise its presence widely until today.  So, at 4 p.m. this afternoon we mailed all of the people who had supplied us with an e-mail address, having either used the smart phone application or the website to submit records of horse-chestnut tree leaves.

The website functions as a central point of information for the smart phone application.  One of the things we are most excited about, however, is the validation section.  As detailed in the blog post below, this is where people can help us to verify the accuracy of all records submitted via the smart phone application… all 5200 of them!

There was much debate within the team as to whether people would get stuck in.  In some senses this is almost a test case for future projects; to see whether in fact the crowd sourcing of validation captures the public’s imagination and yields accurate results.

Within minutes of the e-mail going out people had started to login and check records for us.  Within two hours of the site being advertised several people had already checked over 500 records.  (At this point I’d like to say that I always knew it would work!)

Validation Leaderboard

Validation Leaderboard

One of the principal reasons for creating the website was to enable us to do some more crowd sourcing work.  This time, we’re going to be asking the public to help us check and validate the data collected by the app.

One of the the team (Jasper Tredgold) has coded up a widget that will enable people to go through all the images in the data set and do several things:

Firstly, check that the image is indeed a horse-chestnut

Secondly, check that the damage to the leaves has been caused by the leaf miner

Thirdly, rate the damage to the leaf/leaves

The page looks great and it’s really easy to log-in and start contributing.  The widget remembers your session and you can log in and out as many times as you like and never lose your place.  There’s also a top contributors panel to help spur people on to evaluate as many images as possible.

Validation page

Validation page

The Nature Locator team have been beavering away designing and coding the new website for the Leaf Watch app.  This will be an invaluable addition to the project as it gives us a one-stop-shop location to direct people to in order to help them find out about the app and the project.

Here’s a sneak preview of the homepage:

website homepage

Website Homepage

Communicate Conference

The Nature Locator team recently submitted a proposal for the Delegate Showcase element of the upcoming Bristol Natural History Consortium’s Communicate conference.  This was accepted and we will be presenting the app at the conference on the 3rd November.

http://www.bnhc.org.uk/home/communicate/programme/day-2.html

5000 data uploads

A few weeks back we passed the 5000 mark for the number of submissions we’d received from the app.  Given that it was only launched in July 2011 with minimal marketing, this is a fantastic tally. 

The number of submissions has plateaued now at around 5200 due to most horse-chestnut trees being at least partly defoliated – a combination of the effects of the leaf miner and the onset of autumn.

The best kind of review

Due to our little mishap recently we collected a few rather bad reviews on the Android Marketplace.  The app didn’t work, so people told us what they thought – and why shouldn’t they?

What I’m really impressed with however, is that two of the people that initially left negative reviews came back and “upgraded” their rating and review once the system came back on-line.

Reviews left by app users

I thought this was a really great example of how feedback should/could work.  It’s an example I’ll remember when I’m rating other people’s apps or product, since a few negative reviews can really deflate you and worse still, potentially put people off using it.  Fine if it really is rubbish, but when there’s been a small hiccup, it would be unfortunate for it to turn into something bigger.  And Phil.t was even good enough to think about how we might improve upon the app to aid its visibility.

If I ever manage to get some degree of access to the Google account used to upload and manage the app I’ll personally thank them for their proactive approach to providing feedback.  But in the meantime, I’ll just have to hope they read this blog.

Next »