Exploring Apps4Edmonton using Microsoft Live Labs Pivot

You’re going to hear a lot more about apps over the next few weeks! The deadline for submissions for the City of Edmonton’s Apps4Edmonton competition was Friday evening. Local developers came up with more than 30 really interesting and useful local apps, which will now compete for your votes and for the attention of the judges. You can learn more about the prizes and the competition here.

I started looking at some of the apps, and decided I wanted a better interface to browse them. I thought it would be nice to be able to sort the apps, to see a screenshot of each one, and to see which datasets each of the apps made use of. I also didn’t want to spend too much time on it, so with all of that in mind, this seemed like the perfect opportunity to experiment with Pivot.

Here’s what I came up with! Click on the image below to load the Apps4Edmonton Apps Directory in Pivot. You’ll need Silverlight 4 installed for it to work. Alternatively, if you have downloaded Pivot and have it installed on your computer, you can browse to this URL inside Pivot.

Click here to launch the Pivot!

Might take a minute or two to load. If it doesn’t, just refresh it. What you see are all the apps from the contest page, with a screenshot, description, contest URL, and list of datasets for each one. If you want to see just the apps that use the “Police Stations” dataset for example, you can select it in the navigation pane on the left and the view will update.

Ever since TechEd, I’ve been really interested in Microsoft Live Labs Pivot, an interactive data visualization technology. It’s great for exploring large datasets, identifying relationships, visualizing patterns, etc. The Apps4Edmonton dataset isn’t very large of course, but the tool still does a great job.

How It Works

I started out by building a Pivot Collection using Microsoft Excel. Pivot has a pretty handy tool for turning spreadsheets into collections, so that’s what I used initially. Quickly though I realized that I wanted to host this on the web somewhere, and that I wanted others to help me refine the dataset.

I uploaded the spreadsheet to Google Docs, and then downloaded the Just In Time Pivot Collection sample. After a little bit of experimentation with the Google Docs API (which I have never used before) I had the code working to create my collection on the fly. It loads the spreadsheet from Google Docs, creates the collection, and then serves up the XML and Deep Zoom images.

The spreadsheet is mostly complete, but a few apps are missing datasets. This is because either it wasn’t immediately obvious which they were using, or they simply don’t use any that are part of the data catalogue. You can update the spreadsheet here.

If you’d like to experiment with creating your own just-in-time Pivot Collection, you can download the sample code here and the code for the collection I wrote here. I also made use of CutyCapt to generate screenshots. You’ll also want to check the XML schema.

Apps4Edmonton

There are some really great apps in the Apps4Edmonton competition, so check them out. You’ve got until September 10 to vote for your favorite ideas and apps!

And for full disclosure, I submitted ShareEdmonton to the competition. If you like it, vote for it!

UPDATE: Thanks to John for helping me get the Pivot Collection right!

City of Edmonton launches Apps4Edmonton Competition

On Wednesday the City of Edmonton officially launched its Apps4Edmonton competition, which challenges residents to submit ideas for apps and developers to actually build them. There is more than $50,000 in prizes available, and everyone has a chance to win an Apple iPad. Here’s what the competition is all about:

Every Edmontonian can be an active participant in reshaping our city. Together with community partners the City of Edmonton is proud to launch Apps4Edmonton – a contest which encourages residents to develop applications that will benefit Edmontonians.

Using data sets from the Edmonton Open Data Catalogue, we’re challenging you to develop an app for either a smart phone, mobile device, or PC web browser. Mash up a map, create a visualization, or analyze data in a new way, the choice is yours.

To support the competition, the City has also released an update to the Data Catalogue. There are now 25 datasets available, including Ward boundaries and a list of City facilities. Even more datasets should be available soon, and if there’s something specific you’d like to have, request it from opendata@edmonton.ca.

If you have an idea for an app, submit it here. It can be anything, so be creative! Even if your idea isn’t possible or a developer doesn’t want to take it on, it might serve as inspiration for other apps, so don’t be shy. If you’re building or have already built an app, submit it here. You have until August 27 to do so. The FAQ has some good info, and be sure to familiarize yourself with the rules too.

Applications will be judged on four criteria: Accessibility, Usability, Creativity, and the number of community votes received (voting runs online from August 27 to September 10). In addition to three overall prizes (Gold, Silver, Bronze) there are six categories:

  • The Way We Live
  • The Way We Grow
  • The Way We Green
  • The Way We Move
  • The Way We Plan
  • The Way We Prosper

I’m very happy to see that IT has aligned itself with Transforming Edmonton for this competition! I am hopeful that Apps4Edmonton can help introduce more Edmontonians to those important documents that help guide us toward becoming a more innovative, inclusive, and creative city.

To learn more about Apps4Edmonton, visit the contest site. There should be lots of chatter about the competition at Startup Weekend too, and tonight at the Emerging Business Leaders’ Patio Party.

I can’t wait to see what everyone comes up with!

Edmonton Neighbourhood Census Data

For a long time I’ve wanted to get the City of Edmonton’s neighbourhood census data in CSV format (or really any usable format other than PDF). Recently, with the help of Laura (and Sandra) at the City’s Election & Census Services department, who I met at the Open City Workshop, I finally got it. And now you can have it too!

Download the Edmonton Neighbourhood Census Data in CSV

I’ve also emailed this to the City’s open data team, so hopefully they can get it in the data catalogue soon.

Visualizing the Data

Why is having the census data in a format like CSV useful? Well for one thing, it enables creatives to do stuff with that data through code or other tools. For instance, I was able to generate a heat map for the City of Edmonton:

The darker sections are more heavily populated, the lighter yellow regions are less populated.

Not all neighbourhoods are reflected, as the City does not release details for neighbourhoods with a population between 1 and 49. Here are some other things we can learn from the data set:

  • Total population in the data set is 777,811, which means there are 4628 individuals unaccounted for (total for 2009 was 782,439).
  • The average neighbourhood population is 2424, or 3039 if you exclude neighbourhoods with a reported population of 0.
  • The median neighbourhood population is 2216.
  • Oliver and Downtown are the only two neighbourhoods with a population greater than 10,000.
  • More dwellings are owned (192,171) than rented (121,953).

ShareEdmonton

Another reason having this data in CSV is useful is because app developers can more easily integrate it into the things they are building. For example, all the census data is now available at ShareEdmonton! So when you view a neighbourhood, you’ll see the census data on the right side (see Alberta Avenue for example). You can also browse neighbourhoods by population. I’ve also fixed the neighbourhood search, so it works better now.

This is just the first of a few neighbourhood-related updates this month, so stay tuned for more!

Apps4Edmonton

Yesterday the City released more information on the Apps4Edmonton competition. The first phase, from now until May, is “accepting community ideas”. Basically they want you to tell them what data you want. Aside from the obvious “we don’t know what we don’t know” problem, I think the community has done a pretty good job of defining desired data sets already.

They City had a great start in January with the launch of the data catalogue, but we need more data. Especially data like the census data, which myself and many others have been asking for since the day the PDFs were released. There are clearly some internal issues that need to be worked out if I was able to acquire this before the open data team was. I hope they get everything resolved for the competition, because it’ll be a pretty boring one if we still only have twelve data sets (New York and other cities had dozens, maybe even hundreds, before their competitions).

That said, I know there are passionate, smart people working on it. Email opendata@edmonton.ca if you have data set requests or want to get involved in Apps4Edmonton.