Category: ShareEdmonton

Edmonton Public Schools & Open Data

Today I’m very excited to announce that Edmonton Public Schools has taken a big step into the world of open data by releasing a data set containing information on all of their schools, including the six opening later this year. I understand the data will be made available in the City of Edmonton’s Open Data Catalogue early next week, but you can download the CSV file today if you like.

Download the Edmonton Public Schools Data in CSV

Back in early February I met Jeremy and Paul for lunch to chat about open data and the community here in Edmonton. One of the things we talked about was how Edmonton Public Schools could get involved. In addition to attending events like the Open City Workshop, Jeremy and his team also started working behind-the-scenes to pull together data that might be useful to share. I helped define the fields that should be included and did the geocoding work, but they did all the rest. The result is a great data set of public schools in Edmonton, containing the name, address, lat/long, grade levels, programming information, and contact details for each.

Edmonton Public Schools follows in the footsteps of the Edmonton Public Library in embracing open data. Both organizations should be applauded for being “early adopters” and for their enthusiastic participation in the open data movement here in Edmonton. They have set an example that others can follow. Specifically:

  • Start small! EPL released branch locations, EPSB released school locations.
  • Work with the community! In both cases, I was able to help with some of the work. There are many others in the community who are eager to help as well.
  • Engage the City! In addition to getting the data in the catalogue, which is really important to have a central repository, the City has also offered some suggestions for improvements.

Thank you to Jeremy and the rest of the team at Edmonton Public Schools for making this happen!

No post about a new data set would be complete without mentioning that the data is now available at ShareEdmonton! You can now see a list of all public schools and on the details page for each one, you can see the relevant school ward, grade level, and programming information on the right side (for example, McNally, the high school I attended). More improvements coming soon!

Edmonton Neighbourhood Census Data

For a long time I’ve wanted to get the City of Edmonton’s neighbourhood census data in CSV format (or really any usable format other than PDF). Recently, with the help of Laura (and Sandra) at the City’s Election & Census Services department, who I met at the Open City Workshop, I finally got it. And now you can have it too!

Download the Edmonton Neighbourhood Census Data in CSV

I’ve also emailed this to the City’s open data team, so hopefully they can get it in the data catalogue soon.

Visualizing the Data

Why is having the census data in a format like CSV useful? Well for one thing, it enables creatives to do stuff with that data through code or other tools. For instance, I was able to generate a heat map for the City of Edmonton:

The darker sections are more heavily populated, the lighter yellow regions are less populated.

Not all neighbourhoods are reflected, as the City does not release details for neighbourhoods with a population between 1 and 49. Here are some other things we can learn from the data set:

  • Total population in the data set is 777,811, which means there are 4628 individuals unaccounted for (total for 2009 was 782,439).
  • The average neighbourhood population is 2424, or 3039 if you exclude neighbourhoods with a reported population of 0.
  • The median neighbourhood population is 2216.
  • Oliver and Downtown are the only two neighbourhoods with a population greater than 10,000.
  • More dwellings are owned (192,171) than rented (121,953).

ShareEdmonton

Another reason having this data in CSV is useful is because app developers can more easily integrate it into the things they are building. For example, all the census data is now available at ShareEdmonton! So when you view a neighbourhood, you’ll see the census data on the right side (see Alberta Avenue for example). You can also browse neighbourhoods by population. I’ve also fixed the neighbourhood search, so it works better now.

This is just the first of a few neighbourhood-related updates this month, so stay tuned for more!

Apps4Edmonton

Yesterday the City released more information on the Apps4Edmonton competition. The first phase, from now until May, is “accepting community ideas”. Basically they want you to tell them what data you want. Aside from the obvious “we don’t know what we don’t know” problem, I think the community has done a pretty good job of defining desired data sets already.

They City had a great start in January with the launch of the data catalogue, but we need more data. Especially data like the census data, which myself and many others have been asking for since the day the PDFs were released. There are clearly some internal issues that need to be worked out if I was able to acquire this before the open data team was. I hope they get everything resolved for the competition, because it’ll be a pretty boring one if we still only have twelve data sets (New York and other cities had dozens, maybe even hundreds, before their competitions).

That said, I know there are passionate, smart people working on it. Email opendata@edmonton.ca if you have data set requests or want to get involved in Apps4Edmonton.

Update on ShareEdmonton

I’m still working on improving ShareEdmonton, slowly but surely, and I wanted to provide a brief update on my progress. Over the last couple of weeks, my primary focus has been on improving the event calendar. Making it faster, more complete, and easier to browse. There’s still a lot of work to do, but here are some of the recent improvements:

  • There’s now a Featured Upcoming Events page where I can highlight specific events.
  • Related events have been improved. For example, if you look at the page for this Saturday’s Old Strathcona Farmers’ Market, you’ll see other upcoming dates as well.
  • That feature highlights something else – events on ShareEdmonton are as granular as possible. Instead of just having one event for The Citadel’s upcoming run of Sweeney Todd that starts on February 6 and ends on February 28, each individual show time gets its own page. That’s important in helping to answer the question, what’s happening in Edmonton at a given time and place? There are only a few exceptions to this, such as International Week.

I’m going to continue to make it easier to find and browse events, especially by tag, like valentine’s day or family day. I have made good progress on making the calendar more complete too. Currently, there are more than 200 unique events in ShareEdmonton for February, with more than 600 different instances (a unique event would be “Sweeny Todd”, and each showtime would be a different instance). There are probably hundreds more that I don’t yet have in the calendar. It’s a tricky problem, but I’m working on it!

Another thing I’ve been working on is improving Places in ShareEdmonton, which includes adding more places! Most recently, I started adding places that have been made available as part of the City’s open data catalogue, such as Police Stations. That’s a handy page to see all the police station locations in Edmonton. I’ve got some more neat stuff coming with this, so stay tuned.

If you have feedback, let me know!

What’s happening at your local library?

Ever wonder what’s happening at your local Edmonton Public Library branch? Today, finding out becomes easier than ever! I’m excited to announce that ShareEdmonton now contains all EPL events, with new events being continuously added. The events will show up in all the usual spots, but there are a few sections of the website I wanted to highlight:

The EPL has had event listings on its website for a long time now, and while they are quite detailed, they aren’t necessarily the easiest to find or browse. The ability to subscribe to events is also somewhat limited – you can choose the next 2 weeks of all EPL events via RSS, or events at your branch via email. Still, the EPL is ahead of most organizations in that they’ve been able to aggregate all events into a single place.

Shortly after ShareEdmonton launched, Peter Schoenberg, Director of eServices at EPL, got in touch with me to see if we could work together. I explained the idea behind ShareEdmonton, and he outlined some of the digital initiatives the EPL is undertaking. We identified a couple of actions. The first was for EPL to get started with Open Data, by releasing a data file of library locations. The second was for ShareEdmonton to import those locations and all the events taking place at them.

Importing events required a little bit of custom work on both ends – thanks to Peter and his team for working so efficiently and for their patience! Having the EPL events in ShareEdmonton helps us both. For the EPL, it helps users find out about their local libraries, and exposes EPL events to a different and potentially wider audience. It also makes it possible for users to subscribe to events in Outlook, Google Calendar, or any other calendar application supporting iCal. For ShareEdmonton, it’s another important step toward becoming Edmonton’s de facto calendar.

Check out the EPL branches and events on ShareEdmonton!

Introducing ShareEdmonton

Today I’m excited to launch ShareEdmonton, a local aggregation platform for Edmonton and area. With it, I want to redefine local media and improve Edmonton by embracing the fact that communication is increasingly taking place online.

You can think of ShareEdmonton as an events calendar, at least right now. It certainly has that functionality, and I want it to become the de facto events calendar for Edmonton. I’ve taken the opposite approach of most online calendaring sites, such as Upcoming or Eventful. Instead of starting at the global level and working down, I’ve started at the local level. This is a simple, but important distinction.

I believe that place is more important than ever. That’s why place is at the heart of ShareEdmonton. Unlike other sites, each place exists once and only once in ShareEdmonton. If you want to find out what’s going on at the Shaw Conference Centre, you can be confident there’s only one in the system. In addition to individual places, ShareEdmonton currently supports neighbourhoods, such as Downtown. This is a powerful way to roll up data about a collection of places.

What kind of data? Events, obviously, but also tweets. For any event, place, or neighbourhood you can see recent related tweets written by people in the Edmonton area, in real-time. Or you can see all tweets written by local users. Over time, I’ll be adding other kinds of data alongside tweets, including blog posts, photos, and more.

ShareEdmonton is all about aggregating the immense amounts of data available online and helping you find the bits that are important, relevant or interesting to you, through place, topic, or some other filter. Here’s an example – George W. Bush is in town tonight, at the Shaw Conference Centre. Here’s the event page on ShareEdmonton (and here’s the page for the rally against him). On it, you find information about the event, the location, and recent related tweets – people talking about the event. Two more examples, using topic as a filter: weather and traffic. That’s pretty powerful, I think, and has the potential to become even more powerful over time.

What’s available today is just a small part of what I hope the site will become. Today is step one, and there’s a long way to go until the vision is realized. I have grand ambitions for ShareEdmonton!

Here are a few other quick points:

  • Though I’m not calling this a beta, it is a work-in-progress.
  • The entire site features clean, hackable URLs.
  • The site also features Microformats. If you’re running Firefox, install Operator and you’ll see your browser “light up” with events, locations, tagspaces, and more.
  • All tweets pages have RSS feeds, and most event listing pages have both RSS and iCal feeds.
  • ShareEdmonton is not, and will not be, open source. I am and will be embracing the concepts of open data, however, so stay tuned for more on that.
  • The engine is generic, so you could in theory turn on ShareCalgary or an aggregator for another city.
  • As I was quoted on Saturday – I’m really not concerned with the business model at the moment. I want to build something that is valuable first.

I want to say a big thank you to everyone who has provided feedback, done testing, and otherwise helped me out with this, especially Chris, Cam, Reg, Eric, Rob, Dickson, Jas, and Adam. Also, though she probably would rather me not say it, Sharon played a big behind-the-scenes role in this – thanks!

Please check out ShareEdmonton, and let me know what you think. Tweet it, blog it, leave a comment below, email me, or post something on the Uservoice forum I’ve setup. You can also follow ShareEdmonton on Twitter, which is where I’ll announce new features. Thanks!

Tech stuff I’ve been learning about lately

I haven’t done one of these lists in quite a while, so I figured it was time for an update. Here are some of the geeky tech things I’m currently playing with/learning more about:

Facebook Connect
I’ve added support for Facebook Connect to ShareEdmonton, and was surprised at how straightforward it was. Little bit of a learning curve initially, but nothing major. I’m impressed with the way it works.

OAuth
Looking into this one for use with Twitter and Brightkite. I’m not very far along yet, but it also seems fairly straightforward. Check out this ReadWriteWeb article on how a recent OAuth security flaw was addressed by the community.

MSMQ
I’ve been using this since January, actually. It works great, and I wouldn’t hesitate to use it again. I want to explore some of the more advanced uses now.

OpenCalais
You might consider it a semantic web service, because Calais is all about giving meaning to data. I came across it via bit.ly, which uses Calais to automatically extract names, places, and other metadata from the links you shorten.

Google Maps API
Again, this one is fairly straightforward. Lately I’ve been looking into the non-visual services it provides. For example, geocoding and reverse-geocoding in the background, without necessarily having a map on the page.

Public Data Sets on AWS
This one I’ve looked into the least so far, but I’m keen to check it out. In particular, I’d like to explore working with the Freebase data dump. It’s still amazing to me that you can tap into such a vast amount of data with relative ease.

As you can probably guess, almost all of these are related to work I’m doing with ShareEdmonton. I should have an update on that soon.

Recap: DemoCampEdmonton6

Last night was our sixth DemoCamp here in Edmonton, and I think it was probably our best yet. We had around 140 people in attendance, which isn’t much different than DCE4 but it somehow seemed bigger. Maybe it was all the cameras and video cameras? We had Peter Urban and the Smibs TV team record all the demos – watch for the video there soon. I was also really surprised that so many people had never been to DemoCamp before. We’re definitely reaching new people, and I think that’s great!

We had five demos:

  • I showed the first little bit of ShareEdmonton, and EdmontonTechScene. It wasn’t the best demo in the world, but it wasn’t bad for having just two days 🙂
  • Graham Batty showed us bittablog, an interesting microblogging service that he recently cooked up.
  • Ryan Leland showed his unique take on social networking – you-vs-me. It was a definite crowd pleaser thanks to the humorous topics like Cougar-vs-Bear. You can use the democamp invite code to check it out.
  • Mark Matichuk showed us Clinitrust, a secure messaging platform for medical professionals.
  • Our final demo was Peter Urban and Paul Bellows, who showed us their new joint venture (between Smibs and Yellow Pencil). It’s a tool to help move content from one CMS to another.

The general consensus afterward was that Peter & Paul’s was the demo of the night. Though they did a little too much talking in my opinion, the product is definitely intriguing. It’s not hard to see that there’s a big market for what they are doing. It’ll be a time saver, indeed. Hopefully we’ll get to see more of it soon.

DemoCamp Edmonton 6DemoCamp Edmonton 6

See what I mean about the tripods and cameras? After the demos almost everyone wandered over to RATT (Room At The Top) in the Students’ Union Building. A little too much drinking and karaoke ensued, but it was a fun time!

Twitter featured more prominently this time at DemoCamp. We had TwitterFall up on the big screen before we got started, and that encouraged lots of people to start tweeting. Soon after the demos started, we broke into the top ten trending topics at Twitter Search, and eventually rose as high as #7. Very cool!

Don’t miss Walter & Alain’s great list, 10 things I liked about DemoCamp Edmonton 6. Brittney also has a funny post of fun facts about DemoCamp Edmonton 6. Also, Cam and I did an interview with The Gateway, who wrote about DemoCamp and IDEAfest today.

I can’t wait until DCE7! Thanks to everyone who came out last night. If you’d like to be notified about future DemoCamp and BarCamp events in Edmonton, sign up for the mailing list here.