Talking Open at Technocon 2010

I’ve spent the last two days at Technocon 2010, a technology conference jointly hosted by the City of Edmonton and the University of Alberta for their respective IT employees (about 450 of which have attended). With six keynotes and more than fifty breakout sessions on a range of topics (everything from “Fulfillment and Freedom” to “BlackBerry Enterprise Server”) there has been a little something for everyone.

I’m closing the show this afternoon with a keynote on the topic of “open”, which is one of the three themes for the conference (the other two are “world class” and “transformation”). Keeping in mind that I stand between the audience and home-time, I’m going to keep things light and brief. Here are my slides:

The key thought I want to share is that open government is fundamentally about the relationship between government and citizens and less about technology. And related to that, we should avoid the temptation to jump on the open government bandwagon just because it’s the hot new thing, and focus instead on making sure we improve that relationship. Both sides have a role to play, and I hope to bring some of the citizen perspective to the audience. And of course, one of my key messages is that we can work together.

You can watch it live here. Thanks to Technocon for having me!

Recap: Open City Workshop

Saturday’s Open City Workshop at the Art Gallery of Alberta was a fantastic event! Excellent turnout, great discussions, and lots of enthusiasm for the open data/open government movement here in Edmonton. We started the day with some opening remarks from Councillor Don Iveson, CIO Chris Moore, and FusedLogic’s Walter Schwabe. I really liked Don’s key values: transparency, empowerment, and collaboration.

Open City WorkshopOpen City Workshop

Next up was the panel, featuring David Eaves, Nick Charney, Mark Kuznicki, and Alayne Sinclair. They talked about what open government meant to them, took an odd detour into voting, and took some questions from the audience as well. Here are a few of the key things that stood out for me:

  • The idea of government as a platform is not new!
  • It’s about empowering citizens to make the city their own, enabling them to go after their passions.
  • Engagement is often a sign that you need to do something differently, not necessarily that you’re doing something right.
  • Civil servants are citizens too!
  • Open government is part of a broader cultural shift, and citizens have a responsibility to become participants.

I really enjoyed the panel – it was the highlight of the day for me. It was great to finally meet David, Nick, and Mark in person too.

After some forced networking and a break for lunch, the unconference part of the day got underway. We broke into smaller groups to discuss things like the role of journalism and storytelling in open data, the digital divide, thinking beyond technology solutions, and timelines/deliverables.

Open City WorkshopOpen City Workshop

Open City WorkshopOpen City Workshop

I attended the role of journalism and storytelling first, and we seemed to reach the consensus that storytelling is vital for open data/open government to succeed. We need everyone to tell stories, so that we achieve a diverse range of views. We also felt that journalism has a role to play in bridging the gap that exists between those who “get it” and those who don’t. The second session I attended was on engaging residents not familiar with technology. We ended up talking a lot about deliberative dialogue, and I was left with a lot to think about – how will access to open data affect the way a citizen looks at the world? We’re naturally selective, does open data change anything in that regard? For some thoughts on the other two sessions, check out Stella’s recap.

Open City WorkshopOpen City Workshop

Another really great aspect of the day was that it was streamed live online by FusedLogic in both English and French. There were dozens of people participating virtually, from Edmonton and around the world! I understand that they even held their own breakout discussion in the afternoon! Kudos to the FusedLogic team for taking on such a big task, and making it work so well.

At the end of the day, Chris Moore took the stage once again to make a few announcements:

  • An RFP has gone out for the design and implementation of the next generation of productivity technologies at the City of Edmonton.
  • The City of Edmonton is partnering on open311.org, to bring open standards for 311.
  • On April 19, the City of Edmonton is planning to launch an iPhone app called CityWatch, developed by local company Touchmetric.
  • The City of Edmonton is calling for the creation of a “Code for Canada” organization, modeled after Code for America.
  • There will be an Apps4Edmonton app contest in the near future, with the prizes and winners to be showcased at GTEC2010 in October.

Exciting stuff! Congrats to Chris and his team for putting on a great event.

Stay tuned to the #openyeg and #yegdata hashtags on Twitter for updates, as well as the City of Edmonton’s open city page. You can see the rest of my photos here, and you can see the City’s photoset here. You can see a list of the attendees on Twitter here.

I’ll leave you with this TED video of Tim Berners-Lee talking about open data:

Bring on the data!

Open City Workshop & Participation Inequality

The City of Edmonton is hosting a workshop tomorrow at the Art Gallery of Alberta called Building Community through Open Information (on ShareEdmonton). It’s a follow-up to the open data workshop that happened last year and the conversations that have taken place since, but is focused on connecting stakeholders, increasing a shared understanding of Government 2.0, and planning the way forward. Devin wrote some great thoughts on the workshop here.

I’m really looking forward to seeing a diverse local crowd, representing a variety of agencies and interests. I’m also looking forward to meeting special guests David Eaves, Mark Kuznicki, and Nicholas Charney in person. All three are key players in Canada’s open government space.

And while I’m hopeful that we’ll see some new data released tomorrow, I’m mindful that data is not the focus. The three objectives listed on the event details page are about establishing Edmonton as a leader, and then lots of talk. I think the way you establish yourself as a leader is by actually doing things, but I’ll keep an open mind tomorrow :)

One thing I do want to talk about at the workshop is the divide that a number of people have picked up on. It’s great that Edmonton and other places are making progress on opening up data, but how does that impact the average citizen? There’s definitely a perception that only techies understand and can use open data. I don’t think that gives the average citizen enough credit, but I’m willing to concede that open data is not as accessible today as it needs to be. There’s lots of room for improvement.

Having said that, I think it’s important to keep participation inequality in mind:

All large-scale, multi-user communities and online social networks that rely on users to contribute content or build services share one property: most users don’t participate very much. Often, they simply lurk in the background.

If we think of open data (and open government) as a large community, then we should absolutely expect that a small subset of that community will be responsible for most of the activity. In the context of the 90-9-1 rule, 90% of the community won’t participate (they just observe or read), 9% will occasionally participate, and 1% will participate a lot.

Here’s one way to visualize the open community:

I’m sure there are other ways to break it down, but this makes the most sense to me at the moment.

  1. Goverati: these are government employees, folks from related agencies, non-profits, etc.
  2. Creative Professionals: these are people such as myself, developers, designers, etc.
  3. Business: for-profit organizations.
  4. Citizens: ultimately, the beneficiaries of all this open government stuff!

Of course, this picture is somewhat misleading, because all goverati, creative professionals, and business folks are also citizens, but let’s set that aside for now. I think the goverati and some creative professionals fall into the 1% category, the rest of the creative professionals and business fall into the 9% category, and citizens account for the 90% category.

The 90-9-1 pattern can be seen in action all over the web, perhaps most notably on Wikipedia. A tiny percentage of Wikipedia’s user base is responsible for the vast majority of all content produced. I think we can do better with open data/open government, however. Through applications, interactive visualizations, and the other interesting things that the goverati, creative professionals, and businesses build, I think more and more citizens will move from the 90% category to the 9% category.

I guess the point I’m trying to make is that considering how the average citizen benefits from open data is important, but we shouldn’t let that hold us back from making progress at this point. We need to empower businesses and creative professionals to build things that the average citizen will ultimately benefit from. As we do that, there’s an opportunity to educate citizens if they want to be educated!

There’s only a few hours left to register for the event. Hope to see you there!

Edmonton Sun violates the EPS Crime Map Terms of Use

Back in July, the Edmonton Police Service launched its Neighbourhood Crime Mapping site. Like most people I was quite enthusiastic about the site, until I read the terms of use and realized how restrictive they were. Basically you can look at the numbers, but you can’t do anything with them (such as publish them on a blog). The Crime Mapping site is not open data. I emailed back and forth with the EPS, and was told that they wouldn’t be changing the terms of use. And, they haven’t.

That didn’t stop the Edmonton Sun, however. They apparently ignored the terms of use altogether, and published an article on December 20th summarizing a number of statistics from the website:

Some of Edmonton’s roughest neighbourhoods faced markedly fewer crimes in 2009, according to police statistics.

The statistics came through a new crime mapping system launched by Edmonton police last summer.

I had asked for permission to do something similar and was turned down. After reading the Sun article, I emailed the EPS to find out if the terms of use had been changed (despite the text on the website staying the same). Here’s what Acting S/Sgt. John Warden wrote back:

The Edmonton Sun did not have the EPS’ permission to use the information from the Crime Mapping website and the EPS is dealing directly with the Edmonton Sun in relation to this.

I emailed back a couple of follow-up questions, but have not yet received a response. The Edmonton Sun article is still active on the website, so I’m not exactly sure what “dealing directly with the Edmonton Sun” means.

I’m annoyed by this, obviously. Was it an honest mistake? Maybe. Is it a case of a large media organization getting off the hook? Maybe. Will it happen again? Probably. No one reads the fine print, we all know that.

I don’t think the current terms of use is appropriate, and I strongly urge the Edmonton Police Service to change it.

EPS responds to my query about the Crime Mapping terms of use

Last week I posted about the new Crime Mapping site launched by the Edmonton Police Service (EPS). One of my criticisms of the site was the very restrictive terms of use or disclaimer that you must agree to before you can use the site. In particular:

While it is acceptable to pass the website link on to others in your community, you will not share the information found on the website with others other than with members of the Edmonton Police Service or other law enforcement agencies; and

You will only use this website and the information in it so you can inform yourself of, and participate in, this community policing initiative;

This is problematic because it effectively means that you can’t do anything with the data that EPS has now made available. You can look at it using their site, but you can’t then blog about that data, or add it to a PowerPoint presentation.

I emailed a request for clarification and received a response from Amit Sansanwal, Criminal Statistics Coordinator at EPS. I asked for and was granted permission (by their legal department) to publish his response:

The EPS views the Neighbourhood Crime Mapping website as a valuable addition to our community policing initiative.

The EPS, however, is of the view that this tool can only be effective and achieve its community policing objectives if people seeking the information visit the Neighbourhood Crime Mapping website directly themselves.

By visiting the website, hopeful participants in this EPS community policing initiative can learn about what kind of information is available to them (e.g. crime prevention and partnership programs) and how it fits within this program.

We appreciate your interest in this program and hope that you tell others about the existence of the Neighbourhood Crime Mapping website.

In a later email, Amit pointed out that the current preferred way to get EPS statistics is through Statistics Canada.

The crux of their position, if I understand it correctly, is that they don’t want people looking for crime statistics to come across an inaccurate or malicious source. That seems reasonable. The problem is that such a position assumes people are actively seeking the information. By opening up access to the data and allowing others to make use of it, they can potentially reach far more Edmontonians, not to mention the benefits that could come from mashups or other data visualizations. Furthermore, it seems as though they just want to force people to use the Crime Mapping site so that they can promote additional programs to users.

The Crime Mapping site is fun to look at, but I would argue its utility is restricted by the current terms of use. Unfortunately, it doesn’t look like that’ll be changing any time soon.

Data on Edmonton’s new 12-ward system

Last night City Council voted in favor of changing from the current 6-ward system to the more common 12-ward system used throughout North America. The change will take effect for next year’s municipal election. For more background, check out Dave’s post. You can also check out the City of Edmonton’s page for more information.

As an advocate of open data, I thought I’d share with you some data related to the new wards below. All of the data is available on the City website somewhere, but not in an easily consumable form. I’ve done the legwork to make it accessible.

Amendments made to the motion last night affected the wards a little:

  • Grovenor and McQueen neighbourhoods moved from Ward 1 to Ward 6.
  • CPR West moved to Ward 8 from Ward 10.
  • Calgary Trail North and Calgary Trail South moved from Ward 11 to Ward 10.
  • Some ravine boundaries were changed from “in-the-middle” to “top-of-bank”.

Here are the stats on the new wards:

In a table (download CSV file here):

Ward Population Electors
1 62,625 51,061
2 67,306 54,704
3 63,819 49,465
4 67,811 52,666
5 62,424 49,615
6 70,840 62,152
7 63,549 51,865
8 66,196 57,189
9 68,214 53,889
10 61,276 49,935
11 64,770 51,329
12 63,609 48,529

The average population of each ward is 65,203 and the average number of electors for each ward is 52,700. This data comes from the 2009 Municipal Census.

Here are the number of neighbourhoods in each ward:

I’ve also compiled a list of neighbourhoods in each ward which you can download in CSV here. Or if you’d rather just look, you can download the list in PDF here.

I’m trying to track down or create a good quality map of the 12 wards, but this’ll have to do for now. What I’d really love is lat/long coordinates for each ward. If you have something better than that graphic, let me know!

Go do something useful or interesting with this data, and then tell me about it. I’m looking to collect local examples to strengthen the case for open data at the City of Edmonton!

UPDATE: Here’s a better map in PDF format.

UPDATE2: Here’s an even better color map showing the wards and neighbourhoods in PDF format.

Calgary takes first steps toward becoming an Open City

A motion will go before Calgary’s City Council next week that outlines the first steps in the process of making Calgary an Open City. Calgary follows in the footsteps of Vancouver, which passed a similar motion back in May. DJ has all the details on the Calgary motion here. I think it’s pretty cool that the news is first announced on a blog!

Calgary’s motion will result in a report from City Administration to be presented to Council no later than December 2009, outlining the overall strategy for making Calgary an open city. In particular, the report will identify “opportunities to make more of The City’s data open and accessible while respecting privacy and security concerns , and ensuring that data is available through use of open standards, interfaces and formats.” Other aspects of the strategy will include increasing online citizen participation, procuring and supporting open source technologies, and increasing the number of City services available online.

This is exciting news for developers and other creative professionals in Calgary and elsewhere. I’ve been pushing for open data in Edmonton recently, and I really hope we’re not too far behind our southern neighbours on this issue. There are a number of advantages to making data available in open standards and formats:

  • Citizens can subscribe to data that is of interest to them
  • Data can be mashed together in new ways, revealing new information
  • Visualization of data can help citizens make better decisions
  • Citizens can work together to organize data
  • Government can learn more about its data from citizen contributions

Additionally, using well-understood, open formats such as XML or CSV helps to “future-proof” the data. You don’t need proprietary technology to read a CSV file – any programming language or software platform will work.

One issue that isn’t mentioned in Calgary’s motion but which is very important, is licensing. It’s important that when Calgary does make data available, that it does so in the least restrictive way possible. Either public domain, or creative commons, or something similar. It would be a shame if they made a ton of data available and then had ridiculous terms of use around it.

Open data is about empowering citizens to work with their governments. I’m encouraged by the recent interest among municipalities in Canada, and I hope the trend continues.

Edmonton Police Service (EPS) Crime Mapping tool now online

Back in June we learned that the Edmonton Police Service was planning to launch a new website that would enable citizens to find crime statistics for their neighbourhoods. This afternoon, the EPS Crime Mapping tool went online, and it does just that. You can search for stats on eight types of crimes in any neighbourhood across any time period since 2007. From the press release:

The new crime mapping tool will provide members and citizens with a better understanding of what is going on the neighbourhoods they work and live in.

I’ve been playing with the site today, and I like it. There are pros and cons, however.

How It Works

The first step is to agree to the disclaimer – more on that in a minute. Next, you pick the crimes you want statistics for. The eight types include assault, break and enter, homicide, robbery, sexual assaults, theft from vehicle, theft of vehicle, and theft over $5000. Third, you pick the neighbourhood – there are 357 listed in the system. Finally, you select the time period. There are some quick selections such as yesterday or the last 30 days, or you can enter any two dates. Click “Show Crimes” and your neighbourhood appears on the map, covered in colored dots to represent the reported crimes. Here’s what Oliver looks like for the last 30 days with all crime types selected:

There’s also a “View Statistics” tab above the map that will show you a table for the last three years broken down by month, with a graph below that.

The Good

There are some really good things about this site. First and foremost, the data is excellent. I’m glad that they included everything up-front, instead of doing a test release or something to start. Second, it’s built using Google Maps. This is a big win for EPS – it’s a stable technology that Google is continually making better, and I would guess that most Edmontonians are familiar with it. Third, it’s fast. Almost as soon as you click the button, your stats appear.

The Bad

There are two things about the site that I don’t like. First is the disclaimer – it’s too restrictive. These two points in particular are problematic:

While it is acceptable to pass the website link on to others in your community, you will not share the information found on the website with others other than with members of the Edmonton Police Service or other law enforcement agencies; and

You will only use this website and the information in it so you can inform yourself of, and participate in, this community policing initiative;

That effectively means you can’t do anything with the data. This is in direct contrast with what the press release would lead you to believe:

Providing our citizens with the real picture of neighbourhood crime is the first step in engaging them to do something about it. Members of the public will be better equipped with knowledge to work collaboratively with the EPS to reduce and prevent crime.

What’s the point of making the data available if you can’t do anything with it? Why can’t I blog about the crime stats in a particular neighbourhood? Or mash the crime stats up with some other data? I challenge the notion that simply being able to see the dots on a map equips me to do something about crime in my neighbourhood.

I’ve emailed the feedback address listed on the site asking about this, but I haven’t yet received a response.

The second bad thing about the site is that while it does make data available, it does so in an opaque and closed way. If Edmonton is going to become an open city (with respect to data), sites like the crime mapping tool need to provide information for multiple audiences. One is the average citizen who is happy to click around on the map. Another increasingly important audience is the creative professional who wants to do something with the data, and needs it in a machine-readable format such as a CSV or XML file.

The Undocumented API

The first thing I did after testing the site with my neighbourhood was poke around for clues about where the data comes from. It didn’t take long to realize that there’s a JSON web service behind the application. You can access it here. It’s probably not meant for public consumption, but it’s there and it works. I was able to throw some code together in about 30 minutes to get data out of the service. While it would still be good to have static data files available, the API largely negates the con I mentioned above. As it is unofficial however, who knows if it will remain active and working, so enjoy it while you can.

Final Thoughts

Overall I think the Crime Mapping tool is excellent. We need more applications and services like this, though with less restrictive terms/licensing and easier-to-access data. Kudos to EPS for building this, and let’s hope they improve it.

UPDATE: There are more details in this article. For instance, the tool apparently cost $20,000 to build, and is automatically updated each morning.

Foundations for an Open Edmonton

Today at BarCamp, I led a discussion around building an open Edmonton. Inspired by the great things happening in Vancouver, I wanted to stimulate the discussion here. I started with two fundamentals:

  1. The City of Edmonton must have the desire to be an open city.
  2. The primary audience is the Creative Class of Edmonton, the secondary audience is all citizens.

Next, I shared what I feel are the five basic foundations of an open city:

  1. Free – both financially and philosophically
  2. Permissive Licensing – things like Creative Commons, should be public domain
  3. Open Standards – formats that anyone can read and write
  4. Plentiful Data – make as much data available as possible
  5. Timely Access – eliminate delays and give everyone equal access

After my five slides (a photo for each of the above) we got into a great discussion about the idea. Here are some of the questions that came up:

  • Are citizens ready for so much data?
  • Why would City Council not want to be an open city?
  • What is the current state of progress on the idea in Edmonton?
  • How does privacy & security factor in?
  • What are some great examples of other cities doing this?

All things that we need to explore further. I’m not sure what the next step is, but eventually, I think it would be great to make a presentation on becoming an open city to Council.

In the meantime, Edmonton has already made some data available – a Google Transit data feed – and some other examples include London’s mySociety. Also, be sure to read Vancouver’s Open City Motion.