September 14, 2010

Heaps of data from New South Wales

Posted by josediacono @ 2:33 pm under Uncategorized

GIPA is important for NSW mashups because it will lead to more data being released

The Australian Bureau of Statistics hosted a meeting for Statisticians in Sydney on Thursday 2nd September “GIPA and Open Government”. GIPA is the NSW Government Information Public Access which came into force on 1st July 2010. GIPA  replaces the Freedom of Information Act. It encourages and authorizes state and local government, ministers and their staff, state owned corporations (including utilities) and universities to pro-actively release data. Exceptions  “when there is overriding public interest against disclosure” they are clearly specified.

Officials who release data are protected from civil suits.

GIPA  covers  all sorts of data, not just about documents. It can be emails, tables, transcripts, stats, reports or raw data.

The law doesn’t say anything about the format the data has to come in. It could be on paper, or a pdf which wouldn’t be too helpful for a masher. There may still be a lot of scraping and formatting.

Speakers from the ABS, Office of the Information Commissioner, Dept of Fair trading, police examined the implications, benefits and issues raised with great honesty.

Data could be misinterpreted, misused or abused if it was “just dumped out there”.

On the one side were the policy makers saying “data can then be used creatively in ways and combinations bureaucrats and lawyers have never thought about”, on the other were those who fear that is it precisely because data was collected for one particular purpose, that it could lead to dangerous or erroneous assumptions if it were used for another. For example, the police collect operational data about crime. But where drug dealers are found is not necessarily the same place they live or where the drugs are consumed.  Many crimes go unreported, so what if people in a particular suburb are more likely to report more crime than in another? Their suburb then looks more crime-ridden, businesses may not locate in the area, therefore disadvantaging the residents or property values go down.

But like it or not, data will be released and reused. So how do we enable meaningful interpretation and use, while at the same time not tying up public servants in reformatting or explaining data to the extent they can no longer do their regular jobs?

  1. Give an explanation. People won’t necessarily read it but at least the Minister can look at the explanation when questioned about it.
  2. Finding out what people are really asking will help you provide meaningful data – offer additional data if you think it will help.
  3. If you don’t have the information in the form they request, you don’t have to jump through hoops, just be helpful, offer them what you have and explain the limitations.
  4. If the data is incomplete or poor quality, just say so. Tell the story.
  5. Expect questions and criticisms when you release data.
  6. Put frequently requested data on a website. Making it understandable, easy to search and retrieve.
  7. Use the Data Quality Tool from the ABS to create a Quality statement.  This tool was demonstrated and helps both producers and users to assess and compare seemingly similar datasets.
  8. Embrace the opportunity to improve data you release from crowdsourcing.
  9. You can release secondary data (i.e.if you are the Dept of Planning and someone else has collected it) but if the requester would be better served by going to the original source you can refer them on. You can also release any data you hold that has come from outside NSW.
  10. Q What if a private consultant asks you for data they will make a profit from? A If this ties you up and thus impacts on your core business you do not have to release the data because if it stops you doing your job that is not in the public interest.

Good news for parents

Your child is going for their first job in a café. You want to make sure they will be fairly treated. In about 18 months you will be able to look at a NSW website to check whether they have any harassment claims against them, do they pay penalty rates on Saturdays or how many times they have been inspected.

data.nsw.gov.au

Kate Harrington and Helen Palmer of the Government Chief Information Office run the NSW data portal used by the NSW app4state mashup competition.  The goal of data.nsw.gov.au is to be the single point for people to visit for data because it is very hard for outsiders to find what they are looking for. They took us behind the scenes of the portal – what happens when you click on the “Request for Data” button. (Basically a lot of running around by them to get the data from the custodian).

There is an international wave of improved public information access – from the US where every government agency has to release at least 3 datasets (annually??) to the UK where the two most asked for datasets are public toilets and school catchment areas. Their apps4… prefix has spread around the world from Finland to Africa.

August 8, 2010

Tim Berners-Lee: The year open data went worldwide

Posted by josediacono @ 9:53 am under Uncategorized

Talks in less than 6 minutes. My daughter’s Design and Technology teacher put me on to this one. Thanks Kate.

Tim Berners-Lee invented the World Wide Web. He leads the World Wide Web Consortium, overseeing the Web’s standards and development.

go to the TED website

June 28, 2010

Live London Tube map uses new Transport API

Posted by josediacono @ 4:03 pm under Uncategorized

“What a bright spark can do with open data – and the tools to use it”

Live London tube mapThis is developing into an interesting story. A brilliant ‘live’ tube map showing trains zipping around the London tube in near real time, was launched a couple of weeks ago. It shows what you can do when you get open access to official data according to an article in the Sunday Observer. It was obviously widely read.  I couldn’t get on the site at all, but later learned the API has now been suspended due to overwhelming demand.

The Observer article also introduces an interesting new term “securocrat”.

http://www.guardian.co.uk/technology/2010/jun/27/transport-for-london-live-tube-map

Future Gazing

Posted by josediacono @ 2:01 pm under Uncategorized

How will the geospatial data market evolve over the next ten years?

I enjoyed this article by Matt Ball on the vector1media website. Matt looks at the impact of some profound changes that he says will give GIS users more (and for free) data.   Volunteer mapping and quality improvement from crowdsourcing,  not just from things like openstreetmap but also mobile platforms. (I was introduced recently to some new mobile location based games like foursquare that collect all sort of features and information as  a by-product).

Geospatial technologists will be synthesisers of data. Not a long article so well worth browsing to.

June 20, 2010

Citizen Mapping

Posted by josediacono @ 6:21 pm under Uncategorized

Ross Johnson sent me this fascinating article from the Los Angeles Times about openstreetmap. Crowdsourcing maps is becoming a mainstream social activity. With Google  Maps doing it soon (as mentioned in this article),  openstreetmap and even crowdsourcing through mobile games how does a user decide where to source data from? Can we talk in terms of a  single authoritative source anymore?

http://beta.gisdevelopment.net/index.php?option=com_content&view=article&id=17776:240000-volunteers-create-digital-map-of-world&catid=48&Itemid=1

June 15, 2010

Response to government 2.0 report

Posted by josediacono @ 5:53 pm under Uncategorized

The Federal Government has responded to the taskforce generally agreeing to 12 of its 13 key recommendations. There is a new Agimo  blog to track progress

http://agimo.govspace.gov.au/

May 26, 2010

Neogeographers and paleogeographers

Posted by josediacono @ 2:09 pm under Uncategorized

http://vimeo.com/11540899 Not your fathers approach to geodata creation and sharing posted by moderator Peter Batty.  This is quite a long video and I do plan to make a summary of the key points sometime,but for a start there is a very good explanation of openstreetmap as an example of neogeography and powerful pictures from post earth quake Haiti (the building housing the goverment GIS was destroyed in the earthquake so over a matter of days volunteers created new maps from old paper base maps, high res satellite imagery, even Maps from the CIA if I heard correctly – which made a huge difference to the emergency response and saved lives.

Some amusing banter between neogeographers and traditional GIS people cheekily referred to as paleogeographers.

May 24, 2010

Metadata conference

Posted by josediacono @ 12:32 pm under Uncategorized

I just heard Metadata 2010 is on this week in Canberra.

Sharing Data, Sharing Ideas

Canberra | 26-27 May 2010

This conference on metadata management brings together practitioners and managers to discuss issues related to metadata management, with particular emphasis on public sector data and metadata.

I followed the links and found another event on Friday (an “unconference”) covering the wider Information access policy side. Not a lot of notice but you may be able to get copies of the papers or follow the blog. At first I thought it was an online conference but then found it is at ANU

http://www.opengov20initiative.com/index.html

March 12, 2010

Business Intelligence in the clouds

Posted by josediacono @ 10:29 am under Uncategorized

I attended a media briefing yesterday  by MyDials and Netsuite. It was about Right Time Business Intelligence using cloud computing.  By ‘Right Time’, they mean ‘promptly, when you need it’ . Not real time as in industrial control systems, but you don’t need BI updated every second. Per day or hour (even per week!) is probably  much better than many managers are getting now.

While most large companies have their BI in place, its daunting to implement for middle sized and SMEs which is where MyDials concentrates. Companies don’t have big upfront licencing fees, training or hardware costs. Its scalable, low risk. (If the customer doesn’t get value they simply don’t renew their subscription).

I see a big opportunity there for complementing the Software as a Service (SaaS) with Information as a Service (IaaS).  BI is only as good as your data and if you can give your own business data more context but overlaying  public data (such as demographic data for a health fund) it will be so much more powerful. With all the public sector information being made much more freely available (http://data.australia.gov.au/ and its state counterparts) , rather than every company importing and overlaying it, if one service provider can do it,  its a huge productivity gain.

January 26, 2010

Campsites?

Posted by josediacono @ 9:49 am under Uncategorized

Campsites in AlabamaA friend is planning a trip around Australia and has found there is no single place to get information about camping grounds. Google has a category of caravan parks (but only a few dozen throughout Australia) and some camping but it is all mixed up with scout camps and boot camps. There must be lots of datasets in different places – National Parks, camping and caravans nsw have some, but by no means a definitive list. Not easy to find your way around either.  Then when you cross to another state its a whole new search. It is a classic candidate for a Mashup.  I went looking and found a brilliant site in the US at Recreation.gov – it even tells you where you can take your horse! (not many places)  http://www.recreation.gov/campgroundSearchResult.do?topTabIndex=CampingSpot

« Newer PostsOlder Posts »