November 14, 2012

Open Australia Foundation Hackfest

Posted by josediacono @ 8:14 pm under Uncategorized

Sadly I cannot go but perhaps you can? It will be good and you get to see inside the Google offices at Pyrmont Sydney. Well worth it.

OA say “We’re launching an exciting new project very soon that makes it straightforward for ordinary Australians to request information from their government. The site also opens up the whole process of making Freedom of Information requests by making the whole paper (or rather email) trail of request and responses public.

For this hackfest we’re not only inviting hackers to get involved with the technical aspects of the project, we’re also inviting hacks, activists, FOI gurus and anyone else that’s interested in learning more or getting involved with this new project.”

Register at

April 30, 2012

So how are we doing with open data?

Posted by josediacono @ 9:35 am under Uncategorized

I just watched this video again from Tim Berners-Lee (still not so recent, its 2010), reviewing progress on open data and some mashup examples. The one about the water connections (or lack of)  to white and black communities is particularly powerful.

Sadly, in Australia, I heard that has lost government support – it no longer has anyone looking after it. Sounds like a death knell. There is no “most recent datasets” list so its really hard to see if any new data has been posted.

Tim Berners Lee The Year Open Data went World Wide

September 14, 2010

Heaps of data from New South Wales

Posted by josediacono @ 2:33 pm under Uncategorized

GIPA is important for NSW mashups because it will lead to more data being released

The Australian Bureau of Statistics hosted a meeting for Statisticians in Sydney on Thursday 2nd September  about GIPA and Open Government. GIPA is the NSW Government Information Public Access which came into force on 1st July 2010. GIPA  replaces the Freedom of Information Act. It encourages and authorizes state and local government, ministers and their staff, state owned corporations (including utilities) and universities to pro-actively release data. Exceptions  “when there is overriding public interest against disclosure” are clearly specified.

Officials who release data are protected from civil suits.

GIPA  covers  all sorts of data, not just about documents. It can be emails, tables, transcripts, stats, reports or raw data.

The law doesn’t say anything about the format the data has to come in. It could be on paper, or a pdf which wouldn’t be too helpful for a masher. There may still be a lot of scraping and formatting.

Speakers from the ABS, Office of the Information Commissioner, Dept of Fair trading, police examined the implications, benefits and issues raised with great honesty.

Data could be misinterpreted, misused or abused if it was”just dumped out there”.

On the one side were the policy makers saying “data can then be used creatively in ways and combinations bureaucrats and lawyers have never thought about”, on the other were those who fear that is it precisely because data was collected for one particular purpose, that it could lead to dangerous or erroneous assumptions if it were used for another. For example, the police collect operational data about crime. But where drug dealers are found is not necessarily the same place they live or where the drugs are consumed.  Many crimes go unreported, so what if people in a particular suburb are more likely to report more crime than in another? Their suburb then looks more crime-ridden, businesses may not locate in the area, therefore disadvantaging the residents or property values go down.

But like it or not, data will be released and reused. So how do we enable meaningful interpretation and use, while at the same time not tying up public servants in reformatting or explaining data to the extent they can no longer do their regular jobs?

  1. Give an explanation. People won’t necessarily read it but at least the Minister can look at the explanation when questioned about it.
  2. Finding out what people are really asking will help you provide meaningful data and offer additional data if you think it will help.
  3. If you don’t have the information in the form they request, you don’t have to jump through hoops, just be helpful, offer them what you have and explain the limitations.
  4. If the data is incomplete or poor quality, just say so. Tell the story.
  5. Expect questions and criticisms when you release data.
  6. Put frequently requested data on a website. Making it understandable, easy to search and retrieve.
  7. Use the Data Quality Tool from the ABS to create a Quality statement.  This tool was demonstrated and helps both producers and users to assess and compare seemingly similar datasets.
  8. Embrace the opportunity to improve data you release from crowdsourcing.
  9. You can release secondary data (i.e.if you are the Dept of Planning and someone else has collected it) but if the requester would be better served by going to the original source you can refer them on. You can also release any data you hold that has come from outside NSW.
  10. Q What if a private consultant asks you for data they will make a profit from? A If this ties you up and thus impacts on your core business you do not have to release the data because if it stops you doing your job that is not in the public interest.

Good news for parents

Your child is going for their first job in a cafe. You want to make sure they will be fairly treated. In about 18 months you will be able to look at a NSW website to check whether they have any harassment claims against them, do they pay penalty rates on Saturdays or how many times they have been inspected.

Kate Harrington and Helen Palmer of the Government Chief Information Office run the NSW data portal used by the NSW app4state mashup competition.  The goal of is to be the single point for people to visit for data because it is very hard for outsiders to find what they are looking for. They took us behind the scenes of the portal “what happens when you click on the ‘Request for Data’ button”. (Basically a lot of running around by them to get the data from the custodian).

There is an international wave of improved public information access:  from the US where every government agency has to release at least 3 datasets (annually??) to the UK where the two most asked for datasets are public toilets and school catchment areas. Their apps4 prefix has spread around the world from Finland to Africa.

August 1, 2010

Another Election Mashup

Posted by josediacono @ 6:12 am under Uncategorized

This was created by Google engineers did for the upcoming federal election:

It uses the latest version of the Google Maps API (v3), which is optimized for mobile phone web browsers.

April 30, 2010

Reducing congestion in Holland

Posted by josediacono @ 10:58 am under Uncategorized

As a former Dutch resident and hearing about regular and horrendous gridlock on Dutch motorways I was interested to read about Dutch plans to track every vehicle and charge based on kms  – so no more set vehicle registration fees, just a pay-for-infrastructure use system. I’ve always felt that fixed registration fees encourage you to use your car rather than public transport – because you’ve already paid a lot before you even get into the car. So I hope this goes ahead (starts in 2012)and it works also looks at the privacy issues

Tagged as ,
November 12, 2009

Posted by josediacono @ 11:50 am under Uncategorized

scroll to the bottom for a short video explaining how it all works