Re: New open source catalog and list of APIs on Data.gov

Brand, I've had luck automatically converting JSON to CSV using csvkit's
in2csv:
http://csvkit.readthedocs.org/en/latest/scripts/in2csv.html

Also, JSON is a pretty flexible format. Here's a swiss-army-knife-style
toolkit called jq that can do some neat things with it:
http://stedolan.github.io/jq/

Finally, JSONView
(Firefox<https://addons.mozilla.org/en-US/firefox/addon/jsonview/>,
Chrome<https://chrome.google.com/webstore/detail/jsonview/chklaanhfefbnpoihckbnefhakgolnmc?hl=en>)
makes JSON highly readable in the browser - for some data, much more
readable than CSVs would be in Excel.

CSV export would obviously be awesome, but I can understand why JSON was
prioritized first. The catalog API seems optimized for integration, rather
than direct browsing, and JSON is usually a much simpler glue language
between anything written in common web development languages.


On Fri, May 24, 2013 at 12:13 AM, Brand Niemann <bniemann@cox.net> wrote:

> Data Set Type   Geospatial      66124
> Data Set Type   Original                          7808
> Data Set Type   Sum Total       73932
>
> No, it is 73,932
>
> -----Original Message-----
> From: John Erickson [mailto:olyerickson@gmail.com]
> Sent: Thursday, May 23, 2013 9:33 AM
> To: Brand Niemann
> Cc: Holm, Jeanne M (1760); eGov W3C
> Subject: Re: New open source catalog and list of APIs on Data.gov
>
> Brand, see: https://catalog.data.gov/dataset
>
> Oh wait, that's only 73,644...
>
> On Thu, May 23, 2013 at 9:10 AM, Brand Niemann <bniemann@cox.net> wrote:
> > Jeanne, Thank you. I heard Doug Nebert announce this yesterday at the
> > UCGIS
> > 2013 Symposium:
> >
> > http://ucgis2.org/event-item/preliminary-program
> >
> >
> >
> > When I look for the 73,651 data sets, I find only 7,808 at:
> > https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv
> >
> >
> >
> > So where are the other 65,843?
> >
> >
> >
> > My audit for reproducible results is at:
> > http://semanticommunity.info/An_Open_Data_Policy
> >
> >
> >
> > Thanks, Brand
> >
> >
> >
> > Dr. Brand Niemann
> >
> > Director and Senior Data Scientist
> >
> > Semantic Community
> >
> > http://semanticommunity.info
> >
> > http://gov.aol.com/bloggers/brand-niemann/
> >
> > 703-268-9314
> >
> >
> >
> > From: Holm, Jeanne M (1760) [mailto:jeanne.m.holm@jpl.nasa.gov]
> > Sent: Thursday, May 23, 2013 8:42 AM
> > To: eGov W3C
> > Subject: New open source catalog and list of APIs on Data.gov
> >
> >
> >
> > Hi all--
> >
> >
> >
> > I invite you to visit Data.gov to see the new catalog for browsing
> > U.S. open
> > data: http://catalog.data.gov We have combined raw and geospatial data
> > from many sources across the U.S. and presented it through an open
> > source tool, CKAN.
> >
> >
> >
> > In connection with the U.S. Digital Strategy we have also created a
> > new list of government APIs:
> > http://www.data.gov/developers/page/developer-resources
> >
> >
> >
> > Find out more at:
> > http://www.data.gov/blog/datagov-launches-new-catalog-and-apis
> >
> >
> >
> > --Jeanne Holm
> >
> >
> > **********************************************************
> > Jeanne Holm
> > Evangelist, Data.gov
> > U.S. General Services Administration
> >
> > Cell: (818) 434-5037
> > Twitter/Facebook/LinkedIn: JeanneHolm
> > **********************************************************
>
>
>
> --
> John S. Erickson, Ph.D.
> Director, Web Science Operations
> Tetherless World Constellation (RPI)
> <http://tw.rpi.edu> <olyerickson@gmail.com> Twitter & Skype: olyerickson
>
>
>
>
>


-- 
@konklone <http://twitter.com/konklone> | konklone.com |
sunlightfoundation.com | awesomefoundation.org

Received on Saturday, 25 May 2013 10:35:36 UTC