W3C home > Mailing lists > Public > public-egov-ig@w3.org > May 2013

RE: New open source catalog and list of APIs on Data.gov

From: Brand Niemann <bniemann@cox.net>
Date: Sun, 26 May 2013 16:05:38 -0400
To: "'Eric Mill'" <konklone@gmail.com>
Cc: "'John Erickson'" <olyerickson@gmail.com>, "'Holm, Jeanne M \(1760\)'" <jeanne.m.holm@jpl.nasa.gov>, "'eGov W3C'" <public-egov-ig@w3.org>
Message-ID: <004401ce5a4c$6495b430$2dc11c90$@cox.net>
Thank you. I was looking for something simple like:
http://www.danmandle.com/blog/json-to-csv-conversion-utility/ or

http://json-csv.com/

 

From: Eric Mill [mailto:konklone@gmail.com] 
Sent: Friday, May 24, 2013 10:55 PM
To: Brand Niemann
Cc: John Erickson; Holm, Jeanne M (1760); eGov W3C
Subject: Re: New open source catalog and list of APIs on Data.gov

 

Brand, I've had luck automatically converting JSON to CSV using csvkit's
in2csv:

http://csvkit.readthedocs.org/en/latest/scripts/in2csv.html

 

Also, JSON is a pretty flexible format. Here's a swiss-army-knife-style
toolkit called jq that can do some neat things with it:

http://stedolan.github.io/jq/

 

Finally, JSONView (Firefox
<https://addons.mozilla.org/en-US/firefox/addon/jsonview/> , Chrome
<https://chrome.google.com/webstore/detail/jsonview/chklaanhfefbnpoihckbnefh
akgolnmc?hl=en> ) makes JSON highly readable in the browser - for some data,
much more readable than CSVs would be in Excel. 

 

CSV export would obviously be awesome, but I can understand why JSON was
prioritized first. The catalog API seems optimized for integration, rather
than direct browsing, and JSON is usually a much simpler glue language
between anything written in common web development languages.

 

On Fri, May 24, 2013 at 12:13 AM, Brand Niemann <bniemann@cox.net> wrote:

Data Set Type   Geospatial      66124
Data Set Type   Original                          7808
Data Set Type   Sum Total       73932

No, it is 73,932


-----Original Message-----
From: John Erickson [mailto:olyerickson@gmail.com]
Sent: Thursday, May 23, 2013 9:33 AM
To: Brand Niemann
Cc: Holm, Jeanne M (1760); eGov W3C

Subject: Re: New open source catalog and list of APIs on Data.gov

Brand, see: https://catalog.data.gov/dataset

Oh wait, that's only 73,644...

On Thu, May 23, 2013 at 9:10 AM, Brand Niemann <bniemann@cox.net> wrote:
> Jeanne, Thank you. I heard Doug Nebert announce this yesterday at the
> UCGIS
> 2013 Symposium:
>
> http://ucgis2.org/event-item/preliminary-program
>
>
>
> When I look for the 73,651 data sets, I find only 7,808 at:
> https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv
>
>
>
> So where are the other 65,843?
>
>
>
> My audit for reproducible results is at:
> http://semanticommunity.info/An_Open_Data_Policy
>
>
>
> Thanks, Brand
>
>
>
> Dr. Brand Niemann
>
> Director and Senior Data Scientist
>
> Semantic Community
>
> http://semanticommunity.info
>
> http://gov.aol.com/bloggers/brand-niemann/
>
> 703-268-9314
>
>
>
> From: Holm, Jeanne M (1760) [mailto:jeanne.m.holm@jpl.nasa.gov]
> Sent: Thursday, May 23, 2013 8:42 AM
> To: eGov W3C
> Subject: New open source catalog and list of APIs on Data.gov
>
>
>
> Hi all--
>
>
>
> I invite you to visit Data.gov to see the new catalog for browsing
> U.S. open
> data: http://catalog.data.gov We have combined raw and geospatial data
> from many sources across the U.S. and presented it through an open
> source tool, CKAN.
>
>
>
> In connection with the U.S. Digital Strategy we have also created a
> new list of government APIs:
> http://www.data.gov/developers/page/developer-resources
>
>
>
> Find out more at:
> http://www.data.gov/blog/datagov-launches-new-catalog-and-apis
>
>
>
> --Jeanne Holm
>
>
> **********************************************************
> Jeanne Holm
> Evangelist, Data.gov
> U.S. General Services Administration
>
> Cell: (818) 434-5037
> Twitter/Facebook/LinkedIn: JeanneHolm
> **********************************************************



--
John S. Erickson, Ph.D.
Director, Web Science Operations
Tetherless World Constellation (RPI)
<http://tw.rpi.edu> <olyerickson@gmail.com> Twitter & Skype: olyerickson









 

-- 

@konklone <http://twitter.com/konklone>  | konklone.com |
sunlightfoundation.com | awesomefoundation.org
Received on Sunday, 26 May 2013 20:06:14 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 19:43:28 UTC