RE: New open source catalog and list of APIs on Data.gov

Thank you. I updated my data science app at:
http://semanticommunity.info/An_Open_Data_Policy

 

From: Gannon Dick [mailto:gannon_dick@yahoo.com] 
Sent: Thursday, May 30, 2013 5:04 PM
To: Holm, Jeanne M (1760); Brand Niemann; 'eGov W3C'
Subject: Re: New open source catalog and list of APIs on Data.gov

 

Thanks, Jeanne.  That is how I spent my Memorial Day Vacation.

I encountered a raft of interoperability problems with the mixed data
formats in the same file, and at the end a nasty volume of download issue.
But ... Dinosaurs Rule!  The zip file
(http://www.rustprivacy.org/2013/egov/catalog/DataDotGovCatalog.zip) (2.3
MB) contains a listing by Agency/Sub-Agency/Report Name along with a direct
link (look in the Drupal lower window).  In addition the zip file contains
an XML File with detailed micro-data (from the Agency/Provider).  The file
is UTF-8 and Unicode Compliant (meaning the XML has no unescaped HTML
entities).
--Gannon

  _____  

From: "Holm, Jeanne M (1760)" <jeanne.m.holm@jpl.nasa.gov>
To: Brand Niemann <bniemann@cox.net>; 'eGov W3C' <public-egov-ig@w3.org> 
Sent: Thursday, May 30, 2013 1:49 PM
Subject: Re: New open source catalog and list of APIs on Data.gov





Hi all--

 

Here's the way to download the entire catalog.  The Data.gov catalog
(exclusive of geospatial data) can still be accessed at
https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv  You can use the
export button at the top right to be able to download it in a variety of
formats.

 

The API is another way to access the entire catalog.

 

We are exploring other ways to make the newly integrated catalog available.

 

--Jeanne


**********************************************************
Jeanne Holm
Evangelist, Data.gov
U.S. General Services Administration

Cell: (818) 434-5037
Twitter/Facebook/LinkedIn: JeanneHolm
**********************************************************

 

From: Brand Niemann <bniemann@cox.net>
Date: Thursday, May 23, 2013 7:34 AM
To: Jeanne Holm <Jeanne.M.Holm@jpl.nasa.gov>, eGov W3C
<public-egov-ig@w3.org>
Subject: RE: New open source catalog and list of APIs on Data.gov

 

Thanks, Jeanne. Please send me the link to download the entire and new data
catalog.

 

I am getting ready for: On Thursday, May 23rd at 2:00PM ET, Federal Chief
Information Officer Steven VanRoekel will host a conference call to discuss
the 1-yr Anniversary of the  <http://whitehouse.gov/digitalgov> Digital
Government Strategy and ongoing Administration efforts to drive innovation
through open data and other initiatives.

 

Brand

 

From: Holm, Jeanne M (1760) [mailto:jeanne.m.holm@jpl.nasa.gov] 
Sent: Thursday, May 23, 2013 10:10 AM
To: Brand Niemann; 'eGov W3C'
Subject: Re: New open source catalog and list of APIs on Data.gov

 

Brand--

 

As John pointed out, the entire and new catalog (as of this morning) is
available at https://catalog.data.gov/dataset <http://catalog.data.gov/>  

 

The catalog at https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv is
our previous catalog of "raw" data that is not part of the larger catalog
above.

 

The number differs from our earlier number of datasets:  The total number of
datasets reflects datasets plus data series. A data series may contain a
large number of additional products or files of the same type. The previous
Data.gov catalog counted the individual datasets and not just the series and
therefore had a higher total number of datasets noted. The change in number
does not reflect a change in the size of the catalog, but rather a different
structure of data products in the new catalog.

 

Hope this helps to address any confusion.

 

--Jeanne


**********************************************************
Jeanne Holm
Evangelist, Data.gov
U.S. General Services Administration

Cell: (818) 434-5037
Twitter/Facebook/LinkedIn: JeanneHolm
**********************************************************

 

  _____  

From: Brand Niemann <bniemann@cox.net>
To: "'Holm, Jeanne M (1760)'" <jeanne.m.holm@jpl.nasa.gov>; 'eGov W3C'
<public-egov-ig@w3.org> 
Sent: Thursday, May 23, 2013 8:10 AM
Subject: RE: New open source catalog and list of APIs on Data.gov

 

Jeanne, Thank you. I heard Doug Nebert announce this yesterday at the UCGIS
2013 Symposium:

http://ucgis2.org/event-item/preliminary-program

 

When I look for the 73,651 data sets, I find only 7,808 at:
<https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv>
https://explore.data.gov/Other/Data-gov-Catalog/pyv4-fkgv

 

So where are the other 65,843?

 

My audit for reproducible results is at:
http://semanticommunity.info/An_Open_Data_Policy

 

Thanks, Brand

 

Dr. Brand Niemann

Director and Senior Data Scientist

Semantic Community

http://semanticommunity.info <http://semanticommunity.info/> 

http://gov.aol.com/bloggers/brand-niemann/

703-268-9314

 

From: Holm, Jeanne M (1760) [mailto:jeanne.m.holm@jpl.nasa.gov] 
Sent: Thursday, May 23, 2013 8:42 AM
To: eGov W3C
Subject: New open source catalog and list of APIs on Data.gov

 

Hi all--

 

I invite you to visit Data.gov to see the new catalog for browsing U.S. open
data: http://catalog.data.gov <http://catalog.data.gov/>  We have combined
raw and geospatial data from many sources across the U.S. and presented it
through an open source tool, CKAN. 

 

In connection with the U.S. Digital Strategy we have also created a new list
of government APIs: http://www.data.gov/developers/page/developer-resources 

 

Find out more at:
http://www.data.gov/blog/datagov-launches-new-catalog-and-apis  

 

--Jeanne Holm


**********************************************************
Jeanne Holm
Evangelist, Data.gov
U.S. General Services Administration

Cell: (818) 434-5037
Twitter/Facebook/LinkedIn: JeanneHolm
**********************************************************