- From: Giovanni Tummarello <g.tummarello@gmail.com>
- Date: Mon, 15 Jun 2009 02:41:14 -0400
- To: martin.hepp@ebusiness-unibw.org
- Cc: Frederick Giasson <fred@fgiasson.com>, "public-lod@w3.org" <public-lod@w3.org>
We are currently processing from 500 to 50000 pings per day in sindice. (this is excluding semantic sitemaps, and excluding crawler findings) We are now scaling using hadoop, so that each one is completely reassoned upon (closure of all the imported or simply "mentioned" ontologies) before being indexed. This is performed on hadoop so we can scale to 500000 or whatever, just add servers. (this was described a few days ago on http://blog.sindice.com ) If they community wants them for a reason i'll be happy to implement a ping "giveout" api I am not sure however how having such a mass of pings with no filter or some capability on top can help. What about RSS and pings on specific URIs or searchers? (like long standing queries?) wouldnt that be better? If we can agree on some specs (and there are actual uses for it) we'll be very happy to support. Giovanni On Sun, Jun 14, 2009 at 10:54 AM, Martin Hepp (UniBW)<martin.hepp@ebusiness-unibw.org> wrote: > Dear all: > > I am sure you all agree that PingTheSemanticWeb is a key service for many of > our applications. Unfortunately, it does currently not support the bulk > notification for datasets for which a semantic sitemap is available. > > Since some of you maybe facing the same problem, I just put a short Python > script on-line at > > http://www.ebusiness-unibw.org/wiki/PTSW4Sitemaps > > which you can use to notify PingTheSemanticWeb of multiple files using a > given semantic sitemap. > > Best > Martin > -------------------------------------------------------------- > > martin hepp > e-business & web science research group > universitaet der bundeswehr muenchen > > e-mail: mhepp@computer.org > phone: +49-(0)89-6004-4217 > fax: +49-(0)89-6004-4620 > www: http://www.unibw.de/ebusiness/ (group) > http://www.heppnetz.de/ (personal) > skype: mfhepp > > Check out the GoodRelations vocabulary for E-Commerce on the Web of Data! > ======================================================================== > > Webcast explaining the Web of Data for E-Commerce: > ------------------------------------------------- > http://www.heppnetz.de/projects/goodrelations/webcast/ > > Tool for registering your business: > ---------------------------------- > http://www.ebusiness-unibw.org/tools/goodrelations-annotator/ > > Overview article on Semantic Universe: > ------------------------------------- > http://tinyurl.com/goodrelations-universe > > Project page and resources for developers: > ----------------------------------------- > http://purl.org/goodrelations/ > > Upcoming events: > --------------- > Full-day tutorial at ESWC 2009: The Web of Data for E-Commerce in One Day: A > Hands-on Introduction to the GoodRelations Ontology, RDFa, and Yahoo! > SearchMonkey > > http://www.eswc2009.org/program-menu/tutorials/70 > > Talk at the Semantic Technology Conference 2009: Semantic Web-based > E-Commerce: The GoodRelations Ontology > More information: http://www.semantic-conference.com/session/1881/ > > Slides: http://tinyurl.com/semtech-hepp > > >
Received on Monday, 15 June 2009 06:42:14 UTC