Great idea and much needed move ;)
Within the Hadoop platform, the MapReduce framework is focused on distributed batch processing.
Other frameworks are more focused on streaming…
=> Have you considered the pros and cons?
FYI, we are using the DBpedia Extraction framework at Yahoo Labs for some projects, and have been thinking about porting it to Hadoop for some time.
We may be able to help…
--
Nicolas Torzec
Yahoo Labs
From: Dimitris Kontokostas <kontokostas@informatik.uni-leipzig.de<mailto:kontokostas@informatik.uni-leipzig.de>>
Date: Thursday, March 6, 2014 at 5:04 AM
To: "semantic-web@w3.org<mailto:semantic-web@w3.org>" <semantic-web@w3.org<mailto:semantic-web@w3.org>>, Linked Data community <public-lod@w3.org<mailto:public-lod@w3.org>>, DBpedia Discussions <dbpedia-discussion@lists.sourceforge.net<mailto:dbpedia-discussion@lists.sourceforge.net>>, DBpediaDevelopers <dbpedia-developers@lists.sourceforge.net<mailto:dbpedia-developers@lists.sourceforge.net>>, "dbp-spotlight-users@lists.sourceforge.net<mailto:dbp-spotlight-users@lists.sourceforge.net>" <dbp-spotlight-users@lists.sourceforge.net<mailto:dbp-spotlight-users@lists.sourceforge.net>>, DBpediaSpotlight Developers <dbp-spotlight-developers@lists.sourceforge.net<mailto:dbp-spotlight-developers@lists.sourceforge.net>>
Subject: [Dbpedia-discussion] MapReduce expert needed to help DBpedia [as GSoC co-mentor]
Dear all,
We want to adapt the DBpedia extraction framewok to work with a MapReduce framework. [1]
We want to implement this idea through GSoC 14 and already got two interested students [2] [3].
Unfortunately we are not experienced in this field and our existing contacts could not join. Thus, we are looking for someone to help us mentor the technical aspects of this project.
About GSoC (http://en.wikipedia.org/wiki/GSoC)
The Google Summer of Code (GSoC) is an annual program, first held from May to August 2005,[1]<http://en.wikipedia.org/wiki/GSoC#cite_note-LinSOC-1> in which Google awards stipends (of US$5,500, as of 2014) to all students who successfully complete a requested free and open-source software coding project during the summer.
See some additional info on our page [4]
Best,
Dimitris
[1] http://wiki.dbpedia.org/gsoc2014/ideas/ExtractionwithMapReduce/
[2] student #1<http://sourceforge.net/mailarchive/forum.php?thread_name=CA%2Bu4%2Ba3g3dSd9L%3DM173hryYPp9HjwtNYgUU6Jcedy9MUAmzMVA%40mail.gmail.com&forum_name=dbpedia-gsoc>
[3] student #2<http://sourceforge.net/p/dbpedia/mailman/dbpedia-gsoc/thread/CAOk94WbB7%2BEzaWveP4OWCGeXvKdVUv790wAL%2BuRsoxTb1VEDeQ%40mail.gmail.com/#msg32063932>
[4] http://wiki.dbpedia.org/gsoc2014?v=kx0#h358-6
--
Dimitris Kontokostas
Department of Computer Science, University of Leipzig
Research Group: http://aksw.org
Homepage:http://aksw.org/DimitrisKontokostas