- From: Paul Houle <ontology2@gmail.com>
- Date: Thu, 15 Sep 2016 17:57:00 -0400
- To: Brian.Ulicny@thomsonreuters.com
- Cc: Giovanni Tummarello <g.tummarello@gmail.com>, Linked Data community <public-lod@w3.org>
- Message-ID: <CAE__kdSd7G_nnKdok_vgZeJ=Y6eoQjmZA77bdweqGUdV24JOzQ@mail.gmail.com>
We have an internal framework that is, for lack of a better comparison,
something like SPARQLmotion. Data processing is done by linking together
a number of "Artifacts" that communicate by passing RDF graphs around. For
instance, to read the "Enron Emails" data set, import them into Elastic
Search, and then view in Kibi, we wire up a "Email Parser" artifact to
the artifact defined at the end on this email., configured with the simple
and beautiful turtle language.
There are a lot of things you can miss because of the simplicity of this
example, but note that when we say
<java:com.ontology2.rdf.mogrifier.fn.LocalDateTimeInTexas>
we are importing a plain ordinary Java class (no special signature) to do
time zone conversion. A case study of a system based on this framework
here:
http://ontology2.com/the-book/legalentityidentifier-info.html
Note that we use Kibi to do analysis on the LEI case by simply appending
some turtle to the job definition, which is where we get the gfx you see
here
https://legalentityidentifier.info/lei/doc/page/statistics/
It is a nice example of how you take RDF Graph A and RDF Graph B, take the
union of them, and you have something new.
[] a :ElasticSearchArtifact ;
:name e:searchIndex;
:input :ROOT ;
:indexName "enron" ;
:endpoint "http://localhost:9330/" ;
:field [ :fieldName "bcc" ;
:property em:bcc ;
] ;
:field [ :fieldName "date" ;
:property em:date ;
es:type "date" ;
es:format "date_optional_time" ;
:transform
<java:com.ontology2.rdf.mogrifier.fn.LocalDateTimeInTexas>
] ;
:field [ :fieldName "cc" ;
:property em:cc
] ;
:field [ :fieldName "to" ;
:property em:to
] ;
:field [ :fieldName "contentIds" ;
:property em:contentIds
] ;
:field [ :fieldName "from" ;
:property em:from
] ;
:field [ :fieldName "replyTo" ;
:property em:replyTo
] ;
:field [ :fieldName "plainContent" ;
:property em:plainContent ;
es:index "analyzed" ;
] ;
:field [ :fieldName "subject" ;
:property em:subject ;
es:index "analyzed" ;
] .
On Thu, Sep 15, 2016 at 3:18 PM, <Brian.Ulicny@thomsonreuters.com> wrote:
> Can you give us an overview of how you get RDF into Kibi and what you do
> with it there? Not familiar with Kibi at all.
>
> Brian Ulicny
> ------------------------------
> *From:* Paul Houle [ontology2@gmail.com]
> *Sent:* Thursday, September 15, 2016 1:52 PM
> *To:* Giovanni Tummarello
> *Cc:* Linking Open Data
> *Subject:* Re: Kibi 4.5.3 is out. Open positions
>
> Actually it is not hard to get RDF data into Kibi at all. We do it all
> the time.
>
> On Thu, Sep 15, 2016 at 6:26 AM, Giovanni Tummarello <
> g.tummarello@gmail.com> wrote:
>
>> Dear all,
>>
>> this might not be a (RDF based) Linked Data but it turns out to be a
>> tremendously useful tool for looking into.. any data that is linked.
>>
>> You might want to find out why *Investigation agencies, pharmaceuticals,
>> financials, manufacturing, health care providers, market intelligence
>> companies, cloud data providers, telecoms, oil and gas it companies and
>> others* are now using Kibi to search and real time updated, mixed
>> textual-structured, linked datasets consisting of * database tables,
>> operational logs, news, IOT sensors and whatever else.*
>>
>> Kibi is free and open source, just download from http://siren.solution
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__siren.solution&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=4Fg0eG2f8eS4iMfW8mvBR97ers10y4wyyUqPdt5KF2s&e=>
>> and use away.
>>
>> Kibi is easy to extend, being based and kept in sync on the popular
>> Kibana platform. Many tutorials on how to write plugins are now available.
>>
>> Intrigued? We are now hiring key positions in the Pharma, Investigate and
>> IT Security verticals
>>
>> *Make the difference*, help discover drugs way faster, fight terrorism,
>> optimize operations by joining the team of people that brought to you
>> Sindice, Any23, Freebase Parallax, Sig.ma, Siren for Solr/Elasticsearch,
>> MIT Exhibit, Google Refine
>>
>> Webinar today by the way.. you might want to sign up
>>
>> best
>> Gio
>>
>> ---------- Forwarded message ----------
>>
>>
>>
>> Kibi 4.5.3 is out: CSV Export, Cross Dashboard time sync, tab filter icons
>>
>> Hi all, we're very very happy to announce Kibi 4.5.3-3 in both Community
>> and Enterprise edition.
>>
>> On top of all of Kibana 4.5.3, the new main features exclusive to Kibi
>> are:
>> *CVS Export is here (for the rest of us)*
>>
>> CVS Export has been an awaited feature in Kibana 4 since basically when
>> it was born, but it won't be available until Kibana 5 is out (requiring ES
>> 5 etc) - and consequently Kibi 5.
>>
>> Kibi 4.5.3 cuts the queue and will make happy all those that wish to
>> export small to mid size data (up to 10,000s lines) e.g. to Excel
>> spreadsheets.
>>
>> The Kibi table now has a simply export button, which works Just Fine.
>>
>>
>>
>>
>>
>> *Cross Dashboard time synchronization *
>>
>> What transactions where made during that same email investigation week?
>> Which of the 10 router produced the most logs during those 10 minutes?
>>
>> Which articles this year mentioned companies also founded this year (
>> *relational*+cross filter)?
>>
>> Whatever you are using Kibi for, this is a handy feature, available in
>> the timefilter panel.
>>
>>
>> Filter Situational Awareness: introducing filter tab indicators
>>
>> We now have funnel icons that indicate when a target join dashboard is
>> not showing "all" the records for any reason.
>>
>> In the screeshot below, you know that those "163" companies you're going
>> to get if you press the button are not really from "all the companies".
>>
>> Instead, the funnel is telling us that the *companies dashboard*
>> contains a filter already so the set it will be joined to only has 3060
>> companies at this time.
>>
>> (This might or might not be what the analyst wanted, so good to be aware
>> of this).
>>
>>
>>
>> Also new in 4.5.3
>>
>> -
>>
>> *Support for object migration* from previous Kibi (now starting from 4.4.2)
>> - this will now be a standard Kibi feature.
>> -
>>
>> Upgraded ElasticSearch version to 2.3.4, imported all new Kibana
>> features up to 4.5.3
>> -
>>
>> Various bug fixes, stability, performance and documentation
>> improvements
>> -
>>
>> Scalability improvements and added advanced option: kibi:
>> graphMaxConcurrentCalls [Enterprise Edition only]
>> -
>>
>> Added more graph scripts to Graph Browser [Enterprise Edition only]
>>
>> ...and don't* miss our Graph Analytics feature Webinar.. Today :)*
>>
>> One of the features of Kibi Enterprise Editions is Graph Analytics.
>>
>> We have been invited by Keylines - provider of the amazing commercial
>> graph analysis library that Kibi embeds - to give a webinar on Kibi and
>> this feature,
>>
>> *Today 6PM CET, 5PM BST*
>>
>> More about it in our latest blog post
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoibjJieU80LWhGRDd3bEJXSGUwUm5fWEhfNUNVIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5Fbmx0cj1NVFU3TWp0b2RIUndjem92TDNOcGNtVnVMbk52YkhWMGFXOXVjeTlyYVdKcExXdHBZbUZ1WVMxclpYbHNhVzVsY3kxbmNtRndhQzFoYm1Gc2VYUnBZM010YVc1MGNtOHRZVzVrTFhkbFltbHVZWEl2T3p0aE5qVXhZekkzTkRkak1EbGxZbVV6TWpVNU9XSXpPR1prWkRJd05tWTBOQSUzRCUzRFwiLFwiaWRcIjpcImNkODRiNGIzYTg2OTRiOWQ4MzY4MjM0YmMzNjI0ZjQyXCIsXCJ1cmxfaWRzXCI6W1wiMGFhMzE3NTk1MzY5MDVkMjVkNGUyMjM2ZGFmNGNhN2NhNmRmOTBhYVwiXX0ifQ&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=1IRCuCS4VvuCUMr9fcOMk3HUI4fYGo7E7fwwL7p5CXg&e=> and
>> register HERE
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoiMldIOUFqSHA1QkExUzFON1g1VFhtQnFCY2pBIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5Fbmx0cj1NVFU3TWp0b2RIUndjem92TDJGMGRHVnVaR1ZsTG1kdmRHOTNaV0pwYm1GeUxtTnZiUzl5WldkcGMzUmxjaTgwTlRBd01UQTJPRFUxTlRreE5ESTJPREU1T3p0bU1UVXlZVGhtWkRFd016QTFNV1V5TXpFMU0yRXdZMlF3TWpRMllXUXhaZyUzRCUzRFwiLFwiaWRcIjpcImNkODRiNGIzYTg2OTRiOWQ4MzY4MjM0YmMzNjI0ZjQyXCIsXCJ1cmxfaWRzXCI6W1wiMGFhMzE3NTk1MzY5MDVkMjVkNGUyMjM2ZGFmNGNhN2NhNmRmOTBhYVwiXX0ifQ&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=vwxNj8li6ERWMT0X7J3478uIN-pEJ_kbXa4Y5ghu8AE&e=>
>> .
>>
>> Make sure to register even if you cannot make this time, we'll send a
>> recording to all registered people.
>>
>>
>>
>> Ciao!
>>
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoiTHRBTmtHeFRJU2NFZjE5d1R1b05TSXhzUThFIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5Fbmx0cj1NVFU3TWp0b2RIUndjem92TDNSM2FYUjBaWEl1WTI5dEwzTnBjbVZ1YzJWaGNtTm9PenRoWXpJMlkyVmhPRE5rWm1ZM1pUZzJNemRqWVdZMVkyWXpOemRqTUdGbE1RJTNEJTNEXCIsXCJpZFwiOlwiY2Q4NGI0YjNhODY5NGI5ZDgzNjgyMzRiYzM2MjRmNDJcIixcInVybF9pZHNcIjpbXCIwYWEzMTc1OTUzNjkwNWQyNWQ0ZTIyMzZkYWY0Y2E3Y2E2ZGY5MGFhXCJdfSJ9&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=4rhBUCpFXvc-lXbXT_T8L1Ct4mqHPUYY4gPoIMk8NXU&e=>
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoiNXVBc2RSMm52al9SaVpJSjNqYkRRUXdudnhBIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5Fbmx0cj1NVFU3TWp0b2RIUndjem92TDNkM2R5NTViM1YwZFdKbExtTnZiUzlqYUdGdWJtVnNMMVZEUzBkelF5MTJSREk0Y2pkb1Z6WlVPVkZ6Y0V0UVFUczdNRE5pWkRSa05tUm1NMkkyT1Rka09HTTNNek15WldSbFlXVmhOVGd3TVdFJTNEXCIsXCJpZFwiOlwiY2Q4NGI0YjNhODY5NGI5ZDgzNjgyMzRiYzM2MjRmNDJcIixcInVybF9pZHNcIjpbXCIwYWEzMTc1OTUzNjkwNWQyNWQ0ZTIyMzZkYWY0Y2E3Y2E2ZGY5MGFhXCJdfSJ9&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=TPh7eBKb4jCsmCrvj_NykIqQlXZznvZwP8tGKeaW_Ow&e=>
>> ------------------------------
>>
>> Unit 13 GTC, Mervue Park, Galway - Ireland
>>
>> Copyright © 2011-2016 SIREn Solutions - Elasticsearch, Kibana, Logstash
>> are trademarks of Elasticsearch BV, registered in the U.S. and in other
>> countries.
>>
>> To unsubscribe click here
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoiWGlxUHdpOVBJRVlCODZOdW16cmZRN1ZOYkFBIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5FbmE9dSZuaz0yLWEwNjlhYjE4ZjEmbmVrPTE1XCIsXCJpZFwiOlwiY2Q4NGI0YjNhODY5NGI5ZDgzNjgyMzRiYzM2MjRmNDJcIixcInVybF9pZHNcIjpbXCIwYWEzMTc1OTUzNjkwNWQyNWQ0ZTIyMzZkYWY0Y2E3Y2E2ZGY5MGFhXCJdfSJ9&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=7VoBd6TvEBCrn4QasNfTaW2mAwEOcSOYnXiPBS08dHU&e=>,
>> to edit your subscription click here
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__mandrillapp.com_track_click_30724552_siren.solutions-3Fp-3DeyJzIjoiMnA3QXQ5VEx6T2VRQ0kzRHFFSFhubnVCMmtjIiwidiI6MSwicCI6IntcInVcIjozMDcyNDU1MixcInZcIjoxLFwidXJsXCI6XCJodHRwczpcXFwvXFxcL3NpcmVuLnNvbHV0aW9uc1xcXC8-5FbmE9cCZuaz0yLWEwNjlhYjE4ZjFcIixcImlkXCI6XCJjZDg0YjRiM2E4Njk0YjlkODM2ODIzNGJjMzYyNGY0MlwiLFwidXJsX2lkc1wiOltcIjBhYTMxNzU5NTM2OTA1ZDI1ZDRlMjIzNmRhZjRjYTdjYTZkZjkwYWFcIl19In0&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=r0TILBK0pdKTv6Eb8l5doIueu3qYSWH_wpo9HKqlQ9k&e=>
>> .
>>
>>
>>
>>
>
>
> --
> Paul Houle
>
> (607) 539 6254 paul.houle on Skype ontology2@gmail.com
>
> Ontology2 Edition of DBpedia 2015-10
> https://aws.amazon.com/marketplace/pp/B01HMUNH4Q/
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__basekb.com_gold_&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=6dPh9TLi-ODABnnhbwbO3Y1bDFGgKI5b1VYY8x3jCp0&e=>
> http://ontology2.com/the-book/o2dbpedia-info.html
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__ontology2.com_the-2Dbook_o2dbpedia-2Dinfo.html&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=6RNCqRhJ5zk0dMyE2hlWzyruruD3kpy6CTK4lN2LfrA&e=>
> http://ontology2.com/book/chapter2/part1/dbpedia-examples.html
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__ontology2.com_book_chapter2_part1_dbpedia-2Dexamples.html&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=oNhhHHcQi2KephS0eaSjutfOzD2nXaIK_Kf0rdAWg-c&e=>
>
> RDF: A new Slant
> http://ontology2.com/the-book/rdf-a-new-slant.html
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.linkedin.com_grp_home-3Fgid-3D8267275&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=0oRMdFUBSPJ6ILRRi5qEt4MN3bxrhCja_Wm7-QZKRbA&e=>
>
> Data Lakes, Data Ponds, and Data Droplets
> http://ontology2.com/the-book/data-lakes-ponds-and-droplets.html
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__ontology2.com_the-2Dbook_data-2Dlakes-2Dponds-2Dand-2Ddroplets.html&d=CwMFaQ&c=4ZIZThykDLcoWk-GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=MWFkXZKGzjUiPsZJmvKkJFzcfjNv8b2-O-FtVxe_lKo&m=6HNXMj2TXZcm77rN1z1hfWpUyinwlGkyiNvu_n17km8&s=R9JciN09dJ-w8mZhETJExjlF-hnn30UR50i5SmhYpso&e=>
>
--
Paul Houle
(607) 539 6254 paul.houle on Skype ontology2@gmail.com
Ontology2 Edition of DBpedia 2015-10
https://aws.amazon.com/marketplace/pp/B01HMUNH4Q/ <http://basekb.com/gold/>
http://ontology2.com/the-book/o2dbpedia-info.html
http://ontology2.com/book/chapter2/part1/dbpedia-examples.html
RDF: A new Slant
http://ontology2.com/the-book/rdf-a-new-slant.html
<https://www.linkedin.com/grp/home?gid=8267275>
Data Lakes, Data Ponds, and Data Droplets
http://ontology2.com/the-book/data-lakes-ponds-and-droplets.html
Received on Thursday, 15 September 2016 21:57:29 UTC