W3C home > Mailing lists > Public > public-dwbp-wg@w3.org > June 2015

Re: DQV Comments

From: Steven Adler <adler1@us.ibm.com>
Date: Mon, 22 Jun 2015 10:15:07 -0400
To: Antoine Isaac <aisaac@few.vu.nl>
Cc: "public-dwbp-wg@w3.org" <public-dwbp-wg@w3.org>
Message-ID: <OF19C40607.BE10ACD8-ON85257E6C.004E00A6-85257E6C.004E49F7@us.ibm.com>

Hi Antoine,

I think we could look at constructing an architecture for DQ that focuses
on corroboration and validation, in which all sources of Data on the Web
should at least be doubted without x number of corroboration sources, some
lineage validation, and some data decay formula.  The architecture could
focus on the technical characteristics of linked data corroboration and
lineage validation and we could insert methods for using the architecture
into the BP document.

Happy to discuss on the next DQV call.  When is it?


Best Regards,

Steve

Motto: "Do First, Think, Do it Again"


|------------>
| From:      |
|------------>
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
  |Antoine Isaac <aisaac@few.vu.nl>                                                                                                                  |
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| To:        |
|------------>
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
  |"public-dwbp-wg@w3.org" <public-dwbp-wg@w3.org>                                                                                                   |
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| Date:      |
|------------>
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
  |06/19/2015 08:12 AM                                                                                                                               |
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| Subject:   |
|------------>
  >--------------------------------------------------------------------------------------------------------------------------------------------------|
  |Re: DQV Comments                                                                                                                                  |
  >--------------------------------------------------------------------------------------------------------------------------------------------------|





Hi Steve,

You're reading it fully right.

The first answer is that we need to have a very general framework, so that
everyone can create data that represent their own metrics or subjective
assessments, which they think should be done. It is very difficult to
anticipate the diversity of needs, and we don't want to create a
straitjacket that would prevent too many people from extending our DQV in
the way they need it.

The second answer is that such an abstract framework is not very
satisfactory for us editors, too. This is why we've created a section on
example usage [1], if just to give ideas to readers on how to use the
generic framework. This is still work in progress, as you can see.

The problem is that we don't have much input from the DWBP use cases and
best practices. They too mention quality in a very abstract way, as we've
found in our analysis [2,3]. I've repeatedly asked for more input (e.g.
during the last F2F), but it seems really not easy for the group to do it.

So if we want to add stuff now, we have to look outside the current UCs and
BPs, as I think our investigations on completeness has showed [4].
In fact we have some leads. For example, a colleague from VU, Davide
Ceolin, works on expressing ISO quality criteria for datasets as RDF.
But doing more requires time, which the editors alone don't have. Actually
for the last F2F we had even started to create a questionnaire [5] but none
of us could push it further.

And in any case, it will not provide a mandate for including properties and
classes for specialized metrics or subjective assessments (annotations) in
DQV itself, if this is what you're after.
Fitting specialized classes and properties as part of the standard is
possible only if we find evidence of general need for them, preferably
based on the material the group has gathered.

But of course if you have ideas (and it seems you have some) to extend the
current material we must start with, it's more than welcome!

Kind regards,

Antoine

[1] http://w3c.github.io/dwbp/vocab-dqg.html#examples
[2] https://www.w3.org/2013/dwbp/wiki/Quality_Aspects_In_Use_Cases
[3] https://www.w3.org/2013/dwbp/wiki/Requirements_From_FPWD_BP
[4] https://www.w3.org/2013/dwbp/track/actions/153
[5] https://www.w3.org/2013/dwbp/wiki/QualityQuestionnaire

On 6/15/15 8:24 PM, Steven Adler wrote:
> Just reading through the DQV and apologize if my comments are uninformed.
>From my experience with Data Quality, one can make objective observations
about Data Quality based on the age of the data, in which one assigns
various decay factors and calculates age(decay factor), it's completeness
in which a percentage can be applied.  One can also apply subjective
assessments by comparing one data set to other sources.  One can even
assert that data without comparative sources can't be trusted - no unbribed
journalist would ever publics a story without corroborated sources...
>
> But when I read the DQV I don't really get these points and the whole
thing feels very abstract.  Am I reading it wrong?
>
>
> Best Regards,
>
> Steve
>
> Motto: "Do First, Think, Do it Again"
>
> Inactive hide details for Laufer ---06/11/2015 09:26:29 PM---Hi Antoine,
Ok. I think is good to have a self-contained document.Laufer ---06/11/2015
09:26:29 PM---Hi Antoine, Ok. I think is good to have a self-contained
document.
>
>
>
>
>
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------!

 ---
>
>
>
> Hi Antoine,
>
> Ok. I think is good to have a self-contained document.
>
> Best,
> Laufer
>
> Em quinta-feira, 11 de junho de 2015, Antoine Isaac <_aisaac@few.vu.nl_ <
mailto:aisaac@few.vu.nl>> escreveu:
>
>     Hi Laufer,
>
>     Thanks for the comment!
>
>     We've just followed existing practice in DCAT. Ie. DCAT re-uses the
skos:Concept class, and still "re-defines" it in the DCAT reference doc
[1].
>     I guess other 'vocabulary documentation schools' would not reproduce
the external info. But I do like the idea of having a self-contained
document, at least as long as the effort is not huge.
>
>     And in the case of DQV and DAQ there's another point: as pointed
explicitly (as an ISSUE) in the DQV draft, we may end up have to re-declare
the DAQ constructs as DQV (or even DCAT) ones, later. In that case it will
have been a smart move to have the doc self-contained, earlier than later.
>
>     Kind regards,
>
>     Antoine
>
>     [1] _http://www.w3.org/TR/vocab-dcat/#class-concept_
>
>     On 6/11/15 8:01 PM, Laufer wrote:
>         Hi, Antoine, Christophe, Riccardo,
>
>         First of all, thank your for your efforts in DQV.
>
>         I have a question about the DQV Data model  (Fig.1):
>
>         Considering that dqv:QualityMeasure is a subclass of
daq:Observation, and that
>         the relations beetwen daq:Observation, qb:Observation, daqMetric,
daq:Dimension, daq:Category are defined in
_http://purl.org/eis/vocab/daq#_,
>         it is necessary to have qb:Observation, daqMetric, daq:Dimension,
daq:Category explicitly defined in DQV Data Model?
>
>         Thank you.
>
>         Best Regards,
>         Laufer
>
>         --
>         .  .  .  .. .  .
>         .        .   . ..
>         .     ..       .
>
>
>
> --
> .  .  .  .. .  .
> .        .   . ..
> .     ..       .
>







graycol.gif
(image/gif attachment: graycol.gif)

ecblank.gif
(image/gif attachment: ecblank.gif)

Received on Monday, 22 June 2015 14:20:20 UTC

This archive was generated by hypermail 2.3.1 : Monday, 22 June 2015 14:20:21 UTC