Re: proposed set of SHACL tests

Here is my initial analysis of the test results.  (Look for "***".)

Hi!

I ran your tests using Holger's SHACL Validator [1] (which might not be fully
up to date with latest WG resolutions) and those are the results (6 Failures):

*** I don't think that any of tests involve recent changes to SHACL.


1/ *** The shape scope here is pp:Person, but there are no instances of
pp:Person in the data graph, so no validation should have been done.

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/nothingInScope,
but found: 7 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#message> "Required minimum value count 1 but
found 0"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/pet> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> []  ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractMinCountPropertyConstraint>
] .

2/ ***This is my mistake.  I didn't set up the abbreviated literals correctly.

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/implicitTyping,
but found: 30 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> <http://data.example.com/mikey> ;
  <http://www.w3.org/ns/shacl#message> "Values must have datatype
xsd:double"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> "4.0E0" ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/p5> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> _:b0 ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractDatatypePropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> <http://data.example.com/mikey>
] .

[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> <http://data.example.com/mikey> ;
  <http://www.w3.org/ns/shacl#message> "Values must have datatype
xsd:integer"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> "4" ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/age> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> _:b0 ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractDatatypePropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> <http://data.example.com/mikey>
] .

[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> <http://data.example.com/mikey> ;
  <http://www.w3.org/ns/shacl#message> "Values must have datatype
xsd:decimal"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> "4.0" ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/income> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> _:b0 ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractDatatypePropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> <http://data.example.com/mikey>
] .

3/ *** This may have come from not finding the data file, unless you fixed
that already.
   **** If you did, then it is again strange as there are no SHACL instances
of the scope class in the data graph so no validation should have been done.

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/subclassSubproperty,
but found: 7 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#message> "Required minimum value count 1 but
found 0"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/pet> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> []  ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractMinCountPropertyConstraint>
] .

4/ *** ex:mikey is not a SHACL instance of the shape's scope, so it should not
be triggering validation.

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/domain, but
found: 10 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> <http://data.example.com/mikey> ;
  <http://www.w3.org/ns/shacl#message> "Values must be instances of
pp:Pet"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> []  ;
  <http://www.w3.org/ns/shacl#predicate>
<http://peoplepetsontology.example.com/pet> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> []  ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractClassPropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> <http://data.example.com/mikey>
] .

5/ *** These are signalling a SHACL syntax error.
   *** All four of rdfsReasoning[1-4] are probably  failing this way but the
test harness does not distinguish between syntax errors and validation errors.
   *** I think that there should not have been a syntax error even though I
had the wrong type, as this typing has been optional for quite some time.

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/rdfsReasoning1,
but found: 10 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> _:b0 ;
  <http://www.w3.org/ns/shacl#message> "Values must be instances of
sh:PropertyConstraint"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> []  ;
  <http://www.w3.org/ns/shacl#predicate> <http://www.w3.org/ns/shacl#property> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> <http://www.w3.org/ns/shacl#Shape> ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractClassPropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> _:b0
] .

java.lang.AssertionError: Expected no validation results for
file:///C:/workspace/shacl/target/test-classes/features/core/rdfsReasoning2,
but found: 10 triples:
@base          <http://example.org/random> .
[ a       <http://www.w3.org/ns/shacl#ValidationResult> ;
  <http://www.w3.org/ns/shacl#focusNode> _:b0 ;
  <http://www.w3.org/ns/shacl#message> "Values must be instances of
sh:PropertyConstraint"^^<http://www.w3.org/2001/XMLSchema#string> ;
  <http://www.w3.org/ns/shacl#object> []  ;
  <http://www.w3.org/ns/shacl#predicate> <http://www.w3.org/ns/shacl#property> ;
  <http://www.w3.org/ns/shacl#severity> <http://www.w3.org/ns/shacl#Violation> ;
  <http://www.w3.org/ns/shacl#sourceConstraint> []  ;
  <http://www.w3.org/ns/shacl#sourceShape> <http://www.w3.org/ns/shacl#Shape> ;
  <http://www.w3.org/ns/shacl#sourceTemplate>
<http://www.w3.org/ns/shacl#AbstractClassPropertyConstraint> ;
  <http://www.w3.org/ns/shacl#subject> _:b0
] .
-----------------------------------------------------

Received on Friday, 8 January 2016 17:19:40 UTC