Abstract image of a woman sitting on books and studying on a laptop

ShEx by Example

Download as PPTX, PDF
Jose Emilio Labra Gayo, profile picture
Jose Emilio Labra Gayo

ShEx is a language for validating RDF data. It allows defining shapes that specify constraints on nodes and triples. ShEx expressions can be used to validate if RDF graphs conform to the defined shapes. The ShEx language is inspired by languages like RelaxNG and provides different serialization formats like ShExC, ShExJ, and ShExR. There are open-source implementations of ShEx validators in languages like JavaScript, Scala, Ruby, Python, and Java. ShEx provides a concise way to define RDF shapes and validate instance data against those shapes.

Software
1 of 58
Downloaded 30 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
ShEx by example RDF Validation tutorial Eric Prud'hommeaux World Wide Web Consortium MIT, Cambridge, MA, USA https://www.w3.org/People/Eric/ Dimitris Kontokostas GeoPhy http://kontokostas.com/ Jose Emilio Labra Gayo WESO Research group University of Oviedo, Spain http://labra.weso.es Iovka Boneva LINKS, INRIA & CNRS University of Lille, France http://www.lifl.fr/~boneva/
More info Chapter 4 of Validating RDF Data book Online HTML version
ShEx ShEx (Shape Expressions Language) High level, concise Language for RDF validation & description Official info: http://shex.io Inspired by RelaxNG, Turtle
ShEx as a language Language based approach ShEx = domain specific language for RDF validation Specification: http://shex.io/shex-semantics/ Primer: http://shex.io/shex-primer Different serializations: ShExC (Compact syntax) JSON-LD (ShExJ) RDF obtained from JSON-LD (ShExR)
Short history of ShEx 2013 - RDF Validation Workshop Conclusions: "SPARQL queries cannot easily be inspected and understood…" Need of a higher level, concise language Agreement on the term "Shape" 2014 First proposal of Shape Expressions (ShEx 1.0) 2014 - Data Shapes Working Group chartered Mutual influence between SHACL & ShEx 2017 - ShEx Community Group - ShEx 2.0
ShEx implementations Javascript: https://github.com/shexSpec/shex.js Scala: http://labra.github.io/shaclex/ Ruby: https://ruby-rdf.github.io/shex/ Python: https://github.com/hsolbrig/PyShEx Java: https://github.com/iovka/shex-java Other prototypes: https://www.w3.org/2001/sw/wiki/ShEx
ShEx Online demos Online Validator https://rawgit.com/shexSpec/shex.js/master/doc/shex-simple.html Based on Javascript implementation RDFShape http://rdfshape.weso.es/ Also has support for SHACL ShEx-Java: http://shexjava.lille.inria.fr/ ShExValidata https://www.w3.org/2015/03/ShExValidata/ Based on ShEx 1.0, 3 deployments for different profiles HCLS, DCat, PHACTS
First example Shapes conforming to <User> must contain one property schema:name with a value of type xsd:string prefix schema: <http://schema.org/> prefix xsd: <http://www.w3.org/2001/XMLSchema#> <User> IRI { schema:name xsd:string ; schema:knows @<User> * } Prefix declarations as in Turtle Note: We will omit prefix declarations and use the aliases from: http://prefix.cc
A node conforms to :User if: - It is an IRI - There is exactly one value of shema:name which is a xsd:string - There are zero or more values of schema:knows whose value conforms to :User RDF Validation using ShEx :alice schema:name "Alice" ; schema:knows :alice . :bob schema:name 234 . :carol schema:name "Carol", "Carole" . :dave foaf:name "Dave" . :emily schema:name "Emily" ; schema:email <mailto:emily@example.org> ; schema:knows :alice, :emily . _:1 schema:name "Unknown" . Try it (RDFShape): https://goo.gl/LVFTRw Try it (ShExDemo): https://goo.gl/wp4SWf Schema Instance      User shapes must contain one property schema:name with a value of type xsd:string :User IRI { schema:name xsd:string ; schema:knows @<User> * } 
ShExC - Compact syntax BNF Grammar: http://shex.io/shex-semantics/#shexc Directly inspired by Turtle (reuses several definitions) Prefix declarations Comments starting by # a keyword for rdf:type Keywords aren't case sensitive (MinInclusive = MININCLUSIVE) Shape Labels can be URIs or BlankNodes
ShEx-Json Json serialization for Shape Expressions and validation results <UserShape> { schema:name xsd:string } ≡ { "type" : "Schema", "@context" : "http://www.w3.org/ns/shex.jsonld", "shapes" :[{"type" : "Shape", "id" : "User", "expression" : { "type" : "TripleConstraint", "predicate" : "http://schema.org/name", "valueExpr" : { "type" : "NodeConstraint", "datatype" : "http://www.w3.org/2001/XMLSchema#string" } } }] }
<UserShape> { schema:name xsd:string } Some definitions Schema = set of Shape Expressions Shape Expression = labeled pattern <label> { ...pattern... } Label Pattern
Focus Node and Neighborhood Focus Node = node that is being validated Neighborhood of a node = set of incoming/outgoing triples :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob foaf:name "Robert" ; schema:worksFor :OurCompany . :carol schema:name "Carol" ; schema:follows :alice . :dave schema:name "Dave" . :OurCompany schema:founder :dave ; schema:employee :alice, :bob . Neighbourhood of :alice = { (:alice, schema:name, "Alice") (:alice, schema:follows, :bob), (:alice, schema:worksFor, :OurCompany), (:carol, schema:follows, :alice), (:OurCompany, schema:employee, :alice) }
Shape maps Shape maps declare which node/shape pairs are selected They declare the queries that ShEx engines solve Example: Does :alice conform to <User> ? :alice@<User> Example: Do all subjects of schema:knows conform to <User> ? {FOCUS schema:knows _ }@<User> 3 types of shape maps: Query shape maps: Input shape maps (can be entiched) Fixed shape maps: Simple pairs of node/shape Result shape maps: Shape maps generated by the validation process
Shape map resolver Converts query shape maps to fixed shape maps {FOCUS schema:worksFor _ }@:User {FOCUS rdf:type schema:Person}@:User, {_ schema:worksFor FOCUS }@:Company ShapeMap Resolver Fixed shape map :alice a :User . :bob schema:worksFor :c1, :c2 . :carol a :User ; schema:worksFor :c1 . RDF Graph Query shape map :alice@:User, :bob@:User, :carol@:User, :c1@:Company, :c2@:Company,
ShEx validator Takes as input a Fixed shape map and creates a result shape map :alice@:User, :bob @:User ShEx Validator Result Shape map :User { schema:name xsd:string ; schema:knows @:User* } ShEx Schema :alice schema:name "Alice"; schema:knows :carol . :bob schema:name "Robert" . :carol schema:name "Carol" . RDF Graph Fixed shape map :alice@:User, :bob@:User, :carol@:User
Validation process :alice@:User, :bob@:User ShEx Validator Result shape map :User { schema:name xsd:string ; schema:knows @:User* } ShEx Schema :alice schema:name "Alice"; schema:knows :carol . :bob schema:name "Robert"; schema:knows :carol . :carol schema:name "Carol" . RDF Graph Fixed map :alice@:User, :bob@:User, :carol@:User Query shape map ShapeMap Resolver {FOCUS schema:knows _ }@:User
Node constraints Constraints over an RDF node :User { schema:name xsd:string ; schema:birthDate xsd:date? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User* } Node constraints Node constraints
Triple constraints Constraints about the incoming/outgoing arcs of a node :User { schema:name xsd:string ; schema:birthDate xsd:date ? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User * } Triple constraints
<User> { schema:name xsd:string } Triple constraints A basic expression consists of a Triple Constraint Triple constraint ≈ predicate + value constraint + cardinality :alice Alice predicate value constraint schema:name cardinality , if omitted {1,1} {1,1}
Shape expressions Labelled rules :User { schema:name xsd:string ; schema:birthDate xsd:date ? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User * } ShapeShape expression label Triple expression
Simple expressions and grouping ; can be used to group components :User { schema:name xsd:string ; foaf:age xsd:integer ; schema:email xsd:string ; } :alice schema:name "Alice"; foaf:age 10 ; schema:email "alice@example.org" . :bob schema:name "Robert Smith" ; foaf:age 45 ; schema:email <mailto:bob@example.org> . :carol schema:name "Carol" ; foaf:age 56, 66 ; schema:email "carol@example.org" .  
Cardinalities Inspired by regular expressions If omitted {1,1} = default cardinality* * 0 or more + 1 or more ? 0 or 1 {m} m repetitions {m,n} Between m and n repetitions {m,} m or more repetitions *Note: In SHACL, cardinality by default = (0,unbounded)
Example with cardinalities :User { schema:name xsd:string ; schema:worksFor IRI ? ; schema:follows IRI * } :Company { schema:founder IRI ?; schema:employee IRI {1,100} } :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob foaf:name "Robert" ; schema:worksFor :OurCompany . :carol schema:name "Carol" ; schema:follows :alice . :dave schema:name "Dave" . :OurCompany schema:founder :dave ; schema:employee :alice, :bob .
Choices - OneOf The operator | represents alternatives (either one or the other) :alice schema:name "Alice Cooper" . :bob schema:givenName "Bob", "Robert" ; schema:lastName "Smith" . :carol schema:name "Carol King" ; schema:givenName "Carol" ; schema:lastName "King" . :emily foaf:name "Emily" . :User { schema:name xsd:string ; | schema:givenName xsd:string + ; schema:lastName xsd:string } Try it (RDFShape): http://goo.gl/R3pjA2 (ShExDemo): https://goo.gl/xLZRLf  
Value expressions Type Example Description Anything . The object can be anything Datatype xsd:string Matches a value of type xsd:string Kind IRI BNode Literal NonLiteral The object must have that kind Value set [:Male :Female ] The value must be an element of a that set Reference @<UserShape> The object must have shape <UserShape> Composed xsd:string OR IRI The Composition of value expressions using OR AND NOT IRI Range foaf:~ Starts with the IRI associated with foaf Any except... - :Checked Any value except :Checked
No constraint A dot (.) matches anything  no constraint on values Try it: http://goo.gl/xBndCT :User { schema:name . ; schema:affiliation . ; schema:email . ; schema:birthDate . } :alice schema:name "Alice"; schema:affiliation [ schema:name "OurCompany" ] ; schema:email <mailto:alice@example.org> ; schema:birthDate "2010-08-23"^^xsd:date .
Datatypes Datatypes are directly declared by their URIs Predefined datatypes from XML Schema: xsd:string xsd:integer xsd:date ... :User { schema:name xsd:string; schema:birthDate xsd:date } :alice schema:name "Alice"; schema:birthDate "2010-08-23"^^xsd:date. :bob schema:name "Robert" ; schema:birthDate "2012-10-23" . :carol schema:name _:unknown ; schema:birthDate 2012 . Try it: http://goo.gl/hqYDqu  
Facets on Datatypes It is possible to qualify the datatype with XML Schema facets See: http://www.w3.org/TR/xmlschema-2/#rf-facets Facet Description MinInclusive, MaxInclusive MinExclusive, MaxExclusive Constraints on numeric values which declare the min/max value allowed (either included or excluded) TotalDigits, FractionDigits Constraints on numeric values which declare the total digits and fraction digits allowed Length, MinLength, MaxLength Constraints on string values which declare the length allowed, or the min/max length allowed Pattern Regular expression pattern
Facets on Datatypes :User { schema:name xsd:string MaxLength 10 ; foaf:age xsd:integer MinInclusive 1 MaxInclusive 99 ; schema:phone xsd:string /d{3}-d{3}-d{3}/ } :alice schema:name "Alice"; foaf:age 10 ; schema:phone "123-456-555" . :bob schema:name "Robert Smith" ; foaf:age 45 ; schema:phone "333-444-555" . :carol schema:name "Carol" ; foaf:age 23 ; schema:phone "+34-123-456-555" . Try it: http://goo.gl/LMwXRi  
Node Kinds Value Description Examples Literal Literal values "Alice" "Spain"@en 23 true IRI IRIs <http://example.org/alice> ex:alice BNode Blank nodes _:1 NonLiteral Blank nodes or IRIs _:1 <http://example.org/alice> ex:alice Define the kind of RDF nodes: Literal, IRI, BNode, ...
Example with node kinds :alice schema:name "Alice" ; schema:follows :bob . :bob schema:name :Robert ; schema:follows :carol . :carol schema:name "Carol" ; schema:follows "Dave" . :User { schema:name Literal ; schema:follows IRI } Try it: http://goo.gl/vouWCU  
Value sets The value must be one of the values of a given set Denoted by [ and ] :Product { schema:color [ "Red" "Green" "Blue" ] ; schema:manufacturer [ :OurCompany :AnotherCompany ] } :x1 schema:color "Red"; schema:manufacturer :OurCompany . :x2 schema:color "Cyan" ; schema:manufacturer :OurCompany . :x3 schema:color "Green" ; schema:manufacturer :Unknown . Try it: http://goo.gl/TgaoJ0  
Single value sets Value sets with a single element A very common pattern Try it: http://goo.gl/W464fn <SpanishProduct> { schema:country [ :Spain ] } <FrenchProduct> { schema:country [ :France ] } <VideoGame> { a [ :VideoGame ] } :product1 schema:country :Spain . :product2 schema:country :France . :product3 a :VideoGame ; schema:country :Spain . Note: ShEx doesn't interact with inference It just checks if there is an rdf:type arc Inference can be done before/after validating ShEx can even be used to test inference systems
Shape references Defines that the value must match another shape References are marked as @ :User { schema:worksFor @:Company ; } :Company { schema:name xsd:string } :alice a :User; schema:worksFor :OurCompany . :bob a :User; schema:worksFor :Another . :OurCompany schema:name "OurCompany" . :Another schema:name 23 . Try it: http://goo.gl/qPh7ry  
Recursion and cyclic references Try it: http://goo.gl/507zss :User { schema:worksFor @:Company ; } :Company { schema:name xsd:string ; schema:employee @:User } :alice a :User; schema:worksFor :OurCompany . :bob a :User; schema:worksFor :Another . :OurCompany schema:name "OurCompany" ; schema:employee :alice . :Another schema:name 23 .   :Company schema:legalName xsd:string schema:worksFor schema:employee :User schema:name xsd:string
Composed Shapes It is possible to use AND , OR and NOT to compose shapes Try it:http://goo.gl/XXlKs4 :User { schema:name xsd:string ; schema:worksFor IRI OR @:Company ?; schema:follows IRI OR BNode * } :Company { schema:founder IRI ?; schema:employee IRI {1,100} } :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob schema:name "Robert" ; schema:worksFor [ schema:Founder "Frank" ; schema:employee :carol ; ] . :carol schema:name "Carol" ; schema:follows [ schema:name "Emily" ; ] . :OurCompany schema:founder :dave ; schema:employee :alice, :bob .
IRI ranges Try it: https://goo.gl/sNQi8n Note: IRI ranges are not yet implemented in RDFShape prefix codes: <http://example.codes/> :User { :status [ codes:~ ] } uri:~ represents the set of all URIs that start with stem uri prefix codes: <http://example.codes/> prefix other: <http://other.codes/> :x1 :status codes:resolved . :x2 :status other:done . :x3 :status <http://example.codes/pending> . 
IRI Range exclusions The operator - excludes IRIs or IRI ranges from an IRI range prefix codes: <http://example.codes/> :User { :status [ codes:~ - codes:deleted ] } :x1 :status codes:resolved . :x2 :status other:done. :x3 :status <http://example.codes/pending> . :x4 :status codes:deleted .   Try it: https://goo.gl/BvtTi2
Exercise Define a Schema for the following domain model :University :Course schema:name xsd:string :hasCourse :universityschema:name xsd:string :Student :hasStudent schema:name xsd:string rdf:type [schema:Person] :hasFriend schema:mbox IRI :Teacher rdf:type [schema:Person] schema:name xsd:string :empoloyee :teaches :isEnroledIn
Nested shapes Syntax simplification to avoid defining two shapes Internally, the inner shape is identified using a blank node Try it (ShExDemo): https://goo.gl/z05kpL Try it (RDFShape): http://goo.gl/aLt4rO :User { schema:name xsd:string ; schema:worksFor { a [ schema:Company ] } } User { schema:name xsd:string ; schema:worksFor _:1 } _:1 a [ schema:Company ] . :alice schema:name "Alice" ; schema:worksFor :OurCompany . :OurCompany a schema:Company . ≡
Implicit AND Shapes can be combined (implicit AND) :User { schema:name xsd:string ; schema:worksFor IRI @:Manager /^http://hr.example/id#[0-9]+/ } :Manager { schema:name xsd:string } :alice schema:name "Alice"; schema:worksFor <http://hr.example/id#9> . <http://hr.example/id> a :Manager .
Labeled constraints $label <constraint> associates a constraint to a label It can later be used as &label :User { $:name ( schema:name . | schema:givenName . ; schema:familyName . ) ; schema:email IRI } :Employee { &:name ; :employeeId . } :Employee { ( schema:name . | schema:givenName . ; schema:familyName .) ; :employeeId . }
Inverse triple constraints ^ reverses the order of the triple constaint Try it (RDFShape): http://goo.gl/CRj7J8 :User { schema:name xsd:string ; schema:woksFor @:Company } :Company { a [schema:Company] ; ^schema:worksFor @:User+ } :alice schema:name "Alice"; schema:worksFor :OurCompany . :bob schema:name "Bob" ; schema:worksFor :OurCompany . :OurCompany a schema:Company . Try it (ShEx demo): https://goo.gl/8omekl
Repeated properties Try it (RDFShape): http://goo.gl/ik4IZc <User> { schema:name xsd:string; schema:parent @<Male>; schema:parent @<Female> } <Male> { schema:gender [schema:Male ] } <Female> { schema:gender [schema:Female] } :alice schema:name "Alice" ; schema:parent :bob, :carol . :bob schema:name "Bob" ; schema:gender schema:Male . :carol schema:name "Carol" ; schema:gender schema:Female .
Allowing other triples Triple constraints limit all triples with a given predicate to match one of the constraints This is called closing a property Example: Try it (RDFShape): http://goo.gl/m4fPzY <Company> { a [ schema:Organization ] ; a [ org:Organization ] } :OurCompany a org:Organization, schema:Organization . :OurUniversity a org:Organization, schema:Organization, schema:CollegeOrUniversity . Sometimes we would like to permit other triples (open the property) 
Allowing other triples EXTRA <listOfProperties> declares that a list of properties can contain extra values Example: Try it (RDFShape): http://goo.gl/m4fPzY <Company> EXTRA a { a [ schema:Organization ] ; a [ org:Organization ] } :OurCompany a org:Organization, schema:Organization . :OurUniversity a org:Organization, schema:Organization, schema:CollegeOrUniversity .
Closed Shapes CLOSED can be used to limit the appearance of any predicate not mentioned in the shape expression :alice schema:name "Alice" ; schema:knows :bob . :bob schema:name "Bob" ; schema:knows :alice . :dave schema:name "Dave" ; schema:knows :emily ; :link2virus <virus> . :emily schema:name "Emily" ; schema:knows :dave . <User> { schema:name IRI; schema:knows @<User>* } <User> CLOSED { schema:name IRI; schema:knows @<User>* } Without closed, all match <User> With closed, only :alice and :bob match <User>Try without closed: http://goo.gl/vJEG5G Try with closed: http://goo.gl/KWDEEs
Node constraints Constraints on the focus node <User> IRI { schema:name xsd:string ; schema:worksFor IRI } :alice schema:name "Alice"; :worksFor :OurCompany . _:1 schema:name "Unknown"; :worksFor :OurCompany . 
Conjunction of Shape Expressions AND can be used to define conjunction on Shape Expressions <User> { schema:name xsd:string ; schema:worksFor IRI } AND { schema:worksFor @<Company> } Conjunctions are the default operator in SHACL
Disjunction of Shape Expressions OR can be used to define disjunction of Shape Expressions :User { schema:name xsd:string } OR { schema:givenName xsd:string ; schema:familyName xsd:string }
Negation NOT s creates a new shape expression from a shape s. Nodes conform to NOT s when they do not conform to s. :NoName Not { schema:name . } :alice schema:givenName "Alice" ; #Passes schema:familyName "Cooper" . :bob schema:name "Robert" . #Fails :carol schema:givenName "Carol" ; #Fails schema:name "Carol" .
IF-THEN pattern Combining OR, NOT and AND it is possible to define IF-THEN… :Product { schema:productID . } AND NOT{ a [ schema:Vehicle ] } OR { schema:vehicleEngine . ; schema:fuelType . }
Cyclic dependencies with negation One problem of combining NOT and recursion is the possibility of declarin ill-defined shapes :Barber { # Violates the negation requirement :shaves @:Person } AND NOT { :shaves @:Barber } :Person { schema:name xsd:string } :albert :shaves :dave . #Passes as a :Barber :bob schema:name "Robert" ; # Passes as a :Person :shaves :bob . # Passes :Barber? :dave schema:name "Dave" . #Passes as a :Person
Restriction on cyclic dependencies and negation Constraint to avoid ill formed data models: Whenever a shape refers to itself either directly or indirectly, the chain of references cannot traverse an occurrence of the negation operation NOT.
Semantic Actions Arbitrary code attached to shapes Can be used to perform operations with side effects Independent of any language/technology Several extension languages: GenX, GenJ (http://shex.io/extensions/) :alice schema:name "Alice" ; schema:birthDate "1980-01-23"^^xsd:date ; schema:deathDate "2013-01-23"^^xsd:date . :bob schema:name "Robert" ; schema:birthDate "2013-08-12"^^xsd:date ; schema:deathDate "1990-01-23"^^xsd:date . <Person> { schema:name xsd:string, schema:birthDate xsd:dateTime %js:{ report = _.o; return true; %}, schema:deathDate xsd:dateTime %js:{ return _[1].triple.o.lex > report.lex; %} %sparql:{ ?s schema:birthDate ?bd . FILTER (?o > ?bd) %} }
Other features Current ShEx version: 2.0 Several features have been postponed for next version UNIQUE Inheritance (a Shape that extends another Shape)
Future work & contributions More info http://shex.io ShEx currently under active development Curent work Improve error messages Language expressivity (combination of different operators) If you are interested, you can help List of issues: https://github.com/shexSpec/shex/issues

More Related Content

PPTX
ShEx vs SHACL
Jose Emilio Labra Gayo
 
PPTX
SHACL by example
Jose Emilio Labra Gayo
 
PPTX
SHACL: Shaping the Big Ball of Data Mud
Richard Cyganiak
 
PDF
Introduction to RDF & SPARQL
Open Data Support
 
PDF
JSON-LD and SHACL for Knowledge Graphs
Franz Inc. - AllegroGraph
 
PDF
An introduction to Semantic Web and Linked Data
Fabien Gandon
 
PDF
SHACL Overview
Irene Polikoff
 
PDF
Sass - Getting Started with Sass!
Eric Sembrat
 
ShEx vs SHACL
Jose Emilio Labra Gayo
 
SHACL by example
Jose Emilio Labra Gayo
 
SHACL: Shaping the Big Ball of Data Mud
Richard Cyganiak
 
Introduction to RDF & SPARQL
Open Data Support
 
JSON-LD and SHACL for Knowledge Graphs
Franz Inc. - AllegroGraph
 
An introduction to Semantic Web and Linked Data
Fabien Gandon
 
SHACL Overview
Irene Polikoff
 
Sass - Getting Started with Sass!
Eric Sembrat
 

What's hot (20)

PPT
Introduction to RDF
Narni Rajesh
 
PPTX
SASS - CSS with Superpower
Kanchha kaji Prajapati
 
PPTX
Html5 tutorial for beginners
Singsys Pte Ltd
 
PPTX
SPARQL introduction and training (130+ slides with exercices)
Thomas Francart
 
PPTX
How Hashmap works internally in java
Ramakrishna Joshi
 
PPTX
RDF data validation 2017 SHACL
Jean-Paul Calbimonte
 
PPTX
Introduction to Linked Data
Juan Sequeda
 
PDF
Spark SQL
Joud Khattab
 
PPT
JDBC Java Database Connectivity
Ranjan Kumar
 
PPT
Php with MYSQL Database
Computer Hardware & Trouble shooting
 
PDF
HTML5: features with examples
Alfredo Torre
 
PDF
Top 50 HTML Interview Questions and Answers | Edureka
Edureka!
 
PPTX
The Semantic Web #9 - Web Ontology Language (OWL)
Myungjin Lee
 
PDF
Import and Export Big Data using R Studio
Rupak Roy
 
PPTX
PROV-O Tutorial. DC-2013 Conference
dgarijo
 
PPTX
RDF validation tutorial
Jose Emilio Labra Gayo
 
PPTX
Working with arrays in php
Kamal Acharya
 
PPT
SPARQL Tutorial
Leigh Dodds
 
PPT
Asynchronous JavaScript & XML (AJAX)
Adnan Sohail
 
PPTX
Data Modeling for NoSQL
Tony Tam
 
Introduction to RDF
Narni Rajesh
 
SASS - CSS with Superpower
Kanchha kaji Prajapati
 
Html5 tutorial for beginners
Singsys Pte Ltd
 
SPARQL introduction and training (130+ slides with exercices)
Thomas Francart
 
How Hashmap works internally in java
Ramakrishna Joshi
 
RDF data validation 2017 SHACL
Jean-Paul Calbimonte
 
Introduction to Linked Data
Juan Sequeda
 
Spark SQL
Joud Khattab
 
JDBC Java Database Connectivity
Ranjan Kumar
 
Php with MYSQL Database
Computer Hardware & Trouble shooting
 
HTML5: features with examples
Alfredo Torre
 
Top 50 HTML Interview Questions and Answers | Edureka
Edureka!
 
The Semantic Web #9 - Web Ontology Language (OWL)
Myungjin Lee
 
Import and Export Big Data using R Studio
Rupak Roy
 
PROV-O Tutorial. DC-2013 Conference
dgarijo
 
RDF validation tutorial
Jose Emilio Labra Gayo
 
Working with arrays in php
Kamal Acharya
 
SPARQL Tutorial
Leigh Dodds
 
Asynchronous JavaScript & XML (AJAX)
Adnan Sohail
 
Data Modeling for NoSQL
Tony Tam
 
Ad

Similar to ShEx by Example (20)

PPTX
Challenges and applications of RDF shapes
Jose Emilio Labra Gayo
 
PDF
Two graph data models : RDF and Property Graphs
andyseaborne
 
PPTX
Part04_SHACL By Example presentation.pptx
vudinhphuong96
 
PPTX
Sparql
Tamrat Amare
 
PDF
Self-Enforcing Access Control for Encrypted RDF
Sabrina Kirrane
 
PDF
Semantic Web(Web 3.0) SPARQL
Daniel D.J. UM
 
PPTX
Introduction to SPARQL
Jose Emilio Labra Gayo
 
PPTX
Introduction to SPARQL
Jose Emilio Labra Gayo
 
PDF
HyperGraphQL
Szymon Klarman
 
PDF
Optimizing SPARQL Queries with SHACL.pdf
Department of Informatics, University of Oslo
 
PPTX
RDF Data Model
Jose Emilio Labra Gayo
 
PDF
2011 4IZ440 Semantic Web – RDF, SPARQL, and software APIs
Josef Petrák
 
PDF
SHACL in Apache jena - ApacheCon2020
andyseaborne
 
PPTX
Semantic web meetup – sparql tutorial
AdonisDamian
 
PDF
Sparql service-description
STIinnsbruck
 
PPTX
SuRf – Tapping Into The Web Of Data
cosbas
 
ODP
Graph Data -- RDF and Property Graphs
andyseaborne
 
PPTX
SHACL Specification Draft
Holger Knublauch
 
PDF
A Hands On Overview Of The Semantic Web
Shamod Lacoul
 
PDF
2016-02 Graphs - PG+RDF
andyseaborne
 
Challenges and applications of RDF shapes
Jose Emilio Labra Gayo
 
Two graph data models : RDF and Property Graphs
andyseaborne
 
Part04_SHACL By Example presentation.pptx
vudinhphuong96
 
Sparql
Tamrat Amare
 
Self-Enforcing Access Control for Encrypted RDF
Sabrina Kirrane
 
Semantic Web(Web 3.0) SPARQL
Daniel D.J. UM
 
Introduction to SPARQL
Jose Emilio Labra Gayo
 
Introduction to SPARQL
Jose Emilio Labra Gayo
 
HyperGraphQL
Szymon Klarman
 
Optimizing SPARQL Queries with SHACL.pdf
Department of Informatics, University of Oslo
 
RDF Data Model
Jose Emilio Labra Gayo
 
2011 4IZ440 Semantic Web – RDF, SPARQL, and software APIs
Josef Petrák
 
SHACL in Apache jena - ApacheCon2020
andyseaborne
 
Semantic web meetup – sparql tutorial
AdonisDamian
 
Sparql service-description
STIinnsbruck
 
SuRf – Tapping Into The Web Of Data
cosbas
 
Graph Data -- RDF and Property Graphs
andyseaborne
 
SHACL Specification Draft
Holger Knublauch
 
A Hands On Overview Of The Semantic Web
Shamod Lacoul
 
2016-02 Graphs - PG+RDF
andyseaborne
 
Ad

More from Jose Emilio Labra Gayo (20)

PPTX
Publicaciones de investigación
Jose Emilio Labra Gayo
 
PPTX
Introducción a la investigación/doctorado
Jose Emilio Labra Gayo
 
PPTX
Legislative data portals and linked data quality
Jose Emilio Labra Gayo
 
PPTX
Validating RDF data: Challenges and perspectives
Jose Emilio Labra Gayo
 
PPTX
Wikidata
Jose Emilio Labra Gayo
 
PPTX
Legislative document content extraction based on Semantic Web technologies
Jose Emilio Labra Gayo
 
PPTX
Introducción a la Web Semántica
Jose Emilio Labra Gayo
 
PPTX
2017 Tendencias en informática
Jose Emilio Labra Gayo
 
PPTX
RDF, linked data and semantic web
Jose Emilio Labra Gayo
 
PPTX
19 javascript servidor
Jose Emilio Labra Gayo
 
PPTX
Como publicar datos: hacia los datos abiertos enlazados
Jose Emilio Labra Gayo
 
PPTX
16 Alternativas XML
Jose Emilio Labra Gayo
 
PPTX
XSLT
Jose Emilio Labra Gayo
 
PPTX
XPath
Jose Emilio Labra Gayo
 
PPTX
Arquitectura de la Web y Computación en el Servidor
Jose Emilio Labra Gayo
 
PPTX
RDF Validation Future work and applications
Jose Emilio Labra Gayo
 
PPTX
RDF data model
Jose Emilio Labra Gayo
 
PPTX
Máster en Ingeniería Web
Jose Emilio Labra Gayo
 
PPTX
2016 temuco tecnologias_websemantica
Jose Emilio Labra Gayo
 
PPTX
2015 bogota datos_enlazados
Jose Emilio Labra Gayo
 
Publicaciones de investigación
Jose Emilio Labra Gayo
 
Introducción a la investigación/doctorado
Jose Emilio Labra Gayo
 
Legislative data portals and linked data quality
Jose Emilio Labra Gayo
 
Validating RDF data: Challenges and perspectives
Jose Emilio Labra Gayo
 
Wikidata
Jose Emilio Labra Gayo
 
Legislative document content extraction based on Semantic Web technologies
Jose Emilio Labra Gayo
 
Introducción a la Web Semántica
Jose Emilio Labra Gayo
 
2017 Tendencias en informática
Jose Emilio Labra Gayo
 
RDF, linked data and semantic web
Jose Emilio Labra Gayo
 
19 javascript servidor
Jose Emilio Labra Gayo
 
Como publicar datos: hacia los datos abiertos enlazados
Jose Emilio Labra Gayo
 
16 Alternativas XML
Jose Emilio Labra Gayo
 
XSLT
Jose Emilio Labra Gayo
 
XPath
Jose Emilio Labra Gayo
 
Arquitectura de la Web y Computación en el Servidor
Jose Emilio Labra Gayo
 
RDF Validation Future work and applications
Jose Emilio Labra Gayo
 
RDF data model
Jose Emilio Labra Gayo
 
Máster en Ingeniería Web
Jose Emilio Labra Gayo
 
2016 temuco tecnologias_websemantica
Jose Emilio Labra Gayo
 
2015 bogota datos_enlazados
Jose Emilio Labra Gayo
 

Recently uploaded (20)

PDF
MiniTool Power Data Recovery 12.6 Crack + Portable (Latest Version 2025)
imang66g
 
PDF
Sun and Bloombase Spitfire StoreSafe End-to-end Storage Security Solution
Bloombase
 
PDF
Guide to Food Delivery App Development.pdf
Lilac infotech
 
PDF
Microsoft Office 365 Crack Download Free
wasibhadar
 
DOCX
Modern SharePoint Intranet Templates That Boost Employee Engagement in 2025.docx
Sharepoint Designs
 
PPTX
Presentation by Samna Perveen And Subhan Afzal.pptx
AbdullahShahbaz13
 
PPTX
HackYourBrain__UtrechtJUG__11092025.pptx
SimonedeGijt
 
PPTX
ROI Analysis for Newspaper Industry with Odoo ERP
SatishKumar2651
 
PPTX
DevOpsDays Halifax 2025 - Building 10x Organizations Using Modern Productivit...
Justin Reock
 
PDF
Website Design & Development_ Professional Web Design Services.pdf
narayanaduggempudi88
 
PPTX
hospital managemt ,san.dckldnklcdnkdnkdnjadnjdjn
khushisoniwer2
 
PPTX
R-Studio Crack Free Download 2025 Latest
elifk7615
 
PDF
CCleaner 6.39.11548 Crack 2025 License Key
viktamscs
 
PPTX
Python is a high-level, interpreted programming language
kesavansa2002
 
PDF
Multiverse AI Review 2025: Access All TOP AI Model-Versions!
Moshiur Rahman Jisan
 
PDF
SOFTWARE ENGINEERING Software Engineering (3rd Edition) by K.K. Aggarwal & Yo...
yaderyeka
 
PPTX
4Seller: The All-in-One Multi-Channel E-Commerce Management Platform for Glob...
4Seller Multi-channel Ecommerce Tool
 
PDF
AI-Powered Fuzz Testing: The Future of QA
Shubham Joshi
 
PDF
novaPDF Pro 11.9.482 Crack + License Key [Latest 2025]
viktamscs
 
PPTX
Full-Stack Developer Courses That Actually Land You Jobs
Ask the C Expert
 
MiniTool Power Data Recovery 12.6 Crack + Portable (Latest Version 2025)
imang66g
 
Sun and Bloombase Spitfire StoreSafe End-to-end Storage Security Solution
Bloombase
 
Guide to Food Delivery App Development.pdf
Lilac infotech
 
Microsoft Office 365 Crack Download Free
wasibhadar
 
Modern SharePoint Intranet Templates That Boost Employee Engagement in 2025.docx
Sharepoint Designs
 
Presentation by Samna Perveen And Subhan Afzal.pptx
AbdullahShahbaz13
 
HackYourBrain__UtrechtJUG__11092025.pptx
SimonedeGijt
 
ROI Analysis for Newspaper Industry with Odoo ERP
SatishKumar2651
 
DevOpsDays Halifax 2025 - Building 10x Organizations Using Modern Productivit...
Justin Reock
 
Website Design & Development_ Professional Web Design Services.pdf
narayanaduggempudi88
 
hospital managemt ,san.dckldnklcdnkdnkdnjadnjdjn
khushisoniwer2
 
R-Studio Crack Free Download 2025 Latest
elifk7615
 
CCleaner 6.39.11548 Crack 2025 License Key
viktamscs
 
Python is a high-level, interpreted programming language
kesavansa2002
 
Multiverse AI Review 2025: Access All TOP AI Model-Versions!
Moshiur Rahman Jisan
 
SOFTWARE ENGINEERING Software Engineering (3rd Edition) by K.K. Aggarwal & Yo...
yaderyeka
 
4Seller: The All-in-One Multi-Channel E-Commerce Management Platform for Glob...
4Seller Multi-channel Ecommerce Tool
 
AI-Powered Fuzz Testing: The Future of QA
Shubham Joshi
 
novaPDF Pro 11.9.482 Crack + License Key [Latest 2025]
viktamscs
 
Full-Stack Developer Courses That Actually Land You Jobs
Ask the C Expert
 

ShEx by Example

  • 1. ShEx by example RDF Validation tutorial Eric Prud'hommeaux World Wide Web Consortium MIT, Cambridge, MA, USA https://www.w3.org/People/Eric/ Dimitris Kontokostas GeoPhy http://kontokostas.com/ Jose Emilio Labra Gayo WESO Research group University of Oviedo, Spain http://labra.weso.es Iovka Boneva LINKS, INRIA & CNRS University of Lille, France http://www.lifl.fr/~boneva/
  • 2. More info Chapter 4 of Validating RDF Data book Online HTML version
  • 3. ShEx ShEx (Shape Expressions Language) High level, concise Language for RDF validation & description Official info: http://shex.io Inspired by RelaxNG, Turtle
  • 4. ShEx as a language Language based approach ShEx = domain specific language for RDF validation Specification: http://shex.io/shex-semantics/ Primer: http://shex.io/shex-primer Different serializations: ShExC (Compact syntax) JSON-LD (ShExJ) RDF obtained from JSON-LD (ShExR)
  • 5. Short history of ShEx 2013 - RDF Validation Workshop Conclusions: "SPARQL queries cannot easily be inspected and understood…" Need of a higher level, concise language Agreement on the term "Shape" 2014 First proposal of Shape Expressions (ShEx 1.0) 2014 - Data Shapes Working Group chartered Mutual influence between SHACL & ShEx 2017 - ShEx Community Group - ShEx 2.0
  • 6. ShEx implementations Javascript: https://github.com/shexSpec/shex.js Scala: http://labra.github.io/shaclex/ Ruby: https://ruby-rdf.github.io/shex/ Python: https://github.com/hsolbrig/PyShEx Java: https://github.com/iovka/shex-java Other prototypes: https://www.w3.org/2001/sw/wiki/ShEx
  • 7. ShEx Online demos Online Validator https://rawgit.com/shexSpec/shex.js/master/doc/shex-simple.html Based on Javascript implementation RDFShape http://rdfshape.weso.es/ Also has support for SHACL ShEx-Java: http://shexjava.lille.inria.fr/ ShExValidata https://www.w3.org/2015/03/ShExValidata/ Based on ShEx 1.0, 3 deployments for different profiles HCLS, DCat, PHACTS
  • 8. First example Shapes conforming to <User> must contain one property schema:name with a value of type xsd:string prefix schema: <http://schema.org/> prefix xsd: <http://www.w3.org/2001/XMLSchema#> <User> IRI { schema:name xsd:string ; schema:knows @<User> * } Prefix declarations as in Turtle Note: We will omit prefix declarations and use the aliases from: http://prefix.cc
  • 9. A node conforms to :User if: - It is an IRI - There is exactly one value of shema:name which is a xsd:string - There are zero or more values of schema:knows whose value conforms to :User RDF Validation using ShEx :alice schema:name "Alice" ; schema:knows :alice . :bob schema:name 234 . :carol schema:name "Carol", "Carole" . :dave foaf:name "Dave" . :emily schema:name "Emily" ; schema:email <mailto:[email protected]> ; schema:knows :alice, :emily . _:1 schema:name "Unknown" . Try it (RDFShape): https://goo.gl/LVFTRw Try it (ShExDemo): https://goo.gl/wp4SWf Schema Instance      User shapes must contain one property schema:name with a value of type xsd:string :User IRI { schema:name xsd:string ; schema:knows @<User> * } 
  • 10. ShExC - Compact syntax BNF Grammar: http://shex.io/shex-semantics/#shexc Directly inspired by Turtle (reuses several definitions) Prefix declarations Comments starting by # a keyword for rdf:type Keywords aren't case sensitive (MinInclusive = MININCLUSIVE) Shape Labels can be URIs or BlankNodes
  • 11. ShEx-Json Json serialization for Shape Expressions and validation results <UserShape> { schema:name xsd:string } ≡ { "type" : "Schema", "@context" : "http://www.w3.org/ns/shex.jsonld", "shapes" :[{"type" : "Shape", "id" : "User", "expression" : { "type" : "TripleConstraint", "predicate" : "http://schema.org/name", "valueExpr" : { "type" : "NodeConstraint", "datatype" : "http://www.w3.org/2001/XMLSchema#string" } } }] }
  • 12. <UserShape> { schema:name xsd:string } Some definitions Schema = set of Shape Expressions Shape Expression = labeled pattern <label> { ...pattern... } Label Pattern
  • 13. Focus Node and Neighborhood Focus Node = node that is being validated Neighborhood of a node = set of incoming/outgoing triples :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob foaf:name "Robert" ; schema:worksFor :OurCompany . :carol schema:name "Carol" ; schema:follows :alice . :dave schema:name "Dave" . :OurCompany schema:founder :dave ; schema:employee :alice, :bob . Neighbourhood of :alice = { (:alice, schema:name, "Alice") (:alice, schema:follows, :bob), (:alice, schema:worksFor, :OurCompany), (:carol, schema:follows, :alice), (:OurCompany, schema:employee, :alice) }
  • 14. Shape maps Shape maps declare which node/shape pairs are selected They declare the queries that ShEx engines solve Example: Does :alice conform to <User> ? :alice@<User> Example: Do all subjects of schema:knows conform to <User> ? {FOCUS schema:knows _ }@<User> 3 types of shape maps: Query shape maps: Input shape maps (can be entiched) Fixed shape maps: Simple pairs of node/shape Result shape maps: Shape maps generated by the validation process
  • 15. Shape map resolver Converts query shape maps to fixed shape maps {FOCUS schema:worksFor _ }@:User {FOCUS rdf:type schema:Person}@:User, {_ schema:worksFor FOCUS }@:Company ShapeMap Resolver Fixed shape map :alice a :User . :bob schema:worksFor :c1, :c2 . :carol a :User ; schema:worksFor :c1 . RDF Graph Query shape map :alice@:User, :bob@:User, :carol@:User, :c1@:Company, :c2@:Company,
  • 16. ShEx validator Takes as input a Fixed shape map and creates a result shape map :alice@:User, :bob @:User ShEx Validator Result Shape map :User { schema:name xsd:string ; schema:knows @:User* } ShEx Schema :alice schema:name "Alice"; schema:knows :carol . :bob schema:name "Robert" . :carol schema:name "Carol" . RDF Graph Fixed shape map :alice@:User, :bob@:User, :carol@:User
  • 17. Validation process :alice@:User, :bob@:User ShEx Validator Result shape map :User { schema:name xsd:string ; schema:knows @:User* } ShEx Schema :alice schema:name "Alice"; schema:knows :carol . :bob schema:name "Robert"; schema:knows :carol . :carol schema:name "Carol" . RDF Graph Fixed map :alice@:User, :bob@:User, :carol@:User Query shape map ShapeMap Resolver {FOCUS schema:knows _ }@:User
  • 18. Node constraints Constraints over an RDF node :User { schema:name xsd:string ; schema:birthDate xsd:date? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User* } Node constraints Node constraints
  • 19. Triple constraints Constraints about the incoming/outgoing arcs of a node :User { schema:name xsd:string ; schema:birthDate xsd:date ? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User * } Triple constraints
  • 20. <User> { schema:name xsd:string } Triple constraints A basic expression consists of a Triple Constraint Triple constraint ≈ predicate + value constraint + cardinality :alice Alice predicate value constraint schema:name cardinality , if omitted {1,1} {1,1}
  • 21. Shape expressions Labelled rules :User { schema:name xsd:string ; schema:birthDate xsd:date ? ; schema:gender [schema:Male schema:Female] OR xsd:string; schema:knows IRI @:User * } ShapeShape expression label Triple expression
  • 22. Simple expressions and grouping ; can be used to group components :User { schema:name xsd:string ; foaf:age xsd:integer ; schema:email xsd:string ; } :alice schema:name "Alice"; foaf:age 10 ; schema:email "[email protected]" . :bob schema:name "Robert Smith" ; foaf:age 45 ; schema:email <mailto:[email protected]> . :carol schema:name "Carol" ; foaf:age 56, 66 ; schema:email "[email protected]" .  
  • 23. Cardinalities Inspired by regular expressions If omitted {1,1} = default cardinality* * 0 or more + 1 or more ? 0 or 1 {m} m repetitions {m,n} Between m and n repetitions {m,} m or more repetitions *Note: In SHACL, cardinality by default = (0,unbounded)
  • 24. Example with cardinalities :User { schema:name xsd:string ; schema:worksFor IRI ? ; schema:follows IRI * } :Company { schema:founder IRI ?; schema:employee IRI {1,100} } :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob foaf:name "Robert" ; schema:worksFor :OurCompany . :carol schema:name "Carol" ; schema:follows :alice . :dave schema:name "Dave" . :OurCompany schema:founder :dave ; schema:employee :alice, :bob .
  • 25. Choices - OneOf The operator | represents alternatives (either one or the other) :alice schema:name "Alice Cooper" . :bob schema:givenName "Bob", "Robert" ; schema:lastName "Smith" . :carol schema:name "Carol King" ; schema:givenName "Carol" ; schema:lastName "King" . :emily foaf:name "Emily" . :User { schema:name xsd:string ; | schema:givenName xsd:string + ; schema:lastName xsd:string } Try it (RDFShape): http://goo.gl/R3pjA2 (ShExDemo): https://goo.gl/xLZRLf  
  • 26. Value expressions Type Example Description Anything . The object can be anything Datatype xsd:string Matches a value of type xsd:string Kind IRI BNode Literal NonLiteral The object must have that kind Value set [:Male :Female ] The value must be an element of a that set Reference @<UserShape> The object must have shape <UserShape> Composed xsd:string OR IRI The Composition of value expressions using OR AND NOT IRI Range foaf:~ Starts with the IRI associated with foaf Any except... - :Checked Any value except :Checked
  • 27. No constraint A dot (.) matches anything  no constraint on values Try it: http://goo.gl/xBndCT :User { schema:name . ; schema:affiliation . ; schema:email . ; schema:birthDate . } :alice schema:name "Alice"; schema:affiliation [ schema:name "OurCompany" ] ; schema:email <mailto:[email protected]> ; schema:birthDate "2010-08-23"^^xsd:date .
  • 28. Datatypes Datatypes are directly declared by their URIs Predefined datatypes from XML Schema: xsd:string xsd:integer xsd:date ... :User { schema:name xsd:string; schema:birthDate xsd:date } :alice schema:name "Alice"; schema:birthDate "2010-08-23"^^xsd:date. :bob schema:name "Robert" ; schema:birthDate "2012-10-23" . :carol schema:name _:unknown ; schema:birthDate 2012 . Try it: http://goo.gl/hqYDqu  
  • 29. Facets on Datatypes It is possible to qualify the datatype with XML Schema facets See: http://www.w3.org/TR/xmlschema-2/#rf-facets Facet Description MinInclusive, MaxInclusive MinExclusive, MaxExclusive Constraints on numeric values which declare the min/max value allowed (either included or excluded) TotalDigits, FractionDigits Constraints on numeric values which declare the total digits and fraction digits allowed Length, MinLength, MaxLength Constraints on string values which declare the length allowed, or the min/max length allowed Pattern Regular expression pattern
  • 30. Facets on Datatypes :User { schema:name xsd:string MaxLength 10 ; foaf:age xsd:integer MinInclusive 1 MaxInclusive 99 ; schema:phone xsd:string /d{3}-d{3}-d{3}/ } :alice schema:name "Alice"; foaf:age 10 ; schema:phone "123-456-555" . :bob schema:name "Robert Smith" ; foaf:age 45 ; schema:phone "333-444-555" . :carol schema:name "Carol" ; foaf:age 23 ; schema:phone "+34-123-456-555" . Try it: http://goo.gl/LMwXRi  
  • 31. Node Kinds Value Description Examples Literal Literal values "Alice" "Spain"@en 23 true IRI IRIs <http://example.org/alice> ex:alice BNode Blank nodes _:1 NonLiteral Blank nodes or IRIs _:1 <http://example.org/alice> ex:alice Define the kind of RDF nodes: Literal, IRI, BNode, ...
  • 32. Example with node kinds :alice schema:name "Alice" ; schema:follows :bob . :bob schema:name :Robert ; schema:follows :carol . :carol schema:name "Carol" ; schema:follows "Dave" . :User { schema:name Literal ; schema:follows IRI } Try it: http://goo.gl/vouWCU  
  • 33. Value sets The value must be one of the values of a given set Denoted by [ and ] :Product { schema:color [ "Red" "Green" "Blue" ] ; schema:manufacturer [ :OurCompany :AnotherCompany ] } :x1 schema:color "Red"; schema:manufacturer :OurCompany . :x2 schema:color "Cyan" ; schema:manufacturer :OurCompany . :x3 schema:color "Green" ; schema:manufacturer :Unknown . Try it: http://goo.gl/TgaoJ0  
  • 34. Single value sets Value sets with a single element A very common pattern Try it: http://goo.gl/W464fn <SpanishProduct> { schema:country [ :Spain ] } <FrenchProduct> { schema:country [ :France ] } <VideoGame> { a [ :VideoGame ] } :product1 schema:country :Spain . :product2 schema:country :France . :product3 a :VideoGame ; schema:country :Spain . Note: ShEx doesn't interact with inference It just checks if there is an rdf:type arc Inference can be done before/after validating ShEx can even be used to test inference systems
  • 35. Shape references Defines that the value must match another shape References are marked as @ :User { schema:worksFor @:Company ; } :Company { schema:name xsd:string } :alice a :User; schema:worksFor :OurCompany . :bob a :User; schema:worksFor :Another . :OurCompany schema:name "OurCompany" . :Another schema:name 23 . Try it: http://goo.gl/qPh7ry  
  • 36. Recursion and cyclic references Try it: http://goo.gl/507zss :User { schema:worksFor @:Company ; } :Company { schema:name xsd:string ; schema:employee @:User } :alice a :User; schema:worksFor :OurCompany . :bob a :User; schema:worksFor :Another . :OurCompany schema:name "OurCompany" ; schema:employee :alice . :Another schema:name 23 .   :Company schema:legalName xsd:string schema:worksFor schema:employee :User schema:name xsd:string
  • 37. Composed Shapes It is possible to use AND , OR and NOT to compose shapes Try it:http://goo.gl/XXlKs4 :User { schema:name xsd:string ; schema:worksFor IRI OR @:Company ?; schema:follows IRI OR BNode * } :Company { schema:founder IRI ?; schema:employee IRI {1,100} } :alice schema:name "Alice"; schema:follows :bob; schema:worksFor :OurCompany . :bob schema:name "Robert" ; schema:worksFor [ schema:Founder "Frank" ; schema:employee :carol ; ] . :carol schema:name "Carol" ; schema:follows [ schema:name "Emily" ; ] . :OurCompany schema:founder :dave ; schema:employee :alice, :bob .
  • 38. IRI ranges Try it: https://goo.gl/sNQi8n Note: IRI ranges are not yet implemented in RDFShape prefix codes: <http://example.codes/> :User { :status [ codes:~ ] } uri:~ represents the set of all URIs that start with stem uri prefix codes: <http://example.codes/> prefix other: <http://other.codes/> :x1 :status codes:resolved . :x2 :status other:done . :x3 :status <http://example.codes/pending> . 
  • 39. IRI Range exclusions The operator - excludes IRIs or IRI ranges from an IRI range prefix codes: <http://example.codes/> :User { :status [ codes:~ - codes:deleted ] } :x1 :status codes:resolved . :x2 :status other:done. :x3 :status <http://example.codes/pending> . :x4 :status codes:deleted .   Try it: https://goo.gl/BvtTi2
  • 40. Exercise Define a Schema for the following domain model :University :Course schema:name xsd:string :hasCourse :universityschema:name xsd:string :Student :hasStudent schema:name xsd:string rdf:type [schema:Person] :hasFriend schema:mbox IRI :Teacher rdf:type [schema:Person] schema:name xsd:string :empoloyee :teaches :isEnroledIn
  • 41. Nested shapes Syntax simplification to avoid defining two shapes Internally, the inner shape is identified using a blank node Try it (ShExDemo): https://goo.gl/z05kpL Try it (RDFShape): http://goo.gl/aLt4rO :User { schema:name xsd:string ; schema:worksFor { a [ schema:Company ] } } User { schema:name xsd:string ; schema:worksFor _:1 } _:1 a [ schema:Company ] . :alice schema:name "Alice" ; schema:worksFor :OurCompany . :OurCompany a schema:Company . ≡
  • 42. Implicit AND Shapes can be combined (implicit AND) :User { schema:name xsd:string ; schema:worksFor IRI @:Manager /^http://hr.example/id#[0-9]+/ } :Manager { schema:name xsd:string } :alice schema:name "Alice"; schema:worksFor <http://hr.example/id#9> . <http://hr.example/id> a :Manager .
  • 43. Labeled constraints $label <constraint> associates a constraint to a label It can later be used as &label :User { $:name ( schema:name . | schema:givenName . ; schema:familyName . ) ; schema:email IRI } :Employee { &:name ; :employeeId . } :Employee { ( schema:name . | schema:givenName . ; schema:familyName .) ; :employeeId . }
  • 44. Inverse triple constraints ^ reverses the order of the triple constaint Try it (RDFShape): http://goo.gl/CRj7J8 :User { schema:name xsd:string ; schema:woksFor @:Company } :Company { a [schema:Company] ; ^schema:worksFor @:User+ } :alice schema:name "Alice"; schema:worksFor :OurCompany . :bob schema:name "Bob" ; schema:worksFor :OurCompany . :OurCompany a schema:Company . Try it (ShEx demo): https://goo.gl/8omekl
  • 45. Repeated properties Try it (RDFShape): http://goo.gl/ik4IZc <User> { schema:name xsd:string; schema:parent @<Male>; schema:parent @<Female> } <Male> { schema:gender [schema:Male ] } <Female> { schema:gender [schema:Female] } :alice schema:name "Alice" ; schema:parent :bob, :carol . :bob schema:name "Bob" ; schema:gender schema:Male . :carol schema:name "Carol" ; schema:gender schema:Female .
  • 46. Allowing other triples Triple constraints limit all triples with a given predicate to match one of the constraints This is called closing a property Example: Try it (RDFShape): http://goo.gl/m4fPzY <Company> { a [ schema:Organization ] ; a [ org:Organization ] } :OurCompany a org:Organization, schema:Organization . :OurUniversity a org:Organization, schema:Organization, schema:CollegeOrUniversity . Sometimes we would like to permit other triples (open the property) 
  • 47. Allowing other triples EXTRA <listOfProperties> declares that a list of properties can contain extra values Example: Try it (RDFShape): http://goo.gl/m4fPzY <Company> EXTRA a { a [ schema:Organization ] ; a [ org:Organization ] } :OurCompany a org:Organization, schema:Organization . :OurUniversity a org:Organization, schema:Organization, schema:CollegeOrUniversity .
  • 48. Closed Shapes CLOSED can be used to limit the appearance of any predicate not mentioned in the shape expression :alice schema:name "Alice" ; schema:knows :bob . :bob schema:name "Bob" ; schema:knows :alice . :dave schema:name "Dave" ; schema:knows :emily ; :link2virus <virus> . :emily schema:name "Emily" ; schema:knows :dave . <User> { schema:name IRI; schema:knows @<User>* } <User> CLOSED { schema:name IRI; schema:knows @<User>* } Without closed, all match <User> With closed, only :alice and :bob match <User>Try without closed: http://goo.gl/vJEG5G Try with closed: http://goo.gl/KWDEEs
  • 49. Node constraints Constraints on the focus node <User> IRI { schema:name xsd:string ; schema:worksFor IRI } :alice schema:name "Alice"; :worksFor :OurCompany . _:1 schema:name "Unknown"; :worksFor :OurCompany . 
  • 50. Conjunction of Shape Expressions AND can be used to define conjunction on Shape Expressions <User> { schema:name xsd:string ; schema:worksFor IRI } AND { schema:worksFor @<Company> } Conjunctions are the default operator in SHACL
  • 51. Disjunction of Shape Expressions OR can be used to define disjunction of Shape Expressions :User { schema:name xsd:string } OR { schema:givenName xsd:string ; schema:familyName xsd:string }
  • 52. Negation NOT s creates a new shape expression from a shape s. Nodes conform to NOT s when they do not conform to s. :NoName Not { schema:name . } :alice schema:givenName "Alice" ; #Passes schema:familyName "Cooper" . :bob schema:name "Robert" . #Fails :carol schema:givenName "Carol" ; #Fails schema:name "Carol" .
  • 53. IF-THEN pattern Combining OR, NOT and AND it is possible to define IF-THEN… :Product { schema:productID . } AND NOT{ a [ schema:Vehicle ] } OR { schema:vehicleEngine . ; schema:fuelType . }
  • 54. Cyclic dependencies with negation One problem of combining NOT and recursion is the possibility of declarin ill-defined shapes :Barber { # Violates the negation requirement :shaves @:Person } AND NOT { :shaves @:Barber } :Person { schema:name xsd:string } :albert :shaves :dave . #Passes as a :Barber :bob schema:name "Robert" ; # Passes as a :Person :shaves :bob . # Passes :Barber? :dave schema:name "Dave" . #Passes as a :Person
  • 55. Restriction on cyclic dependencies and negation Constraint to avoid ill formed data models: Whenever a shape refers to itself either directly or indirectly, the chain of references cannot traverse an occurrence of the negation operation NOT.
  • 56. Semantic Actions Arbitrary code attached to shapes Can be used to perform operations with side effects Independent of any language/technology Several extension languages: GenX, GenJ (http://shex.io/extensions/) :alice schema:name "Alice" ; schema:birthDate "1980-01-23"^^xsd:date ; schema:deathDate "2013-01-23"^^xsd:date . :bob schema:name "Robert" ; schema:birthDate "2013-08-12"^^xsd:date ; schema:deathDate "1990-01-23"^^xsd:date . <Person> { schema:name xsd:string, schema:birthDate xsd:dateTime %js:{ report = _.o; return true; %}, schema:deathDate xsd:dateTime %js:{ return _[1].triple.o.lex > report.lex; %} %sparql:{ ?s schema:birthDate ?bd . FILTER (?o > ?bd) %} }
  • 57. Other features Current ShEx version: 2.0 Several features have been postponed for next version UNIQUE Inheritance (a Shape that extends another Shape)
  • 58. Future work & contributions More info http://shex.io ShEx currently under active development Curent work Improve error messages Language expressivity (combination of different operators) If you are interested, you can help List of issues: https://github.com/shexSpec/shex/issues