Lecture 12, 13– Predicate Calculus
and Knowledge Representation
Logic and inferencing
Vision NLP
Expert
Systems
Planning
Robotics
•
Search
•
Reasoning
•
Learning
•
Knowledge
Obtaining implication of given facts and rules -- Hallmark of
intelligence
Inferencing through
−
Deduction (General to specific)
−
Induction (Specific to General)
−
Abduction (Conclusion to hypothesis in absence of any other evidence
to contrary)
Deduction
Given: All men are mortal (rule)
Shakespeare is a man (fact)
To prove: Shakespeare is mortal (inference)
Induction
Given: Shakespeare is mortal
Newton is mortal (Observation)
Dijkstra is mortal
To prove: All men are mortal (Generalization)
If there is rain, then there will be no picnic
Fact1: There was rain
Conclude: There was no picnic
Deduction
Fact2: There was no picnic
Conclude: There was no rain (?)
Induction and abduction are fallible forms of reasoning. Their conclusions are
susceptible to retraction
Two systems of logic
1) Propositional calculus
2) Predicate calculus
Propositions
−
Stand for facts/assertions
−
Declarative statements
−
As opposed to interrogative statements (questions) or imperative
statements (request, order)
Operators
=> and ¬ form a minimal set (can express other operations)
- Prove it.
Tautologies are formulae whose truth value is always T, whatever the
assignment is
)((~),),(),( ⇒∨∧ NIMPLICATIONOTORAND
Model
In propositional calculus any formula with n propositions has 2n
models
(assignments)
- Tautologies evaluate to T in all models.
Examples:
1)
2)
-
e Morgan with AND
PP ¬∨
)()( QPQP ¬∨¬⇔∧¬
Semantic Tree/Tableau method of proving tautology
Start with the negation of the formula
α-formula
β-formula
α-formula
p
q
¬q¬ p
- α - formula
- β - formula
)]()([ QPQP ¬∨¬⇒∧¬¬
)( QP ∧¬
)( QP ¬∨¬¬
- α - formula
Example 2:
B C B CContradictions in all paths
X
α-formula
¬A ¬C
¬A
¬B ¬A ¬B
A
B∨C
A
B∨C A
B∨C
A
B∨C
(α - formulae)
(β - formulae)
(α - formula)
)]()()([ CABACBA ∧∨∧⇒∨∧¬
)( CBA ∨∧
))()(( CABA ∧∨∧¬
)( BA ∧¬
))( CA ∧¬
Exercise:
Prove the backward implication in the previous
example
Inferencing in PC
Resolution Forward
chaining
Backward
chaining
Knowledge
Declarative Procedural
• Declarative knowledge deals with factoid questions
(what is the capital of India? Who won the
Wimbledon in 2005? Etc.)
• Procedural knowledge deals with “How”
• Procedural knowledge can be embedded in
declarative knowledge
Example: Employee knowledge base
Employee record
Emp id : 1124
Age : 27
Salary : 10L / annum
Tax : Procedure to calculate tax from basic salary,
Loans, medical factors, and # of children
Text Knowledge
Representation
A Semantic Graph
in: modifier
a: indefinite
the: definite
student
past tense
agent
bought
object
time
computer
new
June
modifier
The student bought a new computer in June.
UNL representation
Ram is reading the newspaper
Representation of Knowledge
UNL: a United Nations project
 Started in 1996
 10 year program
 15 research groups across continents
 First goal: generators
 Next goal: analysers (needs solving various
ambiguity problems)
 Current active language groups
 UNL_French (GETA-CLIPS, IMAG)
 UNL_Hindi (IIT Bombay with additional work on
UNL_English)
 UNL_Italian (Univ. of Pisa)
 UNL_Portugese (Univ of Sao Paolo, Brazil)
 UNL_Russian (Institute of Linguistics, Moscow)
 UNL_Spanish (UPM, Madrid)
Dave, Parikh and Bhattacharyya, Journal of Machine Translation, 2002
Knowledge Representation
Ram
read
newspaper
agt obj
UNL Graph - relations
Knowledge Representation
Ram(iof>person)
read(icl>interpret)
newspaper(icl>print_media)
UNL Graph - UWs
agt
obj
Knowledge Representation
Ram(iof>person)
read(icl>interpret)
newspaper(icl>print_media)
@entry
@present
@progress
@def
Ram is reading the newspaper
UNL graph - attributes
agt
obj
The boy who works here went to school
plt
agt
@ entry @ past
school(icl>institution)
go(icl>move)
boy(icl>person
)
work(icl>do
)
here
@ entry
agt
plc
:01
Another Example
Predicate Calculus
Predicate Calculus: well known
examples
 Man is mortal : rule
∀x[man(x) → mortal(x)]
 shakespeare is a man
man(shakespeare)
 To infer shakespeare is mortal
mortal(shakespeare)
Forward Chaining/ Inferencing
 man(x) → mortal(x)
 Dropping the quantifier, implicitly Universal
quantification assumed
 man(shakespeare)
 Goal mortal(shakespeare)
 Found in one step
 x = shakespeare, unification
Backward Chaining/
Inferencing
 man(x) → mortal(x)
 Goal mortal(shakespeare)
 x = shakespeare
 Travel back over and hit the fact asserted
 man(shakespeare)
Resolution - Refutation
 man(x) → mortal(x)
 Convert to clausal form
 ~man(shakespeare) mortal(x)
 Clauses in the knowledge base
 ~man(shakespeare) mortal(x)
 man(shakespeare)
 mortal(shakespeare)
∨
∨
Resolution – Refutation contd
 Negate the goal
 ~man(shakespeare)
 Get a pair of resolvents
)(~ eshakespearmortal )()(~ eshakespearmortaleshakespearman ∨
)(~ eshakespearman )(~ eshakespearman
Resolution Tree
1Re solvent 2Re solvent
soluteRe
Search in resolution
 Heuristics for Resolution Search
 Goal Supported Strategy

Always start with the negated goal
 Set of support strategy

Always one of the resolvents is the most recently
produced resolute
Inferencing in Predicate Calculus
 Forward chaining
 Given P, , to infer Q
 P, match L.H.S of
 Assert Q from R.H.S
 Backward chaining
 Q, Match R.H.S of
 assert P
 Check if P exists
 Resolution – Refutation
 Negate goal
 Convert all pieces of knowledge into clausal form (disjunction of
literals)
 See if contradiction indicated by null clause can be derived
QP →
QP →
1. P
2. converted to
3.
Draw the resolution tree (actually an inverted
tree). Every node is a clausal form and
branches are intermediate inference steps.
QP → QP ∨~
Q~
Q~
QP ∨~
P~ P
Terminology
 Pair of clauses being resolved is called the
Resolvents. The resulting clause is called
the Resolute.
 Choosing the correct pair of resolvents is a
matter of search.
Predicate Calculus
 Introduction through an example (Zohar Manna,
1974):
 Problem: A, B and C belong to the Himalayan
club. Every member in the club is either a
mountain climber or a skier or both. A likes
whatever B dislikes and dislikes whatever B likes.
A likes rain and snow. No mountain climber likes
rain. Every skier likes snow. Is there a member
who is a mountain climber and not a skier?
 Given knowledge has:
 Facts
 Rules
Predicate Calculus: Example
contd.
 Let mc denote mountain climber and sk denotes skier.
Knowledge representation in the given problem is as follows:
1. member(A)
2. member(B)
3. member(C)
4. ∀x[member(x) → (mc(x) ∨ sk(x))]
5. ∀x[mc(x) → ~like(x,rain)]
6. ∀x[sk(x) → like(x, snow)]
7. ∀x[like(B, x) → ~like(A, x)]
8. ∀x[~like(B, x) → like(A, x)]
9. like(A, rain)
10. like(A, snow)
11. Question: ∃x[member(x) ∧ mc(x) ∧ ~sk(x)]
 We have to infer the 11th
expression from the given 10.
 Done through Resolution Refutation.
Club example: Inferencing
1. member(A)
2. member(B)
3. member(C)
4.
– Can be written as
–
5.
–
6.
–
7.
–
))]()(()([ xskxmcxmemberx ∨→∀
))]()(()([ xskxmcxmember ∨→
)()()(~ xskxmcxmember ∨∨
)],()([ snowxlkxskx →∀
),()(~ snowxlkxsk ∨
)],(~)([ rainxlkxmcx →∀
),(~)(~ rainxlkxmc ∨
)],(~),([ xBlkxAlikex →∀
),(~),(~ xBlkxAlike ∨
8.
–
9.
10.
11.
– Negate–
)],(),([~ xBlkxAlkx →∀
),(),( xBlkxAlk ∨
),( rainAlk
),( snowAlk
)](~)()([ xskxmcxmemberx ∧∧∃
)]()(~)([~ xskxmcxmemberx ∨∨∀
 Now standardize the variables apart which
results in the following
1. member(A)
2. member(B)
3. member(C)
4.
5.
6.
7.
8.
9.
10.
11.
)()()(~ 111 xskxmcxmember ∨∨
),()(~ 22 snowxlkxsk ∨
),(~)(~ 33 rainxlkxmc ∨
),(~),(~ 44 xBlkxAlike ∨
),(),( 55 xBlkxAlk ∨
),( rainAlk
),( snowAlk
)]()(~)([~ 666 xskxmcxmemberx ∨∨∀
),(~),(~ 44 xBlkxAlike ∨ ),( snowAlk
),(~ snowBlk ),()(~ 22 snowxlkxsk ∨
)()()(~ 111 xskxmcxmember ∨∨)(~ Bsk
)()(~ BmcBmember ∨ )(Bmember
)(Bmc)]()(~)([~ 666 xskxmcxmemberx ∨∨∀
)()(~ BskBmember ∨ )(~ Bsk
)(~ Bmember )(Bmember
7
10
12 5
13 4
14 2
11
15
16 13
17 2
Assignment
 Prove the inferencing in the Himalayan club
example with different starting points,
producing different resolution trees.
 Think of a Prolog implementation of the
problem
 Prolog Reference (Prolog by Chockshin &
Melish)
Problem-2
From predicate calculus
A “department” environment
1. Dr. X is the HoD of CSE
2. Y and Z work in CSE
3. Dr. P is the HoD of ME
4. Q and R work in ME
5. Y is married to Q
6. By Institute policy staffs of the same
department cannot marry
7. All married staff of CSE are insured by LIC
8. HoD is the boss of all staff in the
department
Diagrammatic representation
Dr. X
Y
Z
Dr. P
Q R
married
CSE ME
Questions on “department”
 Who works in CSE?
 Is there a married person in ME?
 Is there somebody insured by LIC?
Problem-3
(Zohar Manna, Mathematical Theory of
Computation, 1974)
From Propositional Calculus
Tourist in a country of truth-
sayers and liers
 Facts and Rules: In a certain country, people
either always speak the truth or always
lie. A tourist T comes to a junction in the
country and finds an inhabitant S of the
country standing there. One of the roads at
the junction leads to the capital of the country
and the other does not. S can be asked only
yes/no questions.
 Question: What single yes/no question can T
ask of S, so that the direction of the capital is
revealed?
Diagrammatic representation
S (either always says the truth
Or always lies)
T (tourist)
Capital
Deciding the Propositions: a very difficult
step- needs human intelligence
 P: Left road leads to capital
 Q: S always speaks the truth
Meta Question: What question
should the tourist ask
 The form of the question
 Very difficult: needs human intelligence
 The tourist should ask
 Is R true?
 The answer is “yes” if and only if the
left road leads to the capital
 The structure of R to be found as a
function of P and Q
A more mechanical part: use
of truth table
P Q S’s
Answer
R
T T Yes T
T F Yes F
F T No F
F F No T
Get form of R: quite
mechanical
 From the truth table
 R is of the form (P x-nor Q) or (P ≡
Q)
Get R in
English/Hindi/Hebrew…
 Natural Language Generation: non-trivial
 The question the tourist will ask is
 Is it true that the left road leads to the
capital if and only if you speak the truth?
 Exercise: A more well known form of this
question asked by the tourist uses the X-OR
operator instead of the X-Nor. What changes
do you have to incorporate to the solution, to
get that answer?
Problem-4
From Propositional Calculus
Another tourist example: this time in a
restaurant setting in a different country
(Manna, 1974)
 Facts: A tourist is in a restaurant in a country when
the waiter tells him:
 “do you see the three men in the table yonder? One of them
is X who always speaks the truth, another is Y who always
lies and the third is Z who sometimes speaks the truth and
sometimes lies, i.e., answers yes/no randomly without
regard to the question.
 Question: Can you (the tourist) ask three yes/no
questions to these men, always indicating who should
answer the question, and determine who of them is
X, who y and who Z?
Solution: Most of the steps are
doable by humans only
 Number the persons: 1, 2, 3
 1 can be X/Y/Z
 2 can be X/Y/Z
 3 can be X/Y/Z
 Let the first question be to 1
 One of 2 and 3 has to be NOT Z.
 Critical step in the solution: only
humans can do?
Now cast the problem in the
same setting as the tourist and
the capital example
 Solving by analogy
 Use of previously solved problems
 Hallmark of intelligence
Analogy with the tourist and
the capital problem
 Find the direction to the capital
  Find Z; who amongst 1, 2 and 3 is Z?
 Ask a single yes/no question to S (the person
standing at the junction)
  Ask a single yes/no question to 1
 Answer forced to reveal the direction of the
capital
  Answer forced to reveal who from 1,2,3 is Z
Question to 1
 Ask “Is R true” and the answer is yes if
and only if 2 is not Z
 Propositions
 P: 2 is not Z
 Q: 1 always speaks the truth, i.e., 1 is X
Use of truth table as before
P Q 1’s
Answer
R
T T Yes T
T F Yes F
F T No F
F F No T
Question to 1: the first
question
 Is it true that 2 is not Z if and
only if you are X?
Analysis of 1’s answer
 Ans= yes
 Case 1: 1 is X/Y (always speaks the truth
or always lies)

2 is indeed not Z (we can trust 1’s answer)
 Case 2: 1 is Z

2 is indeed not Z (we cannot trust 1’s answer;
but that does not affect us)
Analysis of 1’s answer (contd)
 Ans= no
 Case 1: 1 is X/Y (always speaks the truth
or always lies)

2 is Z; hence 3 is not Z
 Case 2: 1 is Z

3 is not Z
Note carefully: how cleverly Z is identified.
Can a machine do it?
Next steps: ask the 2nd
question to determine X/Y
 Once “Not Z” is identified- say 2, ask
him a tautology
 Is P≡P

If yes, 2 is X

If no, 2 is Y
Ask the 3rd
Question
 Ask 2 “is 1 Z”
 If 2 is X
 Ans=yes, 1 is Z
 Ans=no, 1 is Y
 If 2 is Y (always lies)
 Ans=yes, 1 is X
 Ans=no, 1 is Z
 3 is the remaining person
What do these examples
show?
 Logic systematizes the reasoning process
 Helps identify what is
mechanical/routine/automatable
 Brings to light the steps that only human
intelligence can perform
 These are especially of foundational and structural
nature (e.g., deciding what propositions to
start with)
 Algorithmizing reasoning is not trivial

More Related Content

PPTX
Context free grammar
PPTX
Frames
PPTX
Knowledge representation In Artificial Intelligence
PPTX
Recognition-of-tokens
PDF
Dempster Shafer Theory AI CSE 8th Sem
PPTX
oops concept in java | object oriented programming in java
PDF
Bayesian Networks - A Brief Introduction
PPTX
Propositional logic
Context free grammar
Frames
Knowledge representation In Artificial Intelligence
Recognition-of-tokens
Dempster Shafer Theory AI CSE 8th Sem
oops concept in java | object oriented programming in java
Bayesian Networks - A Brief Introduction
Propositional logic

What's hot (20)

PPTX
8 queens problem using back tracking
PPT
Predicate Logic
PDF
Symbol table in compiler Design
PDF
I. AO* SEARCH ALGORITHM
PPTX
First order logic
PPTX
Interface specification
PPTX
Concept learning
PPTX
LISP: Introduction to lisp
PDF
P, NP, NP-Complete, and NP-Hard
PPTX
2. forward chaining and backward chaining
PPTX
Ambiguous & Unambiguous Grammar
PDF
Token, Pattern and Lexeme
PPTX
knowledge representation in artificial intelligence
PPT
Syntax and semantics of propositional logic
PPT
Computational Learning Theory
PPTX
Huffman Coding Algorithm Presentation
PPTX
Structured Knowledge Representation
PPT
2.3 bayesian classification
PPTX
Rule based system
8 queens problem using back tracking
Predicate Logic
Symbol table in compiler Design
I. AO* SEARCH ALGORITHM
First order logic
Interface specification
Concept learning
LISP: Introduction to lisp
P, NP, NP-Complete, and NP-Hard
2. forward chaining and backward chaining
Ambiguous & Unambiguous Grammar
Token, Pattern and Lexeme
knowledge representation in artificial intelligence
Syntax and semantics of propositional logic
Computational Learning Theory
Huffman Coding Algorithm Presentation
Structured Knowledge Representation
2.3 bayesian classification
Rule based system
Ad

Viewers also liked (20)

PDF
03 - Predicate logic
PDF
15 predicate
PPTX
Knowledge representation and Predicate logic
DOCX
ALI IRTAZA
PPT
Relational calculas
PPTX
Nested quantifiers
PPTX
Nested quantifiers
PPT
PPTX
Lecture 12 Heuristic Searches
PDF
17 1 knowledge-based system
PPT
Artificial Intelligence
PPT
Propositional logic
PDF
Lecture 2 predicates quantifiers and rules of inference
PPT
First order logic
PPTX
Propositional logic & inference
PPTX
Propositional logic
PPTX
Unit 6 - Predicates, Referring Expressions, and Universe of Discourse
PPTX
Unit 4 - Referring Expressions
PPT
Relational algebra in dbms
PPT
Presentation on dbms(relational calculus)
03 - Predicate logic
15 predicate
Knowledge representation and Predicate logic
ALI IRTAZA
Relational calculas
Nested quantifiers
Nested quantifiers
Lecture 12 Heuristic Searches
17 1 knowledge-based system
Artificial Intelligence
Propositional logic
Lecture 2 predicates quantifiers and rules of inference
First order logic
Propositional logic & inference
Propositional logic
Unit 6 - Predicates, Referring Expressions, and Universe of Discourse
Unit 4 - Referring Expressions
Relational algebra in dbms
Presentation on dbms(relational calculus)
Ad

Similar to Predicate calculus (20)

PPT
L03 ai - knowledge representation using logic
DOC
artficial intelligence
PDF
GDSC SSN - solution Challenge : Fundamentals of Decision Making
PDF
Knowledge Representation, Prepositional Logic, Representation and Mapping
PPT
cs344-lect15-robotic-knowledge-inferencing-prolog-11feb08.ppt
PDF
Worksheet
PPTX
Natural language processing: word senses and relations
PDF
Classification and pattern recognition.pdf
PDF
Chapter 01 - p2.pdf
PPT
lect14-semantics.ppt
PDF
STAT-WEEK-1-2.pdfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
PDF
Dedalo, looking for Cluster Explanations in a labyrinth of Linked Data
PPTX
AI3391 Artificial Intelligence Session 26 First order logic.pptx
PPTX
02 RULES OF INFERENCES.pptx
PPT
IDCB-IntroductionIDCB-IntroductionIDCB-IntroductionIDCB-IntroductionIDCB-Intr...
PPT
aiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiai
PPT
Predicate logic_2(Artificial Intelligence)
PDF
10 logic+programming+with+prolog
PPTX
Knowledge Representation, Inference and Reasoning
DOC
Chapter-6-Random Variables & Probability distributions-3.doc
L03 ai - knowledge representation using logic
artficial intelligence
GDSC SSN - solution Challenge : Fundamentals of Decision Making
Knowledge Representation, Prepositional Logic, Representation and Mapping
cs344-lect15-robotic-knowledge-inferencing-prolog-11feb08.ppt
Worksheet
Natural language processing: word senses and relations
Classification and pattern recognition.pdf
Chapter 01 - p2.pdf
lect14-semantics.ppt
STAT-WEEK-1-2.pdfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
Dedalo, looking for Cluster Explanations in a labyrinth of Linked Data
AI3391 Artificial Intelligence Session 26 First order logic.pptx
02 RULES OF INFERENCES.pptx
IDCB-IntroductionIDCB-IntroductionIDCB-IntroductionIDCB-IntroductionIDCB-Intr...
aiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiaiai
Predicate logic_2(Artificial Intelligence)
10 logic+programming+with+prolog
Knowledge Representation, Inference and Reasoning
Chapter-6-Random Variables & Probability distributions-3.doc

More from Rajendran (20)

PPT
Element distinctness lower bounds
PPT
Scheduling with Startup and Holding Costs
PPT
Divide and conquer surfing lower bounds
PPT
Red black tree
PPT
Hash table
PPT
Medians and order statistics
PPT
Proof master theorem
PPT
Recursion tree method
PPT
Recurrence theorem
PPT
Master method
PPT
Master method theorem
PPT
Hash tables
PPT
Lower bound
PPT
Master method theorem
PPT
Greedy algorithms
PPT
Longest common subsequences in Algorithm Analysis
PPT
Dynamic programming in Algorithm Analysis
PPT
Average case Analysis of Quicksort
PPT
Np completeness
PPT
computer languages
Element distinctness lower bounds
Scheduling with Startup and Holding Costs
Divide and conquer surfing lower bounds
Red black tree
Hash table
Medians and order statistics
Proof master theorem
Recursion tree method
Recurrence theorem
Master method
Master method theorem
Hash tables
Lower bound
Master method theorem
Greedy algorithms
Longest common subsequences in Algorithm Analysis
Dynamic programming in Algorithm Analysis
Average case Analysis of Quicksort
Np completeness
computer languages

Recently uploaded (20)

PDF
Journal of Dental Science - UDMY (2022).pdf
PPTX
Computer Architecture Input Output Memory.pptx
PDF
Race Reva University – Shaping Future Leaders in Artificial Intelligence
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
Climate Change and Its Global Impact.pptx
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
Empowerment Technology for Senior High School Guide
PDF
HVAC Specification 2024 according to central public works department
PPTX
Education and Perspectives of Education.pptx
PDF
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
PDF
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 1).pdf
PPTX
Module on health assessment of CHN. pptx
PDF
Complications of Minimal Access-Surgery.pdf
PDF
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
PPTX
What’s under the hood: Parsing standardized learning content for AI
PDF
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
Journal of Dental Science - UDMY (2022).pdf
Computer Architecture Input Output Memory.pptx
Race Reva University – Shaping Future Leaders in Artificial Intelligence
Share_Module_2_Power_conflict_and_negotiation.pptx
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
A powerpoint presentation on the Revised K-10 Science Shaping Paper
AI-driven educational solutions for real-life interventions in the Philippine...
Climate Change and Its Global Impact.pptx
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Empowerment Technology for Senior High School Guide
HVAC Specification 2024 according to central public works department
Education and Perspectives of Education.pptx
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 1).pdf
Module on health assessment of CHN. pptx
Complications of Minimal Access-Surgery.pdf
LIFE & LIVING TRILOGY - PART - (2) THE PURPOSE OF LIFE.pdf
What’s under the hood: Parsing standardized learning content for AI
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
FORM 1 BIOLOGY MIND MAPS and their schemes

Predicate calculus

  • 1. Lecture 12, 13– Predicate Calculus and Knowledge Representation
  • 2. Logic and inferencing Vision NLP Expert Systems Planning Robotics • Search • Reasoning • Learning • Knowledge Obtaining implication of given facts and rules -- Hallmark of intelligence
  • 3. Inferencing through − Deduction (General to specific) − Induction (Specific to General) − Abduction (Conclusion to hypothesis in absence of any other evidence to contrary) Deduction Given: All men are mortal (rule) Shakespeare is a man (fact) To prove: Shakespeare is mortal (inference) Induction Given: Shakespeare is mortal Newton is mortal (Observation) Dijkstra is mortal To prove: All men are mortal (Generalization)
  • 4. If there is rain, then there will be no picnic Fact1: There was rain Conclude: There was no picnic Deduction Fact2: There was no picnic Conclude: There was no rain (?) Induction and abduction are fallible forms of reasoning. Their conclusions are susceptible to retraction Two systems of logic 1) Propositional calculus 2) Predicate calculus
  • 5. Propositions − Stand for facts/assertions − Declarative statements − As opposed to interrogative statements (questions) or imperative statements (request, order) Operators => and ¬ form a minimal set (can express other operations) - Prove it. Tautologies are formulae whose truth value is always T, whatever the assignment is )((~),),(),( ⇒∨∧ NIMPLICATIONOTORAND
  • 6. Model In propositional calculus any formula with n propositions has 2n models (assignments) - Tautologies evaluate to T in all models. Examples: 1) 2) - e Morgan with AND PP ¬∨ )()( QPQP ¬∨¬⇔∧¬
  • 7. Semantic Tree/Tableau method of proving tautology Start with the negation of the formula α-formula β-formula α-formula p q ¬q¬ p - α - formula - β - formula )]()([ QPQP ¬∨¬⇒∧¬¬ )( QP ∧¬ )( QP ¬∨¬¬ - α - formula
  • 8. Example 2: B C B CContradictions in all paths X α-formula ¬A ¬C ¬A ¬B ¬A ¬B A B∨C A B∨C A B∨C A B∨C (α - formulae) (β - formulae) (α - formula) )]()()([ CABACBA ∧∨∧⇒∨∧¬ )( CBA ∨∧ ))()(( CABA ∧∨∧¬ )( BA ∧¬ ))( CA ∧¬
  • 9. Exercise: Prove the backward implication in the previous example
  • 10. Inferencing in PC Resolution Forward chaining Backward chaining
  • 11. Knowledge Declarative Procedural • Declarative knowledge deals with factoid questions (what is the capital of India? Who won the Wimbledon in 2005? Etc.) • Procedural knowledge deals with “How” • Procedural knowledge can be embedded in declarative knowledge
  • 12. Example: Employee knowledge base Employee record Emp id : 1124 Age : 27 Salary : 10L / annum Tax : Procedure to calculate tax from basic salary, Loans, medical factors, and # of children
  • 14. A Semantic Graph in: modifier a: indefinite the: definite student past tense agent bought object time computer new June modifier The student bought a new computer in June.
  • 15. UNL representation Ram is reading the newspaper Representation of Knowledge
  • 16. UNL: a United Nations project  Started in 1996  10 year program  15 research groups across continents  First goal: generators  Next goal: analysers (needs solving various ambiguity problems)  Current active language groups  UNL_French (GETA-CLIPS, IMAG)  UNL_Hindi (IIT Bombay with additional work on UNL_English)  UNL_Italian (Univ. of Pisa)  UNL_Portugese (Univ of Sao Paolo, Brazil)  UNL_Russian (Institute of Linguistics, Moscow)  UNL_Spanish (UPM, Madrid) Dave, Parikh and Bhattacharyya, Journal of Machine Translation, 2002
  • 20. The boy who works here went to school plt agt @ entry @ past school(icl>institution) go(icl>move) boy(icl>person ) work(icl>do ) here @ entry agt plc :01 Another Example
  • 22. Predicate Calculus: well known examples  Man is mortal : rule ∀x[man(x) → mortal(x)]  shakespeare is a man man(shakespeare)  To infer shakespeare is mortal mortal(shakespeare)
  • 23. Forward Chaining/ Inferencing  man(x) → mortal(x)  Dropping the quantifier, implicitly Universal quantification assumed  man(shakespeare)  Goal mortal(shakespeare)  Found in one step  x = shakespeare, unification
  • 24. Backward Chaining/ Inferencing  man(x) → mortal(x)  Goal mortal(shakespeare)  x = shakespeare  Travel back over and hit the fact asserted  man(shakespeare)
  • 25. Resolution - Refutation  man(x) → mortal(x)  Convert to clausal form  ~man(shakespeare) mortal(x)  Clauses in the knowledge base  ~man(shakespeare) mortal(x)  man(shakespeare)  mortal(shakespeare) ∨ ∨
  • 26. Resolution – Refutation contd  Negate the goal  ~man(shakespeare)  Get a pair of resolvents )(~ eshakespearmortal )()(~ eshakespearmortaleshakespearman ∨ )(~ eshakespearman )(~ eshakespearman
  • 27. Resolution Tree 1Re solvent 2Re solvent soluteRe
  • 28. Search in resolution  Heuristics for Resolution Search  Goal Supported Strategy  Always start with the negated goal  Set of support strategy  Always one of the resolvents is the most recently produced resolute
  • 29. Inferencing in Predicate Calculus  Forward chaining  Given P, , to infer Q  P, match L.H.S of  Assert Q from R.H.S  Backward chaining  Q, Match R.H.S of  assert P  Check if P exists  Resolution – Refutation  Negate goal  Convert all pieces of knowledge into clausal form (disjunction of literals)  See if contradiction indicated by null clause can be derived QP → QP →
  • 30. 1. P 2. converted to 3. Draw the resolution tree (actually an inverted tree). Every node is a clausal form and branches are intermediate inference steps. QP → QP ∨~ Q~ Q~ QP ∨~ P~ P
  • 31. Terminology  Pair of clauses being resolved is called the Resolvents. The resulting clause is called the Resolute.  Choosing the correct pair of resolvents is a matter of search.
  • 32. Predicate Calculus  Introduction through an example (Zohar Manna, 1974):  Problem: A, B and C belong to the Himalayan club. Every member in the club is either a mountain climber or a skier or both. A likes whatever B dislikes and dislikes whatever B likes. A likes rain and snow. No mountain climber likes rain. Every skier likes snow. Is there a member who is a mountain climber and not a skier?  Given knowledge has:  Facts  Rules
  • 33. Predicate Calculus: Example contd.  Let mc denote mountain climber and sk denotes skier. Knowledge representation in the given problem is as follows: 1. member(A) 2. member(B) 3. member(C) 4. ∀x[member(x) → (mc(x) ∨ sk(x))] 5. ∀x[mc(x) → ~like(x,rain)] 6. ∀x[sk(x) → like(x, snow)] 7. ∀x[like(B, x) → ~like(A, x)] 8. ∀x[~like(B, x) → like(A, x)] 9. like(A, rain) 10. like(A, snow) 11. Question: ∃x[member(x) ∧ mc(x) ∧ ~sk(x)]  We have to infer the 11th expression from the given 10.  Done through Resolution Refutation.
  • 34. Club example: Inferencing 1. member(A) 2. member(B) 3. member(C) 4. – Can be written as – 5. – 6. – 7. – ))]()(()([ xskxmcxmemberx ∨→∀ ))]()(()([ xskxmcxmember ∨→ )()()(~ xskxmcxmember ∨∨ )],()([ snowxlkxskx →∀ ),()(~ snowxlkxsk ∨ )],(~)([ rainxlkxmcx →∀ ),(~)(~ rainxlkxmc ∨ )],(~),([ xBlkxAlikex →∀ ),(~),(~ xBlkxAlike ∨
  • 35. 8. – 9. 10. 11. – Negate– )],(),([~ xBlkxAlkx →∀ ),(),( xBlkxAlk ∨ ),( rainAlk ),( snowAlk )](~)()([ xskxmcxmemberx ∧∧∃ )]()(~)([~ xskxmcxmemberx ∨∨∀
  • 36.  Now standardize the variables apart which results in the following 1. member(A) 2. member(B) 3. member(C) 4. 5. 6. 7. 8. 9. 10. 11. )()()(~ 111 xskxmcxmember ∨∨ ),()(~ 22 snowxlkxsk ∨ ),(~)(~ 33 rainxlkxmc ∨ ),(~),(~ 44 xBlkxAlike ∨ ),(),( 55 xBlkxAlk ∨ ),( rainAlk ),( snowAlk )]()(~)([~ 666 xskxmcxmemberx ∨∨∀
  • 37. ),(~),(~ 44 xBlkxAlike ∨ ),( snowAlk ),(~ snowBlk ),()(~ 22 snowxlkxsk ∨ )()()(~ 111 xskxmcxmember ∨∨)(~ Bsk )()(~ BmcBmember ∨ )(Bmember )(Bmc)]()(~)([~ 666 xskxmcxmemberx ∨∨∀ )()(~ BskBmember ∨ )(~ Bsk )(~ Bmember )(Bmember 7 10 12 5 13 4 14 2 11 15 16 13 17 2
  • 38. Assignment  Prove the inferencing in the Himalayan club example with different starting points, producing different resolution trees.  Think of a Prolog implementation of the problem  Prolog Reference (Prolog by Chockshin & Melish)
  • 40. A “department” environment 1. Dr. X is the HoD of CSE 2. Y and Z work in CSE 3. Dr. P is the HoD of ME 4. Q and R work in ME 5. Y is married to Q 6. By Institute policy staffs of the same department cannot marry 7. All married staff of CSE are insured by LIC 8. HoD is the boss of all staff in the department
  • 42. Questions on “department”  Who works in CSE?  Is there a married person in ME?  Is there somebody insured by LIC?
  • 43. Problem-3 (Zohar Manna, Mathematical Theory of Computation, 1974) From Propositional Calculus
  • 44. Tourist in a country of truth- sayers and liers  Facts and Rules: In a certain country, people either always speak the truth or always lie. A tourist T comes to a junction in the country and finds an inhabitant S of the country standing there. One of the roads at the junction leads to the capital of the country and the other does not. S can be asked only yes/no questions.  Question: What single yes/no question can T ask of S, so that the direction of the capital is revealed?
  • 45. Diagrammatic representation S (either always says the truth Or always lies) T (tourist) Capital
  • 46. Deciding the Propositions: a very difficult step- needs human intelligence  P: Left road leads to capital  Q: S always speaks the truth
  • 47. Meta Question: What question should the tourist ask  The form of the question  Very difficult: needs human intelligence  The tourist should ask  Is R true?  The answer is “yes” if and only if the left road leads to the capital  The structure of R to be found as a function of P and Q
  • 48. A more mechanical part: use of truth table P Q S’s Answer R T T Yes T T F Yes F F T No F F F No T
  • 49. Get form of R: quite mechanical  From the truth table  R is of the form (P x-nor Q) or (P ≡ Q)
  • 50. Get R in English/Hindi/Hebrew…  Natural Language Generation: non-trivial  The question the tourist will ask is  Is it true that the left road leads to the capital if and only if you speak the truth?  Exercise: A more well known form of this question asked by the tourist uses the X-OR operator instead of the X-Nor. What changes do you have to incorporate to the solution, to get that answer?
  • 52. Another tourist example: this time in a restaurant setting in a different country (Manna, 1974)  Facts: A tourist is in a restaurant in a country when the waiter tells him:  “do you see the three men in the table yonder? One of them is X who always speaks the truth, another is Y who always lies and the third is Z who sometimes speaks the truth and sometimes lies, i.e., answers yes/no randomly without regard to the question.  Question: Can you (the tourist) ask three yes/no questions to these men, always indicating who should answer the question, and determine who of them is X, who y and who Z?
  • 53. Solution: Most of the steps are doable by humans only  Number the persons: 1, 2, 3  1 can be X/Y/Z  2 can be X/Y/Z  3 can be X/Y/Z  Let the first question be to 1  One of 2 and 3 has to be NOT Z.  Critical step in the solution: only humans can do?
  • 54. Now cast the problem in the same setting as the tourist and the capital example  Solving by analogy  Use of previously solved problems  Hallmark of intelligence
  • 55. Analogy with the tourist and the capital problem  Find the direction to the capital   Find Z; who amongst 1, 2 and 3 is Z?  Ask a single yes/no question to S (the person standing at the junction)   Ask a single yes/no question to 1  Answer forced to reveal the direction of the capital   Answer forced to reveal who from 1,2,3 is Z
  • 56. Question to 1  Ask “Is R true” and the answer is yes if and only if 2 is not Z  Propositions  P: 2 is not Z  Q: 1 always speaks the truth, i.e., 1 is X
  • 57. Use of truth table as before P Q 1’s Answer R T T Yes T T F Yes F F T No F F F No T
  • 58. Question to 1: the first question  Is it true that 2 is not Z if and only if you are X?
  • 59. Analysis of 1’s answer  Ans= yes  Case 1: 1 is X/Y (always speaks the truth or always lies)  2 is indeed not Z (we can trust 1’s answer)  Case 2: 1 is Z  2 is indeed not Z (we cannot trust 1’s answer; but that does not affect us)
  • 60. Analysis of 1’s answer (contd)  Ans= no  Case 1: 1 is X/Y (always speaks the truth or always lies)  2 is Z; hence 3 is not Z  Case 2: 1 is Z  3 is not Z Note carefully: how cleverly Z is identified. Can a machine do it?
  • 61. Next steps: ask the 2nd question to determine X/Y  Once “Not Z” is identified- say 2, ask him a tautology  Is P≡P  If yes, 2 is X  If no, 2 is Y
  • 62. Ask the 3rd Question  Ask 2 “is 1 Z”  If 2 is X  Ans=yes, 1 is Z  Ans=no, 1 is Y  If 2 is Y (always lies)  Ans=yes, 1 is X  Ans=no, 1 is Z  3 is the remaining person
  • 63. What do these examples show?  Logic systematizes the reasoning process  Helps identify what is mechanical/routine/automatable  Brings to light the steps that only human intelligence can perform  These are especially of foundational and structural nature (e.g., deciding what propositions to start with)  Algorithmizing reasoning is not trivial