Resolution (logic)

In mathematical logic and automated theorem proving, resolution is a rule of inference leading to a refutation complete theorem-proving technique for sentences in propositional logic and first-order logic. For propositional logic, systematically applying the resolution rule acts as a decision procedure for formula unsatisfiability, solving the (complement of the) Boolean satisfiability problem. For first-order logic, resolution can be used as the basis for a semi-algorithm for the unsatisfiability problem of first-order logic, providing a more practical method than one following from Gödel's completeness theorem.

The resolution rule can be traced back to Davis and Putnam (1960);[1] however, their algorithm required trying all ground instances of the given formula. This source of combinatorial explosion was eliminated in 1965 by John Alan Robinson's syntactical unification algorithm, which allowed one to instantiate the formula during the proof "on demand" just as far as needed to keep refutation completeness.[2]

The clause produced by a resolution rule is sometimes called a resolvent.

Resolution in propositional logicEdit

Resolution ruleEdit

The resolution rule in propositional logic is a single valid inference rule that produces a new clause implied by two clauses containing complementary literals. A literal is a propositional variable or the negation of a propositional variable. Two literals are said to be complements if one is the negation of the other (in the following,   is taken to be the complement to  ). The resulting clause contains all the literals that do not have complements. Formally:

 

where

all  ,  , and   are literals,
the dividing line stands for "entails".

The above may also be written as:

 

The clause produced by the resolution rule is called the resolvent of the two input clauses. It is the principle of consensus applied to clauses rather than terms.[3]

When the two clauses contain more than one pair of complementary literals, the resolution rule can be applied (independently) for each such pair; however, the result is always a tautology.

Modus ponens can be seen as a special case of resolution (of a one-literal clause and a two-literal clause).

 

is equivalent to

 

A resolution techniqueEdit

When coupled with a complete search algorithm, the resolution rule yields a sound and complete algorithm for deciding the satisfiability of a propositional formula, and, by extension, the validity of a sentence under a set of axioms.

This resolution technique uses proof by contradiction and is based on the fact that any sentence in propositional logic can be transformed into an equivalent sentence in conjunctive normal form.[4] The steps are as follows.

  • All sentences in the knowledge base and the negation of the sentence to be proved (the conjecture) are conjunctively connected.
  • The resulting sentence is transformed into a conjunctive normal form with the conjuncts viewed as elements in a set, S, of clauses.[4]
    • For example,   gives rise to the set  .
  • The resolution rule is applied to all possible pairs of clauses that contain complementary literals. After each application of the resolution rule, the resulting sentence is simplified by removing repeated literals. If the clause contains complementary literals, it is discarded (as a tautology). If not, and if it is not yet present in the clause set S, it is added to S, and is considered for further resolution inferences.
  • If after applying a resolution rule the empty clause is derived, the original formula is unsatisfiable (or contradictory), and hence it can be concluded that the initial conjecture follows from the axioms.
  • If, on the other hand, the empty clause cannot be derived, and the resolution rule cannot be applied to derive any more new clauses, the conjecture is not a theorem of the original knowledge base.

One instance of this algorithm is the original Davis–Putnam algorithm that was later refined into the DPLL algorithm that removed the need for explicit representation of the resolvents.

This description of the resolution technique uses a set S as the underlying data-structure to represent resolution derivations. Lists, Trees and Directed Acyclic Graphs are other possible and common alternatives. Tree representations are more faithful to the fact that the resolution rule is binary. Together with a sequent notation for clauses, a tree representation also makes it clear to see how the resolution rule is related to a special case of the cut-rule, restricted to atomic cut-formulas. However, tree representations are not as compact as set or list representations, because they explicitly show redundant subderivations of clauses that are used more than once in the derivation of the empty clause. Graph representations can be as compact in the number of clauses as list representations and they also store structural information regarding which clauses were resolved to derive each resolvent.

A simple exampleEdit

 

In plain language: Suppose   is false. In order for the premise   to be true,   must be true. Alternatively, suppose   is true. In order for the premise   to be true,   must be true. Therefore, regardless of falsehood or veracity of  , if both premises hold, then the conclusion   is true.

Resolution in first order logicEdit

Resolution rule can be generalized to first-order logic to:[5]

 

where   is a most general unifier of   and  , and   and   have no common variables.

ExampleEdit

The clauses   and   can apply this rule with   as unifier.

Here x is a variable and b is a constant.

 

Here we see that

  • The clauses   and   are the inference's premises
  •   (the resolvent of the premises) is its conclusion.
  • The literal   is the left resolved literal,
  • The literal   is the right resolved literal,
  •   is the resolved atom or pivot.
  •   is the most general unifier of the resolved literals.

Informal explanationEdit

In first order logic, resolution condenses the traditional syllogisms of logical inference down to a single rule.

To understand how resolution works, consider the following example syllogism of term logic:

All Greeks are Europeans.
Homer is a Greek.
Therefore, Homer is a European.

Or, more generally:

 
 
Therefore,  

To recast the reasoning using the resolution technique, first the clauses must be converted to conjunctive normal form (CNF). In this form, all quantification becomes implicit: universal quantifiers on variables (X, Y, ...) are simply omitted as understood, while existentially-quantified variables are replaced by Skolem functions.

 
 
Therefore,  

So the question is, how does the resolution technique derive the last clause from the first two? The rule is simple:

  • Find two clauses containing the same predicate, where it is negated in one clause but not in the other.
  • Perform a unification on the two predicates. (If the unification fails, you made a bad choice of predicates. Go back to the previous step and try again.)
  • If any unbound variables which were bound in the unified predicates also occur in other predicates in the two clauses, replace them with their bound values (terms) there as well.
  • Discard the unified predicates, and combine the remaining ones from the two clauses into a new clause, also joined by the "∨" operator.

To apply this rule to the above example, we find the predicate P occurs in negated form

¬P(X)

in the first clause, and in non-negated form

P(a)

in the second clause. X is an unbound variable, while a is a bound value (term). Unifying the two produces the substitution

Xa

Discarding the unified predicates, and applying this substitution to the remaining predicates (just Q(X), in this case), produces the conclusion:

Q(a)

For another example, consider the syllogistic form

All Cretans are islanders.
All islanders are liars.
Therefore all Cretans are liars.

Or more generally,

X P(X) → Q(X)
X Q(X) → R(X)
Therefore, ∀X P(X) → R(X)

In CNF, the antecedents become:

¬P(X) ∨ Q(X)
¬Q(Y) ∨ R(Y)

(Note that the variable in the second clause was renamed to make it clear that variables in different clauses are distinct.)

Now, unifying Q(X) in the first clause with ¬Q(Y) in the second clause means that X and Y become the same variable anyway. Substituting this into the remaining clauses and combining them gives the conclusion:

¬P(X) ∨ R(X)

FactoringEdit

The resolution rule, as defined by Robinson, also incorporated factoring, which unifies two literals in the same clause, before or during the application of resolution as defined above. The resulting inference rule is refutation-complete,[6] in that a set of clauses is unsatisfiable if and only if there exists a derivation of the empty clause using only resolution, enhanced by factoring.

An example for an unsatisfiable clause set for which factoring is needed to derive the empty clause is:

 

Since each clause consists of two literals, so does each possible resolvent. Therefore, by resolution without factoring, the empty clause can never be obtained. Using factoring, it can be obtained e.g. as follows:[7]

 

Non-clausal resolutionEdit

Generalizations of the above resolution rule have been devised that do not require the originating formulas to be in clausal normal form.[8][9][10][11][12][13]

These techniques are useful mainly in interactive theorem proving where it is important to preserve human readability of intermediate result formulas. Besides, they avoid combinatorial explosion during transformation to clause-form,[10]:98 and sometimes save resolution steps.[13]:425

Non-clausal resolution in propositional logicEdit

For propositional logic, Murray[9]:18 and Manna and Waldinger[10]:98 use the rule

 ,

where   denotes an arbitrary formula,   denotes a formula containing   as a subformula, and   is built by replacing in   every occurrence of   by  ; likewise for  . The resolvent   is intended to be simplified using rules like  , etc. In order to prevent generating useless trivial resolvents, the rule shall be applied only when   has at least one "negative" and "positive"[14] occurrence in   and  , respectively. Murray has shown that this rule is complete if augmented by appropriate logical transformation rules.[10]:103

Traugott uses the rule

 ,

where the exponents of   indicate the polarity of its occurrences. While   and   are built as before, the formula   is obtained by replacing each positive and each negative occurrence of   in   with   and  , respectively. Similar to Murray's approach, appropriate simplifying transformations are to be applied to the resolvent. Traugott proved his rule to be complete, provided   are the only connectives used in formulas.[12]:398–400

Traugott's resolvent is stronger than Murray's.[12]:395 Moreover, it does not introduce new binary junctors, thus avoiding a tendency towards clausal form in repeated resolution. However, formulas may grow longer when a small   is replaced multiple times with a larger   and/or  .[12]:398

Propositional non-clausal resolution exampleEdit

As an example, starting from the user-given assumptions

 

the Murray rule can be used as follows to infer a contradiction:[15]

 

For the same purpose, the Traugott rule can be used as follows :[12]:397

 

From a comparison of both deductions, the following issues can be seen:

  • Traugott's rule may yield a sharper resolvent: compare (5) and (10), which both resolve (1) and (2) on  .
  • Murray's rule introduced 3 new disjunction symbols: in (5), (6), and (7), while Traugott's rule didn't introduce any new symbol; in this sense, Traugott's intermediate formulas resemble the user's style more closely than Murray's.
  • Due to the latter issue, Traugott's rule can take advantage of the implication in assumption (4), using as   the non-atomic formula   in step (12). Using Murray's rules, the semantically equivalent formula   was obtained as (7), however, it could not be used as   due to its syntactic form.

Non-clausal resolution in first-order logicEdit

For first-order predicate logic, Murray's rule is generalized to allow distinct, but unifiable, subformulas   and   of   and  , respectively. If   is the most general unifier of   and  , then the generalized resolvent is  . While the rule remains sound if a more special substitution   is used, no such rule applications are needed to achieve completeness.[citation needed]

Traugott's rule is generalized to allow several pairwise distinct subformulas   of   and   of  , as long as   have a common most general unifier, say  . The generalized resolvent is obtained after applying   to the parent formulas, thus making the propositional version applicable. Traugott's completeness proof relies on the assumption that this fully general rule is used;[12]:401 it is not clear whether his rule would remain complete if restricted to   and  .[16]

ParamodulationEdit

Paramodulation is a related technique for reasoning on sets of clauses where the predicate symbol is equality. It generates all "equal" versions of clauses, except reflexive identities. The paramodulation operation takes a positive from clause, which must contain an equality literal. It then searches an into clause with a subterm that unifies with one side of the equality. The subterm is then replaced by the other side of the equality. The general aim of paramodulation is to reduce the system to atoms, reducing the size of the terms when substituting.[17]

ImplementationsEdit

See alsoEdit

NotesEdit

  1. ^ Martin Davis, Hilary Putnam (1960). "A Computing Procedure for Quantification Theory". J. ACM. 7 (3): 201–215. doi:10.1145/321033.321034. Here: p. 210, "III. Rule for Eliminating Atomic Formulas".
  2. ^ J.A. Robinson (Jan 1965). "A Machine-Oriented Logic Based on the Resolution Principle". Journal of the ACM. 12 (1): 23–41. doi:10.1145/321250.321253.
  3. ^ D.E. Knuth, The Art of Computer Programming 4A: Combinatorial Algorithms, part 1, p. 539
  4. ^ a b Leitsch, Alexander (1997), The resolution calculus, EATCS Monographs in Theoretical Computer Science, Springer, p. 11, Before applying the inference method itself, we transform the formulas to quantifier-free conjunctive normal form.
  5. ^ Enrique P. Arís, Juan L. González y Fernando M. Rubio, Lógica Computacional, Thomson, (2005).
  6. ^ Stuart J. Russell; Peter Norvig (2009). Artificial Intelligence: A Modern Approach (3rd ed.). Prentice Hall. p. 350 (= p. 286 in the 1st edition of 1995)
  7. ^ David A. Duffy (1991). Principles of Automated Theorem Proving. New York: Wiley. See p. 77. The example here is slightly modified to demonstrate a not-trivial factoring substitution. For clarity, the factoring step, (5), is shown separately. In step (6), the fresh variable   was introduced to enable unifiability of (5) and (6), needed for (7).
  8. ^ D. Wilkins (1973). QUEST — A Non-Clausal Theorem Proving System (Master's Thesis). Univ. of Essex, England.
  9. ^ a b Neil V. Murray (Feb 1979). A Proof Procedure for Quantifier-Free Non-Clausal First Order Logic (Technical report). Syracuse Univ. 2-79. (Cited from Manna, Waldinger, 1980 as: "A Proof Procedure for Non-Clausal First-Order Logic", 1978)
  10. ^ a b c d Zohar Manna, Richard Waldinger (Jan 1980). "A Deductive Approach to Program Synthesis". ACM Transactions on Programming Languages and Systems. 2: 90–121. doi:10.1145/357084.357090. A preprint appeared in Dec 1978 as SRI Technical Note 177
  11. ^ N. V. Murray (1982). "Completely Non-Clausal Theorem Proving". Artificial Intelligence. 18: 67–85. doi:10.1016/0004-3702(82)90011-x.
  12. ^ a b c d e f J. Traugott (1986). "Nested Resolution". Proc. 8th Conference on Automated Deduction. LNCS. 230. Springer. pp. 394–403.
  13. ^ a b Schmerl, U.R. (1988). "Resolution on Formula-Trees". Acta Informatica. 25: 425–438. doi:10.1007/bf02737109. Summary
  14. ^ These notions, called "polarities", refer to the number of explicit or implicit negations found above  . For example,   occurs positive in   and in  , negative in   and in  , and in both polarities in  .
  15. ^ " " is used to indicate simplification after resolution.
  16. ^ Here, " " denotes syntactical term equality modulo renaming
  17. ^ Nieuwenhuis, Robert; Rubio, Alberto. "Paramodulation-Based Theorem Proving". Handbook of Automated Reasoning (PDF).

ReferencesEdit

External linksEdit