Logic of graphs
In the mathematical fields of graph theory and finite model theory, the logic of graphs deals with formal specifications of graph properties using sentences of mathematical logic. There are several variations in the types of logical operation that can be used in these sentences. The first-order logic of graphs concerns sentences in which the variables and predicates concern individual vertices and edges of a graph, while monadic second-order graph logic allows quantification over sets of vertices or edges. Logics based on least fixed point operators allow more general predicates over tuples of vertices, but these predicates can only be constructed through fixed-point operators, restricting their power to an intermediate level between first order and monadic second order.
A sentence may be true for some graphs, and false for others; a graph is said to model , written , if is true of the vertices and adjacency relation of . The algorithmic problem of model checking concerns testing whether a given graph models a given sentence. The algorithmic problem of satisfiability concerns testing whether there exists a graph that models a given sentence. Although both model checking and satisfiability are hard in general, several major algorithmic meta-theorems show that properties expressed in this way can be tested efficiently for important classes of graphs.
Other topics of research in the logic of graphs include investigations of the probability that a random graph has a property specified within a particular type of logic, and methods for data compression based on finding logical sentences that are modeled by a unique graph.
For instance, the condition that a graph does not have any isolated vertices may be expressed by the sentence
where the symbol indicates the undirected adjacency relation between two vertices. This sentence can be interpreted as meaning that for every vertex there is another vertex that is adjacent to .
The subgraph isomorphism problem for a fixed subgraph H asks whether H appears as a subgraph of a larger graph G. It may be expressed by a sentence that states the existence of vertices (one for each vertex of H) such that, for each edge of H, the corresponding pair of variables represent adjacent vertices and such that, for each remaining pair of vertices of H, the corresponding pair of variables represent distinct vertices; see the illustration. As a special case the clique problem (for a fixed clique size) may be expressed by a sentence that states the existence of a number of vertices equal to the clique size all of which are adjacent.
Other types of graphs, such as directed graphs, may involve different axioms, and logical formulations of multigraph properties require special handling such as having multiple edge relations or separate variables for vertices and edges.
Glebskiĭ et al. (1969) and, independently, Fagin (1976) proved a zero–one law for first-order graph logic; Fagin's proof used the compactness theorem. According to this result, every first-order sentence is either almost always true or almost always false for random graphs in the Erdős–Rényi model. That is, let S be a fixed first-order sentence, and choose a random n-vertex graph Gn uniformly at random among all graphs on a set of n labeled vertices. Then in the limit as n tends to infinity the probability that Gn models S will tend either to zero or to one:
Moreover, there is a specific infinite graph, the Rado graph R, such that the sentences modeled by the Rado graph are exactly the ones for which the probability of being modeled by a random finite graph tends to one:
For random graphs in which each edge is included independently of the others with a fixed probability, the same result is true, with the same sentences having probabilities tending to zero or to one.
The computational complexity of determining whether a given sentence has probability tending to zero or to one is high: the problem is PSPACE-complete. If a first-order graph property has probability tending to one on random graphs, then it is possible to list all the n-vertex graphs that model the property, with polynomial delay (as a function of n) per graph.
A similar analysis can be performed for non-uniform random graphs, where the probability of including an edge is a function of the number of vertices, and where the decision to include or exclude an edge is made independently with equal probability for all edges. However, for these graphs the situation is more complicated. In this case, a first-order property may have one or more thresholds, such that when the edge inclusion probability is bounded away from the threshold then the probability of having the given property tends to zero or one. These thresholds can never be an irrational power of n, so random graphs where the edge inclusion probability is an irrational power obey a zero-one law analogous to the one for uniformly random graphs. A similar zero-one law holds for very sparse random graphs that have an edge inclusion probability of n−c with c > 1, as long as c is not a superparticular ratio. If c is superparticular, the probability of having a given property may tend to a limit that is not zero or one, but this limit can be calculated efficiently. There exist first-order sentences that have infinitely many thresholds.
If a first-order sentence includes k distinct variables, then the property it describes can be tested in graphs of n vertices by examining all k-tuples of vertices; however, this brute force search algorithm is not particularly efficient, taking time O(nk). The problem of checking whether a graph models a given first-order sentence includes as special cases the subgraph isomorphism problem (in which the sentence describes the graphs that contain a fixed subgraph) and the clique problem (in which the sentence describes graphs that contain complete subgraphs of a fixed size). The clique problem is hard for W(1), the first level of a hierarchy of hard problems from the point of view of parameterized complexity. Therefore, it is unlikely to have a fixed-parameter tractable algorithm, one whose running time takes the form O(f(k) nc) for a function f and constant c that are independent of k and n. More strongly, if the exponential time hypothesis is true, then clique-finding and first-order model checking would necessarily take time proportional to a power of n whose exponent is proportional to k.
On restricted classes of graphs, model checking of first-order sentences can be much more efficient. In particular, every graph property expressible as a first-order sentence can be tested in linear time for the graphs of bounded expansion. These are the graphs in which all shallow minors are sparse graphs, with a ratio of edges to vertices bounded by a function of the depth of the minor. Even more generally, first-order model checking can be performed in near-linear time for nowhere-dense graphs, classes of graphs for which, at each possible depth, there is at least one forbidden shallow minor. Conversely, if model checking is fixed-parameter tractable for any hereditary family of graphs, that family must be nowhere-dense.
Data compression and graph isomorphismEdit
A first-order sentence S in the logic of graphs is said to define a graph G if G is the only graph that models S. Every graph may be defined by at least one sentence; for instance, one can define an n-vertex graph G by a sentence with n + 1 variables, one for each vertex of the graph, and one more to state the condition that there is no vertex other than the n vertices of the graph. Additional clauses of the sentence can be used to ensure that no two vertex variables are equal, that each edge of G is present, and no edge exists between a pair of non-adjacent vertices of G. However, for some graphs there exist significantly shorter sentences that define the graph.
Several different graph invariants can be defined from the simplest sentences (with different measures of simplicity) that define a given graph. In particular the logical depth of a graph is defined to be the minimum level of nesting of quantifiers (the quantifier rank) in a sentence defining the graph. The sentence outlined above nests the quantifiers for all of its variables, so it has logical depth n + 1. The logical width of a graph is the minimum number of variables in a sentence that defines it. In the sentence outlined above, this number of variables is again n + 1. Both the logical depth and logical width can be bounded in terms of the treewidth of the given graph. The logical length, analogously, is defined as the length of the shortest sentence describing the graph. The sentence described above has length proportional to the square of the number of vertices, but it is possible to define any graph by a sentence with length proportional to its number of edges.
All trees, and most graphs, can be described by first-order sentences with only two variables, but extended by counting predicates. For graphs that can be described by sentences in this logic with a fixed constant number of variables, it is possible to find a graph canonization in polynomial time (with the exponent of the polynomial equal to the number of variables). By comparing canonizations, it is possible to solve the graph isomorphism problem for these graphs in polynomial time.
There exist first-order sentences that are modeled by infinite graphs but not by any finite graph. For instance, the property of having exactly one vertex of degree one, with all other vertices having degree exactly two, can be expressed by a first-order sentence. It is modeled by an infinite ray, but violates Euler's handshaking lemma for finite graphs. However, it follows from the negative solution to the Entscheidungsproblem (by Alonzo Church and Alan Turing in the 1930s) that satisfiability of first-order sentences for graphs that are not constrained to be finite remains undecidable. It is also undecidable to distinguish between the first-order sentences that are true for all graphs and the ones that are true of finite graphs but false for some infinite graphs.
Least fixed point based logics of graphs extend the first-order logic of graphs by allowing predicates defined by special fixed-point operators, which define a predicate as the fixed point of a formula that relates values of the predicate to other values of the same predicate. For instance, if is a predicate that determines whether two vertices are connected by a path in a given graph, then is the least fixed point of the formula
Here, being a fixed point means that the truth of the right side of the formula implies the truth of the left side (as the reversed implication arrow suggests). Being the least fixed means that the pairs of vertices for which is true are a subset of the pairs of vertices for which any other fixed point of the same formula is true. In least fixed point logic, the right hand side of the defining formula must use the predicate only positively (that is, each appearance should be nested within an even number of negations) in order to make the least fixed point well defined. In an equivalent variant, inflationary fixed point logic, the formula need not be monotone but the resulting fixed point is defined as the one obtained by repeatedly applying implications derived from the defining formula starting from the all-false predicate. Other variants, allowing negative implications or multiple simultaneously-defined predicates, are also possible, but provide no additional definitional power. A predicate, defined in one of these ways, can then be applied to a tuple of vertices as part of a larger logical sentence.
Fixed point logics, and extensions of these logics that also allow integer counting variables whose values range from 0 to the number of vertices, have been used in descriptive complexity in an attempt to provide a logical description of decision problems in graph theory that can be decided in polynomial time. The fixed point of a logical formula can be constructed in polynomial time, by an algorithm that repeatedly adds tuples to the set of values for which the predicate is true until reaching a fixed point, so deciding whether a graph models a sentence in this logic can always be decided in polynomial time. Not every polynomial time graph property can be modeled by a sentence in a logic that uses only fixed points and counting. However, for some special classes of graphs the polynomial time properties are the same as the properties expressible in fixed point logic with counting. These include random graphs, interval graphs, and (through a logical expression of the graph structure theorem) every class of graphs characterized by forbidden minors.
In the monadic second-order logic of graphs, the variables represent objects of up to four types: vertices, edges, sets of vertices, and sets of edges. There are two main variations of monadic second-order graph logic: MSO1 in which only vertex and vertex set variables are allowed, and MSO2 in which all four types of variables are allowed. The predicates on these variables include equality testing, membership testing, and either vertex-edge incidence (if both vertex and edge variables are allowed) or adjacency between pairs of vertices (if only vertex variables are allowed). Additional variations in the definition allow additional predicates such as modular counting predicates.
As an example, the connectivity of an undirected graph can be expressed in MSO1 as the statement that, for every partition of the vertices into two nonempty subsets, there exists an edge from one subset to the other. A partition of the vertices can be described by the subset S of vertices on one side of the partition, and each such subset should either describe a trivial partition (one in which one or the other side is empty) or be crossed by an edge. That is, a graph is connected when it models the MSO1 sentence
However, connectivity cannot be expressed in first-order graph logic, nor can it be expressed in existential MSO1 (the fragment of MSO1 in which all set quantifiers are existential and occur at the beginning of the sentence) nor even existential MSO2.
Hamiltonicity can be expressed in MSO2 by the existence of a set of edges that forms a connected 2-regular graph on all the vertices, with connectivity expressed as above and 2-regularity expressed as the incidence of two but not three distinct edges at each vertex. However, Hamiltonicity is not expressible in MSO1, because MSO1 is not capable of distinguishing complete bipartite graphs with equal numbers of vertices on each side of the bipartition (which are Hamiltonian) from unbalanced complete bipartite graphs (which are not).
Although not part of the definition of MSO2, orientations of undirected graphs can be represented by a technique involving Trémaux trees. This allows other graph properties involving orientations to be expressed as well.
According to Courcelle's theorem, every fixed MSO2 property can be tested in linear time on graphs of bounded treewidth, and every fixed MSO1 property can be tested in linear time on graphs of bounded clique-width. The version of this result for graphs of bounded treewidth can also be implemented in logarithmic space. Applications of this result include a fixed-parameter tractable algorithm for computing the crossing number of a graph.
The satisfiability problem for a sentence of monadic second-order logic is the problem of determining whether there exists at least one graph (possibly within a restricted family of graphs) for which the sentence is true. For arbitrary graph families, and arbitrary sentences, this problem is undecidable. However, satisfiability of MSO2 sentences is decidable for the graphs of bounded treewidth, and satisfiability of MSO1 sentences is decidable for graphs of bounded clique-width. The proof involves using Courcelle's theorem to build an automaton that can test the property, and then examining the automaton to determine whether there is any graph it can accept.
As a partial converse, Seese (1991) proved that, whenever a family of graphs has a decidable MSO2 satisfiability problem, the family must have bounded treewidth. The proof is based on a theorem of Robertson and Seymour that the families of graphs with unbounded treewidth have arbitrarily large grid minors. Seese also conjectured that every family of graphs with a decidable MSO1 satisfiability problem must have bounded clique-width; this has not been proven, but a weakening of the conjecture that extends MSO1 with modular counting predicates is true.
- Spencer (2001), Section 1.2, "What Is a First Order Theory?", pp. 15–17.
- Verbitsky & Zhukovskii (2019).
- Goldberg (1993).
- For instance, Henson (1972) requires directed graphs to be described by an asymmetric relation, meaning that loops and 2-cycles are both disallowed, giving the oriented graphs.
- Koncewicz (1973).
- Bruggink & König (2018).
- Grandjean (1983).
- Shelah & Spencer (1988); Spencer (2001).
- Lynch (1992).
- Spencer (1990).
- Downey & Fellows (1995).
- Chen et al. (2006).
- Nešetřil & Ossona de Mendez (2012), 18.3 The Subgraph Isomorphism Problem and Boolean Queries, pp. 400–401; Dvořák, Kráľ & Thomas (2010); Grohe, Kreutzer & Siebertz (2014).
- Pikhurko, Spencer & Verbitsky (2006).
- Pikhurko & Verbitsky (2011).
- Verbitsky (2005).
- Immerman & Lander (1990).
- Parys (2014) writes that this undecidability result is well known, and attributes it to Trahtenbrot (1950) on the undecidability of first-order satisfiability for more general classes of finite structures.
- Lavrov (1963).
- Grohe (2017), pp. 23–27.
- Grohe (2017), pp. 50–51.
- Cai, Fürer & Immerman (1992).
- Hella, Kolaitis & Luosto (1996).
- Laubner (2010).
- Fagin, Stockmeyer & Vardi (1995).
- Courcelle & Engelfriet (2012); Libkin (2004), Corollary 7.24, pp. 126–127.
- Courcelle (1996).
- Courcelle & Engelfriet (2012).
- Elberfeld, Jakoby & Tantau (2010).
- Grohe (2001); Kawarabayashi & Reed (2007).
- Courcelle & Oum (2007).
- Bruggink, H. J. Sander; König, Barbara (2018), "Recognizable languages of arrows and cospans", Mathematical Structures in Computer Science, 28 (8): 1290–1332, doi:10.1017/S096012951800018X, MR 3849613
- Cai, Jin-Yi; Fürer, Martin; Immerman, Neil (1992), "An optimal lower bound on the number of variables for graph identification", Combinatorica, 12 (4): 389–410, doi:10.1007/BF01305232, MR 1194730.
- Chen, Jianer; Huang, Xiuzhen; Kanj, Iyad A.; Xia, Ge (2006), "Strong computational lower bounds via parameterized complexity", Journal of Computer and System Sciences, 72 (8): 1346–1367, doi:10.1016/j.jcss.2006.04.007
- Courcelle, Bruno (1996), "On the expression of graph properties in some fragments of monadic second-order logic" (PDF), in Immerman, Neil; Kolaitis, Phokion G. (eds.), Proc. Descr. Complex. Finite Models, DIMACS, 31, Amer. Math. Soc., pp. 33–62, MR 1451381.
- Courcelle, Bruno; Engelfriet, Joost (2012), Graph Structure and Monadic Second-Order Logic: A Language-Theoretic Approach, Encyclopedia of Mathematics and its Applications, 138, Cambridge University Press, ISBN 9781139644006, Zbl 1257.68006.
- Courcelle, Bruno; Oum, Sang-il (2007), "Vertex-minors, monadic second-order logic, and a conjecture by Seese" (PDF), Journal of Combinatorial Theory, Series B, 97 (1): 91–126, doi:10.1016/j.jctb.2006.04.003, MR 2278126.
- Downey, R. G.; Fellows, M. R. (1995), "Fixed-parameter tractability and completeness. II. On completeness for W", Theoretical Computer Science, 141 (1–2): 109–131, doi:10.1016/0304-3975(94)00097-3.
- Dvořák, Zdeněk; Kráľ, Daniel; Thomas, Robin (2010), "Deciding first-order properties for sparse graphs", Proc. 51st Annual IEEE Symposium on Foundations of Computer Science (FOCS 2010), pp. 133–142, MR 3024787.
- Elberfeld, Michael; Jakoby, Andreas; Tantau, Till (October 2010), "Logspace Versions of the Theorems of Bodlaender and Courcelle" (PDF), Proc. 51st Annual IEEE Symposium on Foundations of Computer Science (FOCS 2010), pp. 143–152, doi:10.1109/FOCS.2010.21.
- Fagin, Ronald (1976), "Probabilities on finite models" (PDF), Journal of Symbolic Logic, 41 (1): 50–58, doi:10.1017/s0022481200051756, MR 0476480.
- Fagin, Ronald; Stockmeyer, Larry J.; Vardi, Moshe Y. (1995), "On monadic NP vs monadic co-NP", Information and Computation, 120 (1): 78–92, doi:10.1006/inco.1995.1100, MR 1340807.
- Glebskiĭ, Ju. V.; Kogan, D. I.; Liogon'kiĭ, M. I.; Talanov, V. A. (1969), "Volume and fraction of satisfiability of formulas of the lower predicate calculus", Otdelenie Matematiki, Mekhaniki i Kibernetiki Akademii Nauk Ukrainskoĭ SSR: Kibernetika (2): 17–27, MR 0300882.
- Goldberg, Leslie Ann (1993), "Polynomial space polynomial delay algorithms for listing families of graphs", Proceedings of the Twenty-fifth Annual ACM Symposium on Theory of Computing (STOC '93), New York, NY, USA: ACM, pp. 218–225, doi:10.1145/167088.167160, ISBN 0-89791-591-7.
- Grandjean, Étienne (1983), "Complexity of the first-order theory of almost all finite structures", Information and Control, 57 (2–3): 180–204, doi:10.1016/S0019-9958(83)80043-6, MR 0742707.
- Grohe, Martin (2001), "Computing crossing numbers in quadratic time", Proceedings of the Thirty-third Annual ACM Symposium on Theory of Computing (STOC '01), pp. 231–236, arXiv:cs/0009010, doi:10.1145/380752.380805.
- Grohe, Martin (2017), Descriptive complexity, canonisation, and definable graph structure theory, Lecture Notes in Logic, 47, Cambridge University Press, Cambridge, ISBN 978-1-107-01452-7, MR 3729479.
- Grohe, Martin; Kreutzer, Stephan; Siebertz, Sebastian (2014), "Deciding first-order properties of nowhere dense graphs", Proceedings of the 46th Annual ACM Symposium on Theory of Computing (STOC '14), New York: ACM, pp. 89–98, arXiv:1311.3899, doi:10.1145/2591796.2591851, ISBN 978-1-4503-2710-7.
- Hella, Lauri; Kolaitis, Phokion G.; Luosto, Kerkko (1996), "Almost everywhere equivalence of logics in finite model theory", The Bulletin of Symbolic Logic, 2 (4): 422–443, doi:10.2307/421173, MR 1460316.
- Henson, C. Ward (1972), "Countable homogeneous relational structures and -categorical theories", The Journal of Symbolic Logic, 37: 494–500, doi:10.2307/2272734, JSTOR 2272734, MR 0321727
- Immerman, Neil; Lander, Eric (1990), "Describing graphs: a first-order approach to graph canonization", in Selman, Alan L. (ed.), Complexity Theory Retrospective: In honor of Juris Hartmanis on the occasion of his sixtieth birthday, New York: Springer-Verlag, pp. 59–81, doi:10.1007/978-1-4612-4478-3_5, MR 1060782.
- Lavrov, I. A. (1963), "The effective non-separability of the set of identically true formulae and the set of finitely refutable formulae for certain elementary theories", Algebra i Logika Sem., 2 (1): 5–18, MR 0157904
- Kawarabayashi, Ken-ichi; Reed, Bruce (2007), "Computing crossing number in linear time", Proceedings of the Thirty-ninth Annual ACM Symposium on Theory of Computing (STOC '07), pp. 382–390, doi:10.1145/1250790.1250848.
- Koncewicz, Leszek (1973), "Definability of classes of graphs in the first order predicate calculus with identity", Polish Academy of Sciences, 32: 159–190, doi:10.1007/BF02123839, JSTOR 20014678, MR 0351796
- Laubner, Bastian (2010), "Capturing polynomial time on interval graphs", 25th Annual IEEE Symposium on Logic in Computer Science (LICS 2010), Los Alamitos, California: IEEE Computer Society, pp. 199–208, arXiv:0911.3799, doi:10.1109/LICS.2010.42, MR 2963094.
- Libkin, Leonid (2004), Elements of finite model theory, Texts in Theoretical Computer Science: An EATCS Series, Springer-Verlag, Berlin, doi:10.1007/978-3-662-07003-1, ISBN 3-540-21202-7, MR 2102513.
- Lynch, James F. (1992), "Probabilities of sentences about very sparse random graphs", Random Structures & Algorithms, 3 (1): 33–53, doi:10.1002/rsa.3240030105, MR 1139487.
- Nešetřil, Jaroslav; Ossona de Mendez, Patrice (2012), Sparsity: Graphs, Structures, and Algorithms, Algorithms and Combinatorics, 28, Springer-Verlag, doi:10.1007/978-3-642-27875-4, hdl:10338.dmlcz/143192, ISBN 978-3-642-27874-7, MR 2920058.
- Parys, Paweł (2014), "First-order logic on CPDA graphs", Computer science—theory and applications, Lecture Notes in Computer Science, 8476, New York: Springer-Verlag, pp. 300–313, doi:10.1007/978-3-319-06686-8_23, MR 3218557.
- Pikhurko, Oleg; Spencer, Joel; Verbitsky, Oleg (2006), "Succinct definitions in the first order theory of graphs", Annals of Pure and Applied Logic, 139 (1–3): 74–109, arXiv:math/0401307, doi:10.1016/j.apal.2005.04.003, MR 2206252.
- Pikhurko, Oleg; Verbitsky, Oleg (2011), "Logical complexity of graphs: a survey", in Grohe, Martin; Makowsky, Johann A. (eds.), Model Theoretic Methods in Finite Combinatorics (AMS-ASL Joint Special Session, January 5-8, 2009, Washington, DC), Contemporary Mathematics, 558, American Mathematical Society, pp. 129–180.
- Seese, D. (1991), "The structure of the models of decidable monadic theories of graphs", Annals of Pure and Applied Logic, 53 (2): 169–195, doi:10.1016/0168-0072(91)90054-P, MR 1114848.
- Shelah, Saharon; Spencer, Joel (1988), "Zero-one laws for sparse random graphs", Journal of the American Mathematical Society, 1 (1): 97–115, doi:10.2307/1990968, MR 0924703.
- Spencer, Joel (1990), "Infinite spectra in the first order theory of graphs", Combinatorica, 10 (1): 95–102, doi:10.1007/BF02122699, MR 1075070.
- Spencer, Joel (2001), The Strange Logic of Random Graphs, Algorithms and Combinatorics, 22, Springer-Verlag, Berlin, doi:10.1007/978-3-662-04538-1, ISBN 3-540-41654-4, MR 1847951.
- Trahtenbrot, B. A. (1950), "The impossibility of an algorithm for the decision problem for finite domains", Doklady Akademii Nauk SSSR, New Series, 70: 569–572, MR 0033784.
- Verbitsky, Oleg (2005), "The first order definability of graphs with separators via the Ehrenfeucht game", Theoretical Computer Science, 343 (1–2): 158–176, arXiv:math/0401361, doi:10.1016/j.tcs.2005.05.003, MR 2168849.
- Verbitsky, Oleg; Zhukovskii, Maksim (2019), "Tight bounds on the asymptotic descriptive complexity of subgraph isomorphism", ACM Transactions on Computational Logic, 20 (2): A9:1–A9:18, arXiv:1802.02143, doi:10.1145/3303881, MR 3942556.