In computational learning theory, the teaching dimension of a concept class C is defined to be , where is the minimum size of a witness set for c in C. Intuitively, this measures the number of instances that are needed to identify a concept in the class, using supervised learning with examples provided by a helpful teacher who is trying to convey the concept as succinctly as possible. This definition was formulated in 1995 by Sally Goldman and Michael Kearns,[1] based on earlier work by Goldman, Ron Rivest, and Robert Schapire.[2]

The teaching dimension of a finite concept class can be used to give a lower and an upper bound on the membership query cost of the concept class.

In Stasys Jukna's book "Extremal Combinatorics", a lower bound is given for the teaching dimension in general:

Let C be a concept class over a finite domain X. If the size of C is greater than

then the teaching dimension of C is greater than k.

However, there are more specific teaching models that make assumptions about teacher or learner, and can get lower values for the teaching dimension. For instance, several models are the classical teaching (CT) model,[1] the optimal teacher (OT) model,[3] recursive teaching (RT),[4] preference-based teaching (PBT),[5] and non-clashing teaching (NCT).[6]

References edit

  1. ^ a b Goldman, Sally A.; Kearns, Michael J. (1995). "On the complexity of teaching". Journal of Computer and System Sciences. 50 (1): 20–31. doi:10.1006/jcss.1995.1003. MR 1322630.
  2. ^ Goldman, Sally A.; Rivest, Ronald L.; Schapire, Robert E. (1993). "Learning binary relations and total orders". SIAM Journal on Computing. 22 (5): 1006–1034. doi:10.1137/0222062. MR 1237160.
  3. ^ Balbach, Frank J. (2008). "Measuring teachability using variants of the teaching dimension". Theoretical Computer Science. 397 (1–3): 94–113. doi:10.1016/j.tcs.2008.02.025. MR 2401488.
  4. ^ Sandra Zilles, Steffen Lange, Robert Holte, and Martin Zinkevich (2011). "Models of cooperative teaching and learning". Journal of Machine Learning Research. 12: 349–384.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  5. ^ Ziyuan Gao, Christoph Ries, Hans Ulrich Simon, and Sandra Zilles (2017). "Preference-based teaching". Journal of Machine Learning Research. 18. arXiv:1702.02047.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  6. ^ Kirkpatrick, Hans U Simon, and Sandra Zilles (2019). "Optimal collusion-free teaching". Algorithmic Learning Theory: 506–528. arXiv:1903.04012.{{cite journal}}: CS1 maint: multiple names: authors list (link)