Measurement dysfunction

Measurement dysfunction describes a situation or behavior where actual data metrics, statistics and especially their meaning (or communicated meaning), can become problematic due to misuse.[1][2][3] Specifically, in areas such as Human Resources (Performance measurements[4]), Technology (Safety[5]), Finance or Health,[5] measurement dysfunctionality are critical, as it can lead to negative outcomes, wrong predictions or forecasts.

Practices to avoid:[6][3]

  • Reward of wrong behavior (also persons who manipulate[7])
  • Measuring the wrong things[8]
  • Measuring either not enough or too much
  • Cheating or data manipulation (intentional or unintentional due to wrong calculation models, systematic errors, human errors, etc.)

On eliminating dysfunctional measurement:[9]

  • Establish, and monitor the move to and adherence to ‘policies’ for good, functional measurement
  • Support technical correctness
  • Periodically evaluate the information need and value delivered by measurements

Trivia edit

"What gets measured gets manipulated."[10][11]

See also edit

References edit

  1. ^ "Presentations and Papers". www.osel.co.uk. Retrieved 2021-02-22.
  2. ^ Austin, Robert D. (1996). Measuring and managing performance in organizations. Tom DeMarco, Timothy R. Lister. New York: Dorset House Publishing. ISBN 0-932633-36-6. OCLC 34798037.
  3. ^ a b "Measurement Dysfunction". proactsafety.com. Retrieved 2021-02-22.
  4. ^ "Measurement Madness: Recognizing and Avoiding the Pitfalls of Performance Measurement | Wiley". Wiley.com. Retrieved 2021-02-22.
  5. ^ a b Vincent, Charles, Dr (2013). The measurement and monitoring of safety : drawing together academic evidence and practical experience to produce a framework for safety measurement and monitoring. Susan Burnett, Jane Carthey. London. ISBN 978-1-906461-44-7. OCLC 861644942.{{cite book}}: CS1 maint: location missing publisher (link) CS1 maint: multiple names: authors list (link)
  6. ^ "When Measurement Goes Bad". www.amanet.org. Retrieved 2021-02-22.
  7. ^ "How to Spot and Stop Manipulators". Psychology Today. Retrieved 2021-02-22.
  8. ^ Leonelli, Sabina (2020), "Scientific Research and Big Data", in Zalta, Edward N. (ed.), The Stanford Encyclopedia of Philosophy (Summer 2020 ed.), Metaphysics Research Lab, Stanford University, retrieved 2021-02-22
  9. ^ Shelley, C. C. (October 2009). "eXtreme Measurement: recognizing, understanding and avoiding measurement dysfunction" (PDF). www.osel.co.uk. Oxford Software Engineering. Retrieved 2021-02-22.{{cite web}}: CS1 maint: date and year (link)
  10. ^ Dekker, Sidney (2017-10-19). "What gets measured, gets manipulated". The Safety Anarchist. Routledge. pp. 75–98. doi:10.4324/9780203733455-5. ISBN 978-0-203-73345-5.
  11. ^ "Managing the Unmanageable: More Rules of Thumb". www.managingtheunmanageable.net. Retrieved 2021-02-22.