All Models Are Wrong
All models are wrong

							

						From Wikipedia, the free encyclopedia
					
All models are wrong is a common aphorism and anapodoton in statistics. It is often expanded as "All models are wrong, but some are useful". The aphorism acknowledges that statistical models always fall short of the complexities of reality but can still be useful nonetheless. The aphorism originally referred just to statistical models, but it is now sometimes used for scientific models in general.[1]
The aphorism is generally attributed to George E. P. Box, a British statistician, although the underlying concept predates Box's writings.



George Box
The phrase "all models are wrong" was first attributed to George Box in a 1976 paper published in the Journal of the American Statistical Association. In the paper, Box uses the phrase to refer to the limitations of models, arguing that while no model is ever completely accurate, simpler models can still provide valuable insights if applied judiciously.[2] In their 1983 book on generalized linear models, Peter McCullagh and John Nelder stated that while modeling in science is a creative process, some models are better than others, even though none can claim eternal truth.[3][4] In 1996, an Applied Statistician's Creed was proposed by M.R. Nester, which incorporated the aphorism as a central tenet.[5]
Although the aphorism is most commonly associated with George Box, the underlying idea has been historically expressed by various thinkers in the past. Alfred Korzybski noted in 1933, "A map is not the territory it represents, but, if correct, it has a similar structure to the territory, which accounts for its usefulness."[6] In 1939, Walter Shewhart discussed the impossibility of constructing a model that fully characterizes a state of statistical control, noting that no model can exactly represent any specific characteristic of such a state.[7] John von Neumann, in 1947, remarked that "truth is much too complicated to allow anything but approximations.[2] In 1960, Georg Rasch noted that no models are ever true, not even Newton's laws, emphasizing that models should not be evaluated based on truth but on their applicability for a given purpose.[1]


Box used the aphorism again in 1979, where he expanded on the idea by discussing how models serve as useful approximations, despite failing to perfectly describe empirical phenomena.[8] He later reiterated this sentiment in his later works, where he discussed how models should be judged based on their utility rather than their absolute correctness.[9][7]
David Cox, in a 1995 commentary, argued that stating all models are wrong is unhelpful, as models by their nature simplify reality. He emphasized that statistical models, like other scientific models, aim to capture important aspects of systems through idealized representations.[10]
In their 2002 book on statistical model selection, Burnham and Anderson reiterated Box’s statement, noting that while models are simplifications of reality, they vary in usefulness, from highly useful to essentially useless.[11]
J. Michael Steele used the analogy of city maps to explain that models, like maps, serve practical purposes despite their limitations, emphasizing that certain models, though simplified, are not necessarily wrong.[12] In response, Andrew Gelman acknowledged Steele’s point but defended the usefulness of the aphorism, particularly in drawing attention to the inherent imperfections of models.[13]
Philosopher Peter Truran, in a 2013 essay, discussed how seemingly incompatible models can make accurate predictions by representing different aspects of the same phenomenon, illustrating the point with an example of two observers viewing a cylindrical object from different angles.[14]
In 2014, David Hand reiterated that models are meant to aid in understanding or decision-making about the real world, a point emphasized by Box’s famous remark.[15]


Anscombe's quartet – Four data sets with the same descriptive statistics, yet very different distributions
Bonini's paradox – As a model of a complex system becomes more complete, it becomes less understandable
Lie-to-children – Teaching a complex subject via simpler models
Map–territory relation – Relationship between an object and a representation of that object
Pragmatism – Philosophical tradition
Reification (fallacy) – Fallacy of treating an abstraction as if it were a real thing
Scientific modelling – Scientific activity  that produces models
Statistical model – Type of mathematical model
Statistical model validation – Evaluating whether a chosen statistical model is appropriate or not
Verisimilitude – Resemblance to reality


^ a b Skogen, M.D.; Ji, R.; Akimova, A.; Daewel, U.; and eleven others (2021), "Disclosing the truth: Are models better than observations?" (PDF), Marine Ecology Progress Series, 680: 7–13, Bibcode:2021MEPS..680....7S, doi:10.3354/meps13574, S2CID 229617529.

^ a b Box, George E. P. (1976), "Science and statistics" (PDF), Journal of the American Statistical Association, 71 (356): 791–799, doi:10.1080/01621459.1976.10480949.

^ McCullagh, P.; Nelder, J. A. (1983), Generalized Linear Models, Chapman & Hall, §1.1.4.

^ McCullagh, P.; Nelder, J. A. (1989), Generalized Linear Models (second ed.), Chapman & Hall, §1.1.4.

^ Nester, M. R. (1996), "An applied statistician's creed" (PDF), Journal of the Royal Statistical Society, Series C, 45 (4): 401–410, doi:10.2307/2986064, JSTOR 2986064.

^ Korzybski, Alfred (1933). Science and Sanity: An Introduction to Non-Aristotelian Systems and General Semantics (1st ed.). Lancaster, PA: International Non-Aristotelian Library Publishing Company / Science Press Printing Company.{{cite book}}:  CS1 maint: date and year (link)

^ a b The relatedness of Shewhart's quotation with the aphorism "all models are wrong" is noted by Fricker & Woodall (2016).

^ Box, G. E. P. (1979), "Robustness in the strategy of scientific model building", in Launer, R. L.; Wilkinson, G. N. (eds.), Robustness in Statistics, Academic Press, pp. 201–236, doi:10.1016/B978-0-12-438150-6.50018-2, ISBN 978-1-4832-6336-6

^ Box, G. E. P.; Draper, N. R. (1987), Empirical Model-Building and Response Surfaces, John Wiley & Sons.

^ Cox, D. R. (1995), "Comment on "Model uncertainty, data mining and statistical inference"", Journal of the Royal Statistical Society, Series A, 158: 455–456.

^ Burnham, K. P.; Anderson, D. R. (2002), Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2nd ed.), Springer-Verlag, §1.2.5.

^ Steele, J. M., "Models: Masterpieces and Lame Excuses".

^ Gelman, A. (12 June 2008), "Some thoughts on the saying, 'All models are wrong, but some are useful'".

^ Truran, P. (2013), "Models: Useful but Not True", Practical Applications of the Philosophy of Science, SpringerBriefs in Philosophy, Springer, pp. 61–67, doi:10.1007/978-3-319-00452-5_10, ISBN 978-3-319-00451-8.

^ Hand, D. J. (2014), "Wonderful examples, but let's not close our eyes", Statistical Science, 29: 98–100, arXiv:1405.4986, doi:10.1214/13-STS446.




Ashby, N. (2002), "Relativity and the Global Positioning System" (PDF), Physics Today, 55 (5): 41–47, Bibcode:2002PhT....55e..41A, doi:10.1063/1.1485583.
Fricker, R. D., Jr.; Woodall, W. H. (2016), "Play it again, and again, Sam", Significance, 13 (4): 46, doi:10.1111/j.1740-9713.2016.00944.x{{citation}}:  CS1 maint: multiple names: authors list (link).
Valéry, Paul (1970), Collected Works of Paul Valéry, Volume 14—Analects, translated by Stuart Gilbert, Princeton University Press.
Vankat, J. L. (2013), Vegetation Dynamics on the Mountains and Plateaus of the American Southwest, Springer.
Wolfson, M. C.; Murphy, B. B. (April 1998), "New views on inequality trends" (PDF), Monthly Labor Review: 3–23.


Anderson, C. (23 June 2008), "The end of theory", Wired
Box, G. E. P. (1999), "Statistics as a catalyst to learning by scientific method Part II—A discussion", Journal of Quality Technology, 31: 16–29, doi:10.1080/00224065.1999.11979890
Enderling, H.; Wolkenhauer, O. (2021), "Are all models wrong?", Computational and Systems Oncology, 1 (1): e1008, doi:10.1002/cso2.1008, PMC 7880041, PMID 33585835
Saltelli, A.; Funtowicz, S. (Winter 2014), "When all models are wrong", Issues in Science and Technology, 30

"All Models are Right, Most are Useless"—Andrew Gelman blog
All models are wrong—Peter Coles blog




