The Flynn effect is the substantial and long-sustained increase in both fluid and crystallized intelligence test scores that were measured in many parts of the world over the 20th century. When intelligence quotient (IQ) tests are initially standardized using a sample of test-takers, by convention the average of the test results is set to 100 and their standard deviation is set to 15 or 16 IQ points. When IQ tests are revised, they are again standardized using a new sample of test-takers, usually born more recently than the first. Again, the average result is set to 100. However, when the new test subjects take the older tests, in almost every case their average scores are significantly above 100.
Test score increases have been continuous and approximately linear from the earliest years of testing to the present. For the Raven's Progressive Matrices test, a study published in the year 2009 found that British children's average scores rose by 14 IQ points from 1942 to 2008. Similar gains have been observed in many other countries in which IQ testing has long been widely used, including other Western European countries, Japan, and South Korea.
There are numerous proposed explanations of the Flynn effect, as well as some skepticism about its implications. Similar improvements have been reported for other cognitions such as semantic and episodic memory. Research suggests that there is an ongoing reversed Flynn effect, i.e. a decline in IQ scores, in Norway, Denmark, Australia, Britain, the Netherlands, Sweden, Finland, France and German-speaking countries, a development which appears to have started in the 1990s.
Origin of termEdit
|James Flynn: Why our IQ levels are higher than our grandparents', (18:41), TED talks|
The Flynn effect is named for James R. Flynn, who did much to document it and promote awareness of its implications. The term itself was coined by Richard Herrnstein and Charles Murray, authors of The Bell Curve. Although the general term for the phenomenon—referring to no researcher in particular—continues to be "secular rise in IQ scores", many textbooks on psychology and IQ testing have now followed the lead of Herrnstein and Murray in calling the phenomenon the Flynn effect.
Rise in IQEdit
IQ tests are updated periodically. For example, the Wechsler Intelligence Scale for Children (WISC), originally developed in 1949, was updated in 1974, 1991, 2003 and again in 2014. The revised versions are standardized based on the performance of test-takers in standardization samples. A standard score of IQ 100 is defined as the median performance of the standardization sample. Thus one way to see changes in norms over time is to conduct a study in which the same test-takers take both an old and new version of the same test. Doing so confirms IQ gains over time. Some IQ tests, for example tests used for military draftees in NATO countries in Europe, report raw scores, and those also confirm a trend of rising scores over time. The average rate of increase seems to be about three IQ points per decade in the United States, as scaled by the Wechsler tests. The increasing test performance over time appears on every major test, in every age range, at every ability level, and in every modern industrialized country, although not necessarily at the same rate as in the United States. The increase was continuous and roughly linear from the earliest days of testing to the mid-1990s.[better source needed] Though the effect is most associated with IQ increases, a similar effect has been found with increases in attention and of semantic and episodic memory.
Ulric Neisser estimated that using the IQ values of 1997, the average IQ of the United States in 1932, according to the first Stanford–Binet Intelligence Scales standardization sample, was 80. Neisser states that "Hardly any of them would have scored 'very superior', but nearly one-quarter would have appeared to be 'deficient.'" He also wrote that "Test scores are certainly going up all over the world, but whether intelligence itself has risen remains controversial."
Trahan et al. (2014) found that the effect was about 2.93 points per decade, based on both Stanford–Binet and Wechsler tests; they also found no evidence the effect was diminishing. In contrast, Pietschnig and Voracek (2015) reported, in their meta-analysis of studies involving nearly 4 million participants, that the Flynn effect had decreased in recent decades. They also reported that the magnitude of the effect was different for different types of intelligence ("0.41, 0.30, 0.28, and 0.21 IQ points annually for fluid, spatial, full-scale, and crystallized IQ test performance, respectively"), and that the effect was stronger for adults than for children.
Raven (2000) found that, as Flynn suggested, data interpreted as showing a decrease in many abilities with increasing age must be re-interpreted as showing that there has been a dramatic increase of these abilities with date of birth. On many tests this occurs at all levels of ability.
Some studies have found the gains of the Flynn effect to be particularly concentrated at the lower end of the distribution. Teasdale and Owen (1989), for example, found the effect primarily reduced the number of low-end scores, resulting in an increased number of moderately high scores, with no increase in very high scores. In another study, two large samples of Spanish children were assessed with a 30-year gap. Comparison of the IQ distributions indicated that the mean IQ scores on the test had increased by 9.7 points (the Flynn effect), the gains were concentrated in the lower half of the distribution and negligible in the top half, and the gains gradually decreased as the IQ of the individuals increased. Some studies have found a reverse Flynn effect with declining scores for those with high IQ.
In 1987, Flynn took the position that the very large increase indicates that IQ tests do not measure intelligence but only a minor sort of "abstract problem-solving ability" with little practical significance. He argued that if IQ gains do reflect intelligence increases, there would have been consequent changes of our society that have not been observed (a presumed non-occurrence of a "cultural renaissance"). Flynn no longer endorses this view of intelligence and has since elaborated and refined his view of what rising IQ scores mean.
Precursors to Flynn's publicationsEdit
Earlier investigators had discovered rises in raw IQ test scores in some study populations, but had not published general investigations of that issue in particular. Historian Daniel C. Calhoun cited earlier psychology literature on IQ score trends in his book The Intelligence of a People (1973). R. L. Thorndike drew attention to rises in Stanford-Binet scores in a 1975 review of the history of intelligence testing.
There is debate about whether the rise in IQ scores also corresponds to a rise in general intelligence, or only a rise in special skills related to taking IQ tests. Because children attend school longer now and have become much more familiar with the testing of school-related material, one might expect the greatest gains to occur on such school content-related tests as vocabulary, arithmetic or general information. Just the opposite is the case: abilities such as these have experienced relatively small gains and even occasional decreases over the years. Meta-analytic findings indicate that Flynn effects occur for tests assessing both fluid and crystallized abilities. For example, Dutch conscripts gained 21 points during only 30 years, or 7 points per decade, between 1952 and 1982. But this rise in IQ test scores is not wholly explained by an increase in general intelligence. Studies have shown that while test scores have improved over time, the improvement is not fully correlated with latent factors related to intelligence. Rushton has shown that the gains in IQ over time (the Lynn-Flynn effect) are unrelated to g. Other researchers have shown that the IQ gains described by the Flynn effect are due in part to increasing intelligence, and in part to increases in test-specific skills. In parallel with the measured gains in IQ scores, secular declines have been found for "mental speed, digit span backwards, the use of difficult words, and color acuity, all of which are related to intelligence".
A 2017 survey of 75 experts in the field of intelligence research suggested four key causes of the Flynn effect: Better health, better nutrition, more and better education, and rising standards of living. Genetic changes were seen as not important. The experts' views agreed with an independently performed meta-analysis on published Flynn effect data, except that the latter found life history speed to be the most important factor.
The expert survey explained the possible end or decline in the Flynn effect by asymmetric fertility by means of genetic effects, migration, asymmetric fertility by means of socialization effects, declines in education, and the influence of media.
Schooling and test familiarityEdit
Duration of average schooling has increased steadily. One problem with this explanation is that if in the US comparing older and more recent subjects with similar educational levels, then the IQ gains appear almost undiminished in each such group considered individually.
Many studies find that children who do not attend school score drastically lower on the tests than their regularly attending peers. During the 1960s, when some Virginia counties closed their public schools to avoid racial integration, compensatory private schooling was available only for Caucasian children. On average, the scores of African-American children who received no formal education during that period decreased at a rate of about six IQ points per year.
Another explanation is an increased familiarity of the general population with tests and testing. For example, children who take the very same IQ test a second time usually gain five or six points. However, this seems to set an upper limit on the effects of test sophistication. One problem with this explanation and others related to schooling is that in the US, the groups with greater test familiarity show smaller IQ increases.
Early intervention programs have shown mixed results. Some preschool (ages 3–4) intervention programs like "Head Start" do not produce lasting changes of IQ, although they may confer other benefits.[which?] The "Abecedarian Early Intervention Project", an all-day program that provided various forms of environmental enrichment to children from infancy onward, showed IQ gains that did not diminish over time. The IQ difference between the groups, although only five points, was still present at age 12. Not all such projects have been successful. Also, such IQ gains can diminish until age 18.
Generally more stimulating environmentEdit
Still another theory is that the general environment today is much more complex and stimulating. One of the most striking 20th-century changes of the human intellectual environment has come from the increase of exposure to many types of visual media. From pictures on the wall to movies to television to video games to computers, each successive generation has been exposed to richer optical displays than the one before and may have become more adept at visual analysis. This would explain why visual tests like the Raven's have shown the greatest increases. An increase only of particular form(s) of intelligence would explain why the Flynn effect has not caused a "cultural renaissance too great to be overlooked."
In 2001, Dickens and Flynn presented a model for resolving several contradictory findings regarding IQ. They argue that the measure "heritability" includes both a direct effect of the genotype on IQ and also indirect effects such that the genotype changes the environment, thereby affecting IQ. That is, those with a greater IQ tend to seek stimulating environments that further increase IQ. These reciprocal effects result in gene environment correlation. The direct effect could initially have been very small, but feedback can create large differences of IQ. In their model, an environmental stimulus can have a very great effect on IQ, even for adults, but this effect also decays over time unless the stimulus continues (the model could be adapted to include possible factors, like nutrition during early childhood, that may cause permanent effects). The Flynn effect can be explained by a generally more stimulating environment for all people. The authors suggest that any program designed to increase IQ may produce long-term IQ gains if that program teaches children how to replicate the types of cognitively demanding experiences that produce IQ gains outside the program. To maximize lifetime IQ, the programs should also motivate them to continue searching for cognitively demanding experiences after they have left the program.
Flynn in his 2007 book What Is Intelligence? further expanded on this theory. Environmental changes resulting from modernization—such as more intellectually demanding work, greater use of technology and smaller families—have meant that a much larger proportion of people are more accustomed to manipulating abstract concepts such as hypotheses and categories than a century ago. Substantial portions of IQ tests deal with these abilities. Flynn gives, as an example, the question 'What do a dog and a rabbit have in common?' A modern respondent might say they are both mammals (an abstract, or a priori answer, which depends only on the meanings of the words dog and rabbit), whereas someone a century ago might have said that humans catch rabbits with dogs (a concrete, or a posteriori answer, which depended on what happened to be the case at that time).
Improved nutrition is another possible explanation. Today's average adult from an industrialized nation is taller than a comparable adult of a century ago. That increase of stature, likely the result of general improvements of nutrition and health, has been at a rate of more than a centimeter per decade. Available data suggest that these gains have been accompanied by analogous increases of head size, and by an increase in the average size of the brain. This argument had been thought to suffer the difficulty that groups who tend to be of smaller overall body size (e.g. women, or people of Asian ancestry) do not have lower average IQs. Richard Lynn, however, claims that while people of East Asian origin may often have smaller bodies, they tend to have larger brains and higher IQs than average whites.
A 2005 study presented data supporting the nutrition hypothesis, which predicts that gains will occur predominantly at the low end of the IQ distribution, where nutritional deprivation is probably most severe. An alternative interpretation of skewed IQ gains could be that improved education has been particularly important for this group. Richard Lynn makes the case for nutrition, arguing that cultural factors cannot typically explain the Flynn effect because its gains are observed even at infant and preschool levels, with rates of IQ test score increase about equal to those of school students and adults. Lynn states that "This rules out improvements in education, greater test sophistication, etc. and most of the other factors that have been proposed to explain the Flynn effect. He proposes that the most probable factor has been improvements in pre-natal and early post-natal nutrition."
A century ago, nutritional deficiencies may have limited body and organ functionality, including skull volume. The first two years of life is a critical time for nutrition. The consequences of malnutrition can be irreversible and may include poor cognitive development, educability, and future economic productivity. On the other hand, Flynn has pointed to 20-point gains on Dutch military (Raven's type) IQ tests between 1952, 1962, 1972, and 1982. He observes that the Dutch 18-year-olds of 1962 had a major nutritional handicap. They were either in the womb, or were recently born, during the great Dutch famine of 1944—when German troops monopolized food and 18,000 people died of starvation. Yet, concludes Flynn, "they do not show up even as a blip in the pattern of Dutch IQ gains. It is as if the famine had never occurred." It appears that the effects of diet are gradual, taking effect over decades (affecting mother as well as child) rather than a few months.
In support of the nutritional hypothesis, it is known that, in the United States, the average height before 1900 was about 10 cm (∼4 inches) shorter than it is today. Possibly related to the Flynn effect is a similar change of skull size and shape during the last 150 years. Though the idea that brain size is unrelated to race and intelligence was popularized in the 1980s, studies continue to show significant correlations. A Norwegian study found that height gains were strongly correlated with intelligence gains until the cessation of height gains in military conscript cohorts towards the end of the 1980s. Both height and skull size increases probably result from a combination of phenotypic plasticity and genetic selection over this period. With only five or six human generations in 150 years, time for natural selection has been very limited, suggesting that increased skeletal size resulting from changes in population phenotypes is more likely than recent genetic evolution.
It is well known that micronutrient deficiencies change the development of intelligence. For instance, one study has found that iodine deficiency causes a fall, on average, of 12 IQ points in China.
Scientists James Feyrer, Dimitra Politi, and David N. Weil have found in the U.S. that the proliferation of iodized salt increased IQ by 15 points in some areas. Journalist Max Nisen has stated that, with this type of salt becoming popular, that "the aggregate effect has been extremely positive."
Daley et al. (2003) found a significant Flynn effect among children in rural Kenya, and concluded that nutrition was one of the hypothesized explanations that best explained their results (the others were parental literacy and family structure).
Eppig, Fincher, and Thornhill (2009) argue that "From an energetics standpoint, a developing human will have difficulty building a brain and fighting off infectious diseases at the same time, as both are very metabolically costly tasks" and that "the Flynn effect may be caused in part by the decrease in the intensity of infectious diseases as nations develop." They suggest that improvements in gross domestic product (GDP), education, literacy, and nutrition may have an effect on IQ mainly through reducing the intensity of infectious diseases.
Eppig, Fincher, and Thornhill (2011) in a similar study instead looking at different US states found that states with a higher prevalence of infectious diseases had lower average IQ. The effect remained after controlling for the effects of wealth and educational variation.
Atheendar Venkataramani (2010) studied the effect of malaria on IQ in a sample of Mexicans. Exposure during the birth year to malaria eradication[further explanation needed] was associated with increases in IQ. It also increased the probability of employment in a skilled occupation. The author suggests that this may be one explanation for the Flynn effect and that this may be an important explanation for the link between national malaria burden and economic development. A literature review of 44 papers states that cognitive abilities and school performance were shown to be impaired in sub-groups of patients (with either cerebral malaria or uncomplicated malaria) when compared with healthy controls. Studies comparing cognitive functions before and after treatment for acute malarial illness continued to show significantly impaired school performance and cognitive abilities even after recovery. Malaria prophylaxis was shown to improve cognitive function and school performance in clinical trials when compared to placebo groups.
Heterosis, or hybrid vigor associated with historical reductions of the levels of inbreeding, has been proposed by Michael Mingroni as an alternative explanation of the Flynn effect. However, James Flynn has pointed out that even if everyone mated with a sibling in 1900, subsequent increases in heterosis would not be a sufficient explanation of the observed IQ gains.
Possible end of progressionEdit
Jon Martin Sundet and colleagues (2004) examined scores on intelligence tests given to Norwegian conscripts between the 1950s and 2002. They found that the increase of scores of general intelligence stopped after the mid-1990s and declined in numerical reasoning sub-tests.
Teasdale and Owen (2005) examined the results of IQ tests given to Danish male conscripts. Between 1959 and 1979 the gains were 3 points per decade. Between 1979 and 1989 the increase approached 2 IQ points. Between 1989 and 1998 the gain was about 1.3 points. Between 1998 and 2004 IQ declined by about the same amount as it gained between 1989 and 1998. They speculate that "a contributing factor in this recent fall could be a simultaneous decline in proportions of students entering 3-year advanced-level school programs for 16–18-year-olds." The same authors in a more comprehensive 2008 study, again on Danish male conscripts, found that there was a 1.5-point increase between 1988 and 1998, but a 1.5-point decrease between 1998 and 2003/2004. A possible contributing factor to the more recent decline may be changes in the Danish educational system. Another may be the rising proportion of immigrants or their immediate descendants in Denmark. This is supported by data on Danish draftees where first or second generation immigrants with Danish nationality score below average.
In the United Kingdom, a study by Flynn (2009) found that tests carried out in 1980 and again in 2008 show that the IQ score of an average 14-year-old dropped by more than two points over the period. For the upper half of the results the performance was even worse. Average IQ scores declined by six points. However, children aged between five and 10 saw their IQs increase by up to half a point a year over the three decades. Flynn argues that the abnormal drop in British teenage IQ could be due to youth culture having “stagnated” or even dumbed down. He also states that the youth culture is more oriented towards computer games than towards reading and holding conversations. Researcher Richard Gray, commenting on the study, also mentions the computer culture diminishing reading books as well as a tendency towards teaching to the test.
Lynn and Harvey argued in 2008 that the causes of the above are difficult to interpret since these countries had had significant recent immigration from countries with lower average national IQs. Nevertheless, they expect that similar patterns will occur, or have occurred, first in other developed nations and then in the developing world as there is a limit to how much environmental factors can improve intelligence. Furthermore, during the last century there is a negative correlation between fertility and intelligence although there is not yet any conclusive evidence of the association between the two. They estimate that there has been a dysgenic decline in the world's genotypic IQ (masked by the Flynn effect for the phenotype) of 0.86 IQ points per decade for the years 1950–2000.
Bratsberg & Rogeberg (2018) present evidence that the Flynn effect in Norway has reversed, and that both the original rise in mean IQ scores and their subsequent decline were caused by environmental factors.
IQ group differencesEdit
If the Flynn effect has ended in developed nations, then this may possibly allow national differences in IQ scores to diminish if the Flynn effect continues in nations with lower average national IQs.
Also, if the Flynn effect has ended for the majority in developed nations, it may still continue for minorities, especially for groups like immigrants where many may have received poor nutrition during early childhood or have had other disadvantages. A study in the Netherlands found that children of non-Western immigrants had improvements for g, educational achievements, and work proficiency compared to their parents, although there were still remaining differences compared to ethnic Dutch.
There is a controversy as to whether the US racial gap in IQ scores is diminishing. If that is the case then this may or may not be related to the Flynn effect. Flynn has commented that he never claimed that the Flynn effect has the same causes as the black-white gap, but that it shows that environmental factors can create IQ differences of a magnitude similar to the gap. Research that has examined whether g factor and IQ gains from the Flynn effect are related have found there is a negative correlation between the two, which may indicate that group differences and the Flynn effect are possibly due to differing causes
The Flynn effect has also been part of the discussions regarding Spearman's hypothesis, which states that differences in the g factor are the major source of differences between blacks and whites observed in many studies of race and intelligence.
- Baker, David P.; Eslinger, Paul J.; Benavides, Martin; Peters, Ellen; Dieckmann, Nathan F.; Leon, Juan (March 2015). "The cognitive impact of the education revolution: A possible cause of the Flynn Effect on population IQ". Intelligence. 49: 144–58. doi:10.1016/j.intell.2015.01.003. ISSN 0160-2896.
- Flynn, James R. (March 2009). "Requiem for nutrition as the cause of IQ gains: Raven's gains in Britain 1938–2008". Economics and Human Biology. 7 (1): 18–27. doi:10.1016/j.ehb.2009.01.009. ISSN 1873-6130. PMID 19251490.
- Rönnlund M, Nilsson LG (September 2009). "Flynn effects on sub-factors of episodic and semantic memory: parallel gains over time and the same set of determining factors". Neuropsychologia. 47 (11): 2174–80. doi:10.1016/j.neuropsychologia.2008.11.007. PMID 19056409.
- Al-Shahomee et al., 2018, "An increase of intelligence in Libya from 2008 to 2017". Personality and Individual Differences 130. doi:10.1016/j.paid.2018.04.004
- Teasdale, Thomas W; Owen, David R (2005). "A long-term rise and recent decline in intelligence test performance: The Flynn Effect in reverse". Personality and Individual Differences. 39 (4): 837–43. doi:10.1016/j.paid.2005.01.029.
- Dutton, Edward; Lynn, Richard (2013). "A negative Flynn effect in Finland, 1997–2009". Intelligence. 41 (6): 817–20. doi:10.1016/j.intell.2013.05.008.
- Pietschnig, Jakob; Gittler, Georg (2015). "A reversal of the Flynn effect for spatial perception in German-speaking countries: Evidence from a cross-temporal IRT-based meta-analysis (1977–2014)". Intelligence. 53: 145–53. doi:10.1016/j.intell.2015.10.004.
- Bratsberg, Bernt; Rogeberg, Ole (June 6, 2018). "Flynn effect and its reversal are both environmentally caused". Proceedings of the National Academy of Sciences. 115 (26): 6674–78. doi:10.1073/pnas.1718793115. ISSN 0027-8424. PMC 6042097. PMID 29891660.
- Flynn, James R. (2009). What Is Intelligence: Beyond the Flynn Effect (expanded paperback ed.). Cambridge: Cambridge University Press. pp. 1–2. ISBN 978-0-521-74147-7. Lay summary (July 18, 2010).
The 'Flynn effect' is the name that has become attached to an exciting development, namely, that the twentieth century saw massive IQ gains from one generation to another. To forestall a diagnosis of megalomania, the label was coined by Herrnstein and Murray, the authors of The Bell Curve, and not by myself.
- Fletcher, Richard B.; Hattie, John (2011). Intelligence and Intelligence Testing. Taylor & Francis. p. 26. ISBN 978-1-136-82321-3. Retrieved August 31, 2013. Lay summary (September 15, 2013).
Indeed, this effect, now called the 'Flynn effect', is well established. Nations, almost without exception, have shown gains of about 20 IQ points per generation (30 years). These gains are highest for IQ tests that are most related to reasoning and the capacity to figure out novel problems (this is often called 'fluid intelligence', see Chapter 5); and least related to knowledge, which arises from better educational opportunity, a history of persistence and good motivation for learning (this is often called 'crystallised intelligence', see Chapter 5).Freeman, Joan (2010). Gifted Lives: What Happens when Gifted Children Grow Up. London: Routledge. pp. 290–91. ISBN 978-0-415-47009-4. Lay summary (May 16, 2013).
A strange new phenomenon has been growing since about 1950, called the 'Flynn Effect' after Professor James Flynn of the University of Otago, New Zealand. In his book What is Intelligence ?, Flynn describes a year-on-year rise in measured intelligence, about three IQ points a decade.Urbina, Susana (2004). Essentials of Psychological Testing. John Wiley & Sons. p. 103. ISBN 978-0-471-41978-5. Lay summary (October 10, 2013).
A puzzling longitudinal trend in the opposite direction, known as the 'Flynn effect', has been well documented in successive revisions of major intelligence tests (like the S-B and the Wechsler scales) that invariably involve the administration of both the old and new versions to a segment of the newer standardization sample, for comparative purposes. Data from revisions of various intelligence tests in the United States as well as in other countries—extensively analyzed by J.R. Flynn (1984, 1987)—show a pronounced, longterm upward trend in the level of performance required to obtain any given IQ score. The Flynn effect presumably reflects population gains over time in the kinds of cognitive performance that intelligence tests sample.Wasserman, John D. (2012). "Chapter 18: Assessment of Intellectual Functioning". In Weiner, Irving B.; Graham, John R.; Naglieri, Jack A. (eds.). Handbook of Psychology. Volume 10: Assessment Psychology. John Wiley & Sons. p. 486. ISBN 978-0-470-89127-8. Retrieved November 25, 2013.
Both definitions also specify that the intellectual functioning criterion for a diagnosis of intellectual disability is approximately 2 SDs or more below the normative mean, but factors such as test score statistical error (standard error of measurement), test fairness, normative expectations for the population of interest, the Flynn effect, and practice effects from previous testing need to be considered before arriving at any diagnosis.Chamorro-Premuzic, Tomas (June 13, 2011). Personality and Individual Differences. Wiley. p. 221. ISBN 978-1-4051-9927-8. Retrieved June 15, 2014.
Flynn effect The finding by sociologist James Flynn that there are generational increases in IQ across nations.
- Neisser U (1997). "Rising Scores on Intelligence Tests". American Scientist. 85 (5): 440–47. Bibcode:1997AmSci..85..440N. Archived from the original on November 4, 2016.CS1 maint: BOT: original-url status unknown (link)
- Trahan, LH; Stuebing, KK; Fletcher, JM; Hiscock, M (September 2014). "The Flynn effect: a meta-analysis". Psychological Bulletin. 140 (5): 1332–60. doi:10.1037/a0037173. PMC 4152423. PMID 24979188.
- Jakob Pietschnig; Martin Voracek (May 1, 2015). "One Century of Global IQ Gains: A Formal Meta-Analysis of the Flynn Effect (1909–2013)". Perspectives on Psychological Science. 10 (3): 282–306. doi:10.1177/1745691615577701. ISSN 1745-6916. PMID 25987509.
- Raven John (2000). "The Raven's Progressive Matrices: Change and Stability over Culture and Time" (PDF). Cognitive Psychology. 41 (1): 1–48. Bibcode:1992CogPs..24..535V. doi:10.1006/cogp.1999.0735. PMID 10945921.
- Teasdale, T. (1989). "Continuing secular increases in intelligence and a stable prevalence of high intelligence levels". Intelligence. 13 (3): 255–62. doi:10.1016/0160-2896(89)90021-4.
- Colom, R.; Lluis-Font, J.M. & Andrés-Pueyo, A. (2005). "The generational intelligence gains are caused by decreasing variance in the lower half of the distribution: Supporting evidence for the nutrition hypothesis" (PDF). Intelligence. 33 (1): 83–91. doi:10.1016/j.intell.2004.07.010.
- Dutton Edward; Lynn Richard (2013). "A negative Flynn effect in Finland, 1997–2009". Intelligence. 41 (6): 817–20. doi:10.1016/j.intell.2013.05.008.
- Tucker, Ian (September 22, 2012). "James Flynn: IQ may go up as well as down". The Guardian. ISSN 0261-3077. Retrieved January 21, 2019.
- Calhoun, Daniel (1973). The Intelligence of a People. Princeton University Press. ISBN 978-0-691-04619-8. Lay summary (October 6, 2013).
- Thorndike, R.L. (1975). "Mr. Binet's Test 70 Years Later". Educational Researcher. 4 (5): 3–7. doi:10.3102/0013189X004005003. ISSN 0013-189X. JSTOR 1174855.
- Must O, Must A, Raudik V (2003). "The secular rise in IQs: In Estonia, the Flynn effect is not a Jensen effect" (PDF). Intelligence. 31 (5): 461–71. doi:10.1016/S0160-2896(03)00013-8.
- Rushton, J.P. (1999). "Secular Gains in IQ Not Related to the g Factor and Inbreeding Depression – Unlike Black-White Differences: A Reply to Flynn" (PDF). Personality and Individual Differences. 26 (2): 381–89. doi:10.1016/S0191-8869(98)00148-2. Archived from the original (PDF) on May 16, 2006.
- Rushton, J.P.; Jensen, A. (2010). "The rise and fall of the Flynn effect as a reason to expect a narrowing of the Black–White IQ gap". Intelligence. 38 (2): 213–19. doi:10.1016/j.intell.2009.12.002.
- Wicherts, J.M.; Dolan, C.V.; Hessen, D.J.; Oosterveld, P.; Baal, G.C.M. van; Boomsma, D.I. & Span, M.M. (2004). "Are intelligence tests measurement invariant over time? Investigating the nature of the Flynn effect" (PDF). Intelligence. 32 (5): 509537. CiteSeerX 10.1.1.207.4350. doi:10.1016/j.intell.2004.07.002. Archived from the original (PDF) on May 29, 2005.
The overall conclusion of the present paper is that factorial invariance with respect to cohorts is not tenable . . . . The fact that the gains cannot be explained solely by increases at the level of the latent variables (common factors), which IQ tests purport to measure, should not sit well with explanations that appeal solely to changes at the level of the latent variables.
- Te Nijenhuis J, De Jong MJ, Evers A, Van Der Flier H (2004). "Are cognitive differences between immigrant and majority groups diminishing?". European Journal of Personality. 18 (5): 405–34. doi:10.1002/per.511.
- Colom R, Garcia-Lopez O (2003). "Secular Gains in Fluid Intelligence: Evidence from the Culture-Fair Intelligence Test". Journal of Biosocial Science. 35 (1): 33–39. doi:10.1017/S0021932003000336. PMID 12537154.
- Rindermann et al., 2017
- Rindermann, et al., 2017
- According to Rinderman et al., chapter 4
- Pietschnig and Voracek, 2015.
- Plomin R.; DeFries J.C.; Craig I.W.; McGuffin P. (2003). Behavioral genetics in the postgenomic era (4th ed.).
- David F Marks (2010). "IQ variations across time, race, and nationality:an artifact of differences in literacy skills". Psychological Reports. 106 (3): 643–64. doi:10.2466/pr0.106.3.643-664. PMID 20712152.
- Dickens WT, Flynn JR (2001). "Heritability estimates versus large environmental effects: The IQ paradox resolved" (PDF). Psychological Review. 108 (2): 346–369. CiteSeerX 10.1.1.139.2436. doi:10.1037/0033-295X.108.2.346. PMID 11381833.
- Dickens WT, Flynn JR (2002). "The IQ Paradox: Still Resolved" (PDF). Psychological Review. 109 (4): 764–71. doi:10.1037/0033-295x.109.4.764. Archived from the original (PDF) on March 19, 2007.
- Jantz, R.; Meadows Jantz, L. (2000). "Secular change in craniofacial morphology". American Journal of Human Biology. 12 (3): 327–38. doi:10.1002/(SICI)1520-6300(200005/06)12:3<327::AID-AJHB3>3.0.CO;2-1. PMID 11534023.
- Lynn, Richard (2006). Race Differences in Intelligence. An Evolutionary Analysis. Washington Summit Publishers, Augusta, GA.
- Lynn, Richard (January – February 2009). "What has caused the Flynn effect? Secular increases in the Development Quotients of infants". Intelligence. 37 (1): 16–24. doi:10.1016/j.intell.2008.07.008.
- "The Lancet Series on Maternal and Child Undernutrition". 2008.
- C. Banning (1946). "Food Shortage and Public Health, First Half of 1945". Annals of the American Academy of Political and Social Science Vol. 245, The Netherlands during German Occupation (May 1946), pp. 93–110
- Flynn J.R. (1987). "Massive IQ gains in 14 nations: What IQ tests really measure". Psychological Bulletin. 101 (2): 171–91. doi:10.1037/0033-2909.101.2.171.
- Flynn, James R. (2009). What Is Intelligence? (p. 103). Cambridge University Press. Kindle Edition.
- Samaras, Thomas T.; Elrick, Harold (May 2002). "Group Height, body size, and longevity: is smaller better for the human body?". West J Med. 176 (3): 206–08. doi:10.1136/ewjm.176.3.206. PMC 1071721. PMID 12016250.
- Sundet, J.; Barlaug, D.; Torjussen, T. (2004). "The end of the Flynn effect?: A study of secular trends in mean intelligence test scores of Norwegian conscripts during half a century". Intelligence. 32 (4): 349–62. doi:10.1016/j.intell.2004.06.004.
- Jantz RL, Meadows Jantz L (May 2000). "Secular change in craniofacial morphology". Am. J. Hum. Biol. 12 (3): 327–38. doi:10.1002/(SICI)1520-6300(200005/06)12:3<327::AID-AJHB3>3.0.CO;2-1. PMID 11534023.
Jantz RL (July 2001). "Cranial change in Americans: 1850–1975". J. Forensic Sci. 46 (4): 784–87. PMID 11451056.
- Qian M; Wang D; Watkins WE; et al. (2005). "The effects of iodine on intelligence in children: a meta-analysis of studies conducted in China". Asia Pacific Journal of Clinical Nutrition. 14 (1): 32–42. PMID 15734706.
- "How Adding Iodine To Salt Resulted In A Decade's Worth Of IQ Gains For The United States", By Max Nisen, July 23, 2013 Business Insider
- Daley, TC; Whaley, SE; Sigman, MD; Espinosa, MP; Neumann, C (May 2003). "IQ on the rise: the Flynn effect in rural Kenyan children". Psychological Science. 14 (3): 215–19. doi:10.1111/1467-9280.02434. PMID 12741743.
- Eppig C, Fincher CL, Thornhill R (December 2010). "Parasite prevalence and the worldwide distribution of cognitive ability". Proc. Biol. Sci. 277 (1701): 3801–08. doi:10.1098/rspb.2010.0973. PMC 2992705. PMID 20591860.
- Eppig, C.; Fincher, C.L.; Thornhill, R. (2011). "Parasite prevalence and the distribution of intelligence among the states of the USA". Intelligence. 39 (2–3): 155–60. doi:10.1016/j.intell.2011.02.008.
- Venkataramani, Atheendar (September 18, 2010). "Early Life Exposure to Malaria and Cognition and Skills in Adulthood: Evidence from Mexico". SSRN 1679164.
- Fernando SD, Rodrigo C, Rajapakse S (2010). "The 'hidden' burden of malaria: cognitive impairment following infection". Malar. J. 9 (1): 366. doi:10.1186/1475-2875-9-366. PMC 3018393. PMID 21171998.
- Mackintosh, N.J. (2011). IQ and Human Intelligence. Oxford: Oxford University Press, p. 291.
- Teasdale TW, Owen DR (2005). "A long-term rise and recent decline in intelligence test performance: The Flynn Effect in reverse". Personality and Individual Differences. 39 (4): 837–43. doi:10.1016/j.paid.2005.01.029.
- Teasdale TW, Owen DR (2008). "Secular declines in cognitive test scores: A reversal of the Flynn Effect" (PDF). Intelligence. 36 (2): 121–26. doi:10.1016/j.intell.2007.01.007.
- Cotton, S.M.; Kiely, P.M.; Crewther, D.P.; Thomson, B.; Laycock, R.; Crewther, S.G. (2005). "A normative and reliability study for the Raven's Colored Progressive Matrices for primary school aged children in Australia". Personality and Individual Differences. 39 (3): 647–60. doi:10.1016/j.paid.2005.02.015.
- Gray, Richard (February 7, 2009). "British teenagers have lower IQs than their counterparts did 30 years ago". The Telegraph. London.
- Flynn, J.R. (2009). "Requiem for nutrition as the cause of IQ gains: Raven's gains in Britain 1938–2008". Economics & Human Biology. 7 (1): 18–27. doi:10.1016/j.ehb.2009.01.009. PMID 19251490.
- Lynn, Richard; Harvey, John (March 2008). "The decline of the world's IQ". Intelligence. 36 (2): 112–20. doi:10.1016/j.intell.2007.03.004. ISSN 0160-2896.
- Flynn, J.R. (2010). "The spectacles through which I see the race and IQ debate". Intelligence. 38 (4): 363–66. doi:10.1016/j.intell.2010.05.001.
- Nijenhuis, J.; van der Flierb, H. (2013). "Is the Flynn effect on g?: A meta-analysis". Intelligence. 41 (6): 802–07. doi:10.1016/j.intell.2013.03.001.
- Flynn, J.R. (1999). "Searching for justice: the discovery of IQ gains over time" (PDF). American Psychologist. 54: 5–9. doi:10.1037/0003-066X.54.1.5.
- Flynn, James R. (1984). "The Mean IQ of Americans: Massive Gains 1932 to 1978" (PDF). Psychological Bulletin. 95: 29–51. doi:10.1037/0033-2909.95.1.29. Retrieved May 16, 2013.
- Flynn, James R. (March 1987). "Massive IQ Gains in 14 Nations: What IQ Tests Really Measure" (PDF). Psychological Bulletin. 101 (2): 171–91. doi:10.1037/0033-2909.101.2.171. Retrieved May 13, 2013.
- Flynn, James R. (1998). "IQ Gains over Time: Toward Finding the Causes". In Neisser, Ulric (ed.). The Rising Curve: Long-Term Gains in IQ and Related Measures. Washington, DC: American Psychological Association. pp. 25–66. ISBN 978-1-55798-503-3.
- Flynn, James R. (2009). What Is Intelligence: Beyond the Flynn Effect (expanded paperback ed.). Cambridge: Cambridge University Press. ISBN 978-0-521-74147-7. Lay summary (July 18, 2010).
- Flynn, James R. (2012). Are We Getting Smarter? Rising IQ in the Twenty-First Century. Cambridge: Cambridge University Press. ISBN 978-1-107-60917-4. Lay summary (May 16, 2013).
- Neisser, Ulric, ed. (1998). The Rising Curve: Long-Term Gains in IQ and Related Measures. APA Science Volume Series. Washington (DC): American Psychological Association. ISBN 978-1-55798-503-3. Lay summary (May 16, 2013).
- Tuddenham, Read D. (1948), "Soldier intelligence in World Wars I and II", American Psychologist, 3 (2): 54–56, doi:10.1037/h0054962, PMID 18911933
- Edward Dutton; Dimitri van der Linden; Richard Lynn (2016). "The negative Flynn Effect: A systematic literature review". Intelligence. 59: 163–69. doi:10.1016/j.intell.2016.10.002.
- "TED Speaker: James Flynn: Why our IQ levels are higher than our grandparents'". TED.com. Retrieved November 13, 2017.
- Beyond the Flynn Effect a 2006 lecture by James R. Flynn at the University of Cambridge
- The Flynn Effect by Indiana University.
- Marguerite Holloway, Flynn's effect, Scientific American, January 1999; online edition
- "Heritability Estimates Versus Large Environmental Effects: The IQ Paradox Resolved" – a 2001 article by Dickens and Flynn
- "Dome Improvement" (Wired article)
- Malcolm Gladwell from the New Yorker on race, I.Q., and the Flynn effect
- Increasing intelligence: the Flynn effect