Hockey stick controversy
In the hockey stick controversy, the data and methods used in reconstructions of the temperature record of the past 1000 years have been disputed. Reconstructions have consistently shown that the rise in the instrumental temperature record of the past 150 years is not matched in earlier centuries, and the name "hockey stick graph" was coined for figures showing a long-term decline followed by an abrupt rise in temperatures. These graphs were publicised to explain the scientific findings of climatology, and in addition to scientific debate over the reconstructions, they have been the topic of political dispute. The issue is part of the global warming controversy and has been one focus of political responses to reports by the Intergovernmental Panel on Climate Change (IPCC). Arguments over the reconstructions have been taken up by fossil fuel industry–funded lobbying groups attempting to cast doubt on climate science.
The use of proxy indicators to get quantitative estimates of the temperature record of past centuries was developed from the 1990s onwards, and found indications that recent warming was exceptional. The Bradley & Jones 1993 reconstruction introduced the "Composite Plus Scaling" (CPS) method used by most later large-scale reconstructions, and its findings were disputed by Patrick Michaels at the United States House Committee on Science.
In 1998, Michael E. Mann, Raymond S. Bradley and Malcolm K. Hughes developed new statistical techniques to produce Mann, Bradley & Hughes 1998 (MBH98), the first eigenvector-based climate field reconstruction (CFR). This showed global patterns of annual surface temperature, and included a graph of average hemispheric temperatures back to 1400. In Mann, Bradley & Hughes 1999 (MBH99) the methodology was extended back to 1000. The term hockey stick was coined by the climatologist Jerry D. Mahlman, to describe the pattern this showed, envisaging a graph that is relatively flat to 1900 as forming an ice hockey stick's "shaft", followed by a sharp increase corresponding to the "blade". A version of this graph was featured prominently in the 2001 IPCC Third Assessment Report (TAR), along with four other reconstructions supporting the same conclusion. The graph was publicised, and became a focus of dispute for those opposed to the strengthening scientific consensus that late 20th-century warmth was exceptional.
Those disputing the graph included Pat Michaels, the George C. Marshall Institute and Fred Singer. A paper by Willie Soon and Sallie Baliunas claiming greater medieval warmth was used by the Bush administration chief of staff Philip Cooney to justify altering the first Environmental Protection Agency Report on the Environment. The paper was quickly dismissed by scientists in the Soon and Baliunas controversy, but on July 28, Republican Jim Inhofe spoke in the Senate citing it to claim "that man-made global warming is the greatest hoax ever perpetrated on the American people".
Later in 2003, a paper by Steve McIntyre and Ross McKitrick disputing the data used in MBH98 paper was publicised by the George C. Marshall Institute and the Competitive Enterprise Institute. In 2004, Hans von Storch published criticism of the statistical techniques as tending to underplay variations in earlier parts of the graph, though this was disputed and he later accepted that the effect was very small. In 2005, McIntyre and McKitrick published criticisms of the principal component analysis methodology as used in MBH98 and MBH99. The analysis therein was subsequently disputed by published papers, including Huybers 2005 and Wahl & Ammann 2007, which pointed to errors in the McIntyre and McKitrick methodology. In June 2005, Rep. Joe Barton launched what Sherwood Boehlert, chairman of the House Science Committee, called a "misguided and illegitimate investigation" into the data, methods and personal information of Mann, Bradley and Hughes. At Boehlert's request, a panel of scientists convened by the National Research Council was set up, which reported in 2006, supporting Mann's findings with some qualifications, including agreeing that there were some statistical failings but these had little effect on the result. Barton and U.S. Rep. Ed Whitfield requested Edward Wegman to set up a team of statisticians to investigate, and they supported McIntyre and McKitrick's view that there were statistical failings, although they did not quantify whether there was any significant effect. They also produced an extensive network analysis which has been discredited by expert opinion and found to have issues of plagiarism. Arguments against the MBH studies were reintroduced as part of the Climatic Research Unit email controversy, but dismissed by eight independent investigations.
More than two dozen reconstructions, using various statistical methods and combinations of proxy records, have supported the broad consensus shown in the original 1998 hockey-stick graph, with variations in how flat the pre-20th century "shaft" appears. The 2007 IPCC Fourth Assessment Report cited 14 reconstructions, 10 of which covered 1,000 years or longer, to support its strengthened conclusion that it was likely that Northern Hemisphere temperatures during the 20th century were the highest in at least the past 1,300 years. Over a dozen subsequent reconstructions, including Mann et al. 2008 and PAGES 2k Consortium 2013, have supported these general conclusions.
- 1 Background
- 2 Climate field reconstruction (CFR) methods; MBH 1998 and 1999
- 2.1 Mann, Bradley and Hughes 1998
- 2.2 Jones et al. 1998
- 2.3 Mann, Bradley and Hughes 1999
- 2.4 IPCC Third Assessment Report, 2001
- 3 Controversy after IPCC Third Assessment Report
- 3.1 IPCC graph enters political controversy
- 3.2 Soon & Baliunas and Inhofe's hoax accusation
- 3.3 McIntyre and McKitrick 2003
- 3.4 von Storch and Zorita 2004
- 3.5 Reconstructions, Inhofe and State of Fear
- 3.6 McIntyre and McKitrick 2005
- 4 Congressional investigations
- 5 National Research Council Report
- 6 Committee on Energy and Commerce Report (Wegman Report)
- 7 IPCC Fourth Assessment Report, 2007
- 8 Further reconstructions
- 9 Climatic Research Unit email controversy
- 10 Continuing research
- 11 See also
- 12 Notes
- 13 References in chronological sequence
Paleoclimatology dates back to the 19th century, and the concept of examining varves in lake beds and tree rings to track local climatic changes was suggested in the 1930s. In the 1960s, Hubert Lamb generalised from historical documents and temperature records of central England to propose a Medieval Warm Period from around 900 to 1300, followed by Little Ice Age. This was the basis of a "schematic diagram" featured in the IPCC First Assessment Report of 1990 beside cautions that the medieval warming might not have been global. Early quantitative reconstructions were published in the 1980s.
Publicity over the concerns of scientists about the implications of global warming led to increasing public and political interest, and the Reagan administration, concerned in part about the political impact of scientific findings, successfully lobbied for the 1988 formation of the Intergovernmental Panel on Climate Change to produce reports subject to detailed approval by government delegates. The IPCC First Assessment Report in 1990 noted evidence that Holocene climatic optimum around 5,000-6,000 years ago had been warmer than the present (at least in summer) and that in some areas there had been exceptional warmth during "a shorter Medieval Warm Period (which may not have been global)" about AD 950-1250, followed by a cooler period of the Little Ice Age which ended only in the middle to late nineteenth century. The report discussed the difficulties with proxy data, "mainly pollen remains, lake varves and ocean sediments, insect and animal remains, glacier termini" but considered tree ring data was "not yet sufficiently easy to assess nor sufficiently integrated with indications from other data to be used in this report". A "schematic diagram" of global temperature variations over the last thousand years has been traced to a graph based loosely on Lamb's 1965 paper, nominally representing central England, modified by Lamb in 1982. Mike Hulme describes this schematic diagram as "Lamb's sketch on the back of an envelope", a "rather dodgy bit of hand-waving".
Archives of climate proxies were developed: in 1993 Raymond S. Bradley and Phil Jones composited historical records, tree rings and ice cores for the Northern Hemisphere from 1400 up to the 1970s to produce a decadal reconstruction. Like later reconstructions including the MBH "hockey stick" studies, their reconstruction indicated a slow cooling trend followed by an exceptional temperature rise in the 20th century. This paper introduced the "Composite Plus Scaling" (CPS) method which was subsequently used by most large-scale climate reconstructions of hemispheric or global average temperatures. This decadal summer temperature reconstruction, together with a separate curve plotting instrumental thermometer data from the 1850s onwards, was featured as Figure 3.20 in the IPCC Second Assessment Report (SAR) of 1996. It stated that, in this record, warming since the late 19th century was unprecedented. The section proposed that "The data from the last 1000 years are the most useful for determining the scales of natural climate variability". Recent studies including the 1994 reconstruction by Hughes and Diaz questioned how widespread the Medieval Warm Period had been at any one time, thus it was not possible "to conclude that global temperatures in the Medieval Warm Period were comparable to the warm decades of the late 20th century." The SAR concluded, "it appears that the 20th century has been at least as warm as any century since at least 1400 AD. In at least some areas, the recent period appears to be warmer than has been the case for a thousand or more years".
Tim Barnett of the Scripps Institution of Oceanography was working towards the next IPCC assessment with Phil Jones, and in 1996 told journalist Fred Pearce: "What we hope is that the current patterns of temperature change prove distinctive, quite different from the patterns of natural variability in the past". Dendroclimatologist Keith Briffa's February 1998 study reporting a divergence problem affecting some tree ring proxies after 1960 warned that this problem had to be taken into account to avoid overestimating past temperatures.
While the details of the science were being worked out, the international community had been steadily working towards a global framework for a cap on greenhouse-gas emissions. The UN Conference on Environment and Development was held in Rio de Janeiro in 1992, and produced a treaty framework that called for voluntary capping of emissions at 1990 levels. Government representatives gathered in Kyoto later during 1998 and turned this framework into a binding commitment known as the Kyoto protocol. Due to the nature of the treaty, it essentially required commitment from the United States and other highly industrial nations for proper implementation. By 1998, the Clinton Administration had signed the treaty, but vigorous lobbying meant ratification of the treaty was successfully opposed in the Senate by a bipartisan coalition of economic and energy interests. Lobbyists such as the Western Fuels Association funded scientists whose work might undermine the scientific basis of the treaty, and in 1998 it was revealed that the American Petroleum Institute had hosted informal discussions between individuals from oil companies, trade associations and conservative policy research organizations who opposed the treaty, and who had tentatively proposed an extensive plan to recruit and train scientists in media relations. A media-relations budget of $600,000 was proposed to persuade science writers and editors and television correspondents to question and undermine climate science.
Controversy over Bradley and Jones 1993
At a hearing of the United States House Committee on Science on 6 March 1996, Chairman Robert Smith Walker questioned witnesses Robert Watson of the White House Office of Science and Technology and Michael MacCracken, head of the U.S. Global Change Research Program, over the scientific consensus shown by the IPCC report and about the peer reviewed status of the papers it cited.
As reported by Pat Michaels on his World Climate Report website, MacCracken said during the hearing that "the last decade is the warmest since 1400", implying that the warming had been caused by the greenhouse effect, and replied to Walker's question about whether thermometers had then existed by explaining the use of biological materials as temperature proxies. Michaels showed a version of the graph based on Bradley & Jones 1993 with the instrumental temperature record curve removed, and argued on the basis of the "raw data" that the large rise in temperatures occurred in the 1920s, "before the greenhouse effect had changed very much", and "there’s actually been a decline since then". He said the Science Committee had been told of this, and of comments by one IPCC reviewer that this was misleading and the text should say "Composite indicators of summer temperature show that a rapid rise occurred around 1920, this rise was prior to the major greenhouse emissions. Since then, composite temperatures have dropped slightly on a decadal scale." Michaels said that the IPCC had not noted this in the agreed text, "instead leaving most readers with the impression that the trees of the Northern Hemisphere had changed their growth rates in response to man’s impact on the atmosphere." He questioned the consensus, as only one reviewer out of 2,500 scientists had noticed this problem.
Climate field reconstruction (CFR) methods; MBH 1998 and 1999
Variations on the "Composite Plus Scale" (CPS) method continued to be used to produce hemispheric or global mean temperature reconstructions. From 1998, this was complemented by Climate Field Reconstruction (CFR) methods, which could show how climate patterns had developed over large spatial areas, making the reconstruction useful for investigating natural variability and long-term oscillations as well as for comparisons with patterns produced by climate models. The CFR method made more use of climate information embedded in remote proxies, but was more dependent than CPS on assumptions that relationships between proxy indicators and large-scale climate patterns remained stable over time. Related rigorous statistical methods had already been developed for tree ring data to produce regional reconstructions of temperatures, and other aspects such as rainfall.
As part of his doctoral research, Michael E. Mann worked with seismologist Jeffrey Park on the development of statistical techniques for finding long-term oscillations of natural variability in the instrumental temperature record of global surface temperatures over the last 140 years; Mann & Park 1993 showed patterns relating to the El Niño–Southern Oscillation, and Mann & Park 1994 found what was later termed the Atlantic multidecadal oscillation. They then teamed up with Raymond S. Bradley to use these techniques on the dataset from his Bradley & Jones 1993 study with the aim of finding long-term oscillations of natural variability in global climate. The resulting reconstruction went back to 1400, and was published in November as Mann, Park & Bradley 1995. They were able to detect that the multiple proxies were varying in a coherent oscillatory way, indicating both the multidecadal pattern in the North Atlantic and a longer-term oscillation of roughly 250 years in the surrounding region. Their study did not calibrate these proxy patterns against a quantitative temperature scale, and a new statistical approach was needed to find how they related to surface temperatures to reconstruct past temperature patterns.
Mann, Bradley and Hughes 1998
For his postdoctoral research, Mann joined Bradley and tree ring specialist Malcolm K. Hughes to develop a new statistical approach to reconstruct underlying spatial patterns of temperature variation combining diverse datasets of proxy information covering different periods across the globe, including a rich resource of tree ring networks for some areas and sparser proxies such as lake sediments, ice cores and corals, as well as some historical records. Their global reconstruction was a major breakthrough in evaluation of past climate dynamics, and the first eigenvector-based climate field reconstruction (CFR) incorporating multiple climate proxy data sets of different types and lengths into a high-resolution global reconstruction. To relate this data to measured temperatures, they used principal component analysis (PCA) to find the leading patterns, or principal components, of instrumental temperature records during the calibration period from 1902 to 1980. Their method was based on separate multiple regressions between each proxy record (or summary) and all of the leading principal components of the instrumental record. The least squares simultaneous solution of these multiple regressions used covariance between the proxy records. The results were then used to reconstruct large-scale patterns over time in the spatial field of interest (defined as the empirical orthogonal functions, or EOFs) using both local relationships of the proxies to climate and distant climate teleconnections. Temperature records for almost 50 years prior to 1902 were analysed using PCA for the important step of validation calculations, which showed that the reconstructions were statistically meaningful, or skillful.
A balance was required over the whole globe, but most of the proxy data came from tree rings in the Northern mid latitudes, largely in dense proxy networks. Since using all of the large numbers of tree ring records would have overwhelmed the sparse proxies from the polar regions and the tropics, they used principal component analysis (PCA) to produce PC summaries representing these large datasets, and then treated each summary as a proxy record in their CFR analysis. Networks represented in this way included the North American tree ring network (NOAMER) and Eurasia.
The primary aim of CFR methods was to provide the spatially resolved reconstructions essential for coherent geophysical understanding of how parts of the climate system varied and responded to radiative forcing, so hemispheric averages were a secondary product. The CFR method could also be used to reconstruct Northern Hemisphere mean temperatures, and the results closely resembled the earlier CPS reconstructions including Bradley & Jones 1993. Mann describes this as the least scientifically interesting thing they could do with the rich spatial patterns, but also the aspect that got the most attention. Their original draft ended in 1980 as most reconstructions only went that far, but an anonymous peer reviewer of the paper suggested that the curve of instrumental temperature records should be shown up to the present to include the considerable warming that had taken place between 1980 and 1998.
The Mann, Bradley & Hughes 1998 (MBH98) multiproxy study on "Global-scale temperature patterns and climate forcing over the past six centuries" was submitted to the journal Nature on 9 May 1997, accepted on 27 February 1998 and published on 23 April 1998. The paper announced a new statistical approach to find patterns of climate change in both time and global distribution, building on previous multiproxy reconstructions. The authors concluded that "Northern Hemisphere mean annual temperatures for three of the past eight years are warmer than any other year since (at least) AD1400", and estimated empirically that greenhouse gases had become the dominant climate forcing during the 20th century. In a review in the same issue, Gabriele C. Hegerl described their method as "quite original and promising", which could help to verify model estimates of natural climate fluctuations and was "an important step towards reconstructing space–time records of historical temperature patterns".
Publicity on publication of MBH98
Release of the paper on 22 April 1998 was given exceptional media coverage, possibly due to the chance that this happened to be Earth Day and it was the warmest year on record. There was an immediate media response to the press release, and the story featured in major newspapers including the New York Times, USA Today and the Boston Globe. Later reports appeared in Time, U.S. News & World Report and Rolling Stone. On one afternoon, Mann was interviewed by CNN, CBS and NBC. In the CBS interview, John Roberts repeatedly asked him if the study proved that humans were responsible for global warming, to which he would go no further than that it was "highly suggestive" of that inference.
The New York Times highlighted their finding that the 20th century had been the warmest century in 600 years, quoting Mann saying that "Our conclusion was that the warming of the past few decades appears to be closely tied to emission of greenhouse gases by humans and not any of the natural factors". Most proxy data are inherently imprecise, and Mann said: "We do have error bars. They are somewhat sizable as one gets farther back in time, and there is reasonable uncertainty in any given year. There is quite a bit of work to be done in reducing these uncertainties." Climatologist Tom Wigley had high regard for the progress the study made, but doubted if proxy data could ever be wholly convincing in detecting the human contribution to changing climate.
Phil Jones of the UEA Climatic Research Unit told the New York Times he was doubtful about adding the 150-year thermometer record to extend the proxy reconstruction, and compared this with putting together apples and oranges; Mann et al. said they used a comparison with the thermometer record to check that recent proxy data were valid. Jones thought the study would provide important comparisons with the findings of climate modeling, which showed a "pretty reasonable" fit to proxy evidence. A commentary on MBH98 by Jones was published in Science on 24 April 1998. He noted that it used almost all the available long-term proxy climate series, "and if the new multivariate method of relating these series to the instrumental data is as good as the paper claims, it should be statistically reliable." He discussed some of the difficulties, and emphasised that "Each paleoclimatic discipline has to come to terms with its own limitations and must unreservedly admit to problems, warts and all."
Controversy over MBH 1998
On 11 May, contrarian Pat Michaels objected to press headlines such as "Proof of Greenhouse Warming" and "1990s Warmest Since 1400" in a feature he titled "Science Pundits Miss Big Picture Again" published on his Western Fuels Association funded World Climate Report website. He asserted that "almost all of the warming described in the article took place before 1935–long before major changes to the greenhouse effect–and the scientific methodology guarantees that the early 1990s should appear as the warmest years", citing the papers by Jones to support his view that all of the warming took place between 1920 and 1935: "In other words, if this is the human signal, it ended 63 years ago." He referred to his earlier pieces making the same complaint about the Bradley & Jones 1993 study featured in the Second Assessment Report, and about Overpeck et al. 1997.
The George C. Marshall Institute alleged in June 1998 that MBH98 was deceptive in only going back to 1400: "Go back just a few hundred years more to the period 1000–1200 AD and you find that the climate was considerably warmer than now. This era is known as the Medieval Warm Period." It said that "by 1300 it began to cool, and by 1400 we were well into the Little Ice Age. It is no surprise that temperatures in 1997 were warmer than they were in the Little Ice Age", and so if "1997 had been compared with the years around 1000 AD, 1997 would have looked like a rather cool year" rather than being the warmest on record. It said that the Medieval Warm Period predated industrial greenhouse gas emissions, and had a natural origin.
In August, criticisms by Willie Soon and Sallie Baliunas were published by Michaels on his World Climate Report website. They took issue with tree ring reconstructions by Briffa et al. 1998 and Jones 1998 as well as with MBH98, discussing the tree ring divergence problem as well as arguing that warming had ended early in the 20th century before CO
2 increases and so was natural. They reiterated the suggestion that MBH98 only went back to 1400 to avoid showing the Medieval Warm Period, and implied that it too suffered from the tree ring divergence problem which actually affected a different reconstruction and not MBH98. Michaels subsequently gave Mann the opportunity to post a reply on the website in September 1998.
In October 1998. the borehole reconstruction published by Pollack, Huang and Shen gave independent support to the conclusion that 20th-century warmth was exceptional for the past 500 years.
Jones et al. 1998
Jones, Keith Briffa, Tim P. Barnett and Simon Tett had independently produced a "Composite Plus Scale" (CPS) reconstruction extending back for a thousand years, comparing tree ring, coral layer, and glacial proxy records, but not specifically estimating uncertainties. Jones et al. 1998 was submitted to The Holocene on 16 October 1997; their revised manuscript was accepted on 3 February and published in May 1998. As Bradley recalls, Mann's initial view was that there was too little information and too much uncertainty to go back so far, but Bradley said "Why don't we try to use the same approach we used in Nature, and see if we could push it back a bit further?" Within a few weeks, Mann responded that to his surprise, "There is a certain amount of skill. We can actually say something, although there are large uncertainties."
Mann, Bradley and Hughes 1999
In considering the 1998 Jones et al. reconstruction which went back a thousand years, Mann, Bradley and Hughes reviewed their own research and reexamined 24 proxy records which extended back before 1400. Mann carried out a series of statistical sensitivity tests, removing each proxy in turn to see the effect its removal had on the result. He found that certain proxies were critical to the reliability of the reconstruction, particularly one tree ring dataset collected by Gordon Jacoby and Rosanne D'Arrigo in a part of North America that Bradley's earlier research had identified as a key region.
This dataset only extended back to 1400, and though another proxy dataset from the same region (in the International Tree-Ring Data Bank) went further back and should have given reliable proxies for earlier periods, validation tests only supported their reconstruction after 1400. To find out why, Mann compared the two datasets and found that they tracked each other closely from 1400 to 1800, then diverged until around 1900 when they again tracked each other. He found a likely reason in the CO
2 "fertilisation effect" affecting tree rings as identified by Graybill and Idso, with the effect ending once CO
2 levels had increased to the point where warmth again became the key factor controlling tree growth at high altitude. Mann used comparisons with other tree ring data from the region to produce a corrected version of this dataset. Their reconstruction using this corrected dataset passed the validation tests for the extended period, but they were cautious about the increased uncertainties.
The Mann, Bradley and Hughes reconstruction covering 1,000 years (MBH99) was submitted in October 1998 to Geophysical Research Letters which published it in March 1999 with the cautious title Northern Hemisphere temperatures during the past millennium: inferences, uncertainties, and limitations to emphasise the increasing uncertainty involved in reconstructions of the period before 1400 when fewer proxies were available. A University of Massachusetts Amherst news release dated 3 March 1999 announced publication in the 15 March issue of Geophysical Research Letters, "strongly suggesting that the 1990s were the warmest decade of the millennium, with 1998 the warmest year so far." Bradley was quoted as saying "Temperatures in the latter half of the 20th century were unprecedented", while Mann said "As you go back farther in time, the data becomes sketchier. One can’t quite pin things down as well, but, our results do reveal that significant changes have occurred, and temperatures in the latter 20th century have been exceptionally warm compared to the preceding 900 years. Though substantial uncertainties exist in the estimates, these are nonetheless startling revelations." While the reconstruction supported theories of a relatively warm medieval period, Hughes said "even the warmer intervals in the reconstruction pale in comparison with mid-to-late 20th-century temperatures." The New York Times report had a colored version of the graph, distinguishing the instrumental record from the proxy evidence and emphasising the increasing range of possible error in earlier times, which MBH said would "preclude, as yet, any definitive conclusions" about climate before 1400.
The reconstruction found significant variability around a long-term cooling trend of −0.02 °C per century, as expected from orbital forcing, interrupted in the 20th century by rapid warming which stood out from the whole period, with the 1990s "the warmest decade, and 1998 the warmest year, at moderately high levels of confidence". The time series line graph Figure 2(a) showed their reconstruction from AD 1000 to 1980 as a thin line, wavering around a thicker dark 40-year smoothed line. This curve followed a downward trend (shown as a thin dot-dashed line) from a Medieval Warm Period (about as warm as the 1950s) down to a cooler Little Ice Age before rising sharply in the 20th century. Thermometer data shown with a dotted line overlapped the reconstruction for a calibration period from 1902 to 1980, then continued sharply up to 1998. A shaded area showed uncertainties to two standard error limits, in medieval times rising almost as high as recent temperatures. When Mann gave a talk about the study to the National Oceanic and Atmospheric Administration's Geophysical Fluid Dynamics Laboratory, Jerry Mahlman nicknamed the graph the "hockey stick", with the slow cooling trend the "stick", and the anomalous 20th century warming the "blade".
Critique and independent reconstructions
Briffa and Tim Osborn critically examined MBH99 in a May 1999 detailed study of the uncertainties of various proxies. They raised questions later adopted by critics of Mann's work, including the point that bristlecone pines from the Western U.S. could have been affected by pollution such as rising CO
2 levels as well as temperature. The temperature curve was supported by other studies, but most of these shared the limited well dated proxy evidence then available, and so few were truly independent. The uncertainties in earlier times rose as high as those in the reconstruction at 1980, but did not reach the temperatures of later thermometer data. They concluded that although the 20th century was almost certainly the warmest of the millennium, the amount of anthropogenic warming remains uncertain."
With work progressing on the next IPCC report, Chris Folland told researchers on 22 September 1999 that a figure showing temperature changes over the millennium "is a clear favourite for the policy makers' summary". Two graphs competed: Jones et al. (1998) and MBH99. In November, Jones produced a simplified figure for the cover of the short annual World Meteorological Organization report, which lacks the status of the more important IPCC reports. Two fifty-year smoothed curves going back to 1000 were shown, from MBH99 and Jones et al. (1998), with a third curve to 1400 from Briffa's new paper, combined with modern temperature data bringing the lines up to 1999: in 2010 the lack of a clarity about this change of data was criticised as misleading.
Briffa's paper as published in the January 2000 issue of Quaternary Science Reviews showed the unusual warmth of the last century, but cautioned that the impact of human activities on tree growth made it subtly difficult to isolate a clear climate message. In February 2000 Thomas J. Crowley and Thomas S. Lowery's reconstruction incorporated data not used previously. It reached the conclusion that peak Medieval warmth only occurred during two or three short periods of 20 to 30 years, with temperatures around 1950s levels, refuting claims that 20th century warming was not unusual.
Reviewing twenty years of progress in palaeoclimatology, Jones noted the reconstructions by Jones et al. (1998), MBH99, Briffa (2000) and Crowley & Lowery (2000) showing good agreement using different methods, but cautioned that use of many of the same proxy series meant that they were not independent, and more work was needed.
Controversy over draft of IPCC Third Assessment Report
In May 2000, while drafts of the IPCC Third Assessment Report were in the review process, Fred Singer's contrarian Science and Environmental Policy Project held a press event on Capitol Hill, Washington, D.C. and alleged that the Summary for Policymakers was a "political document put together by a few scientific bureaucrats". Regarding the draft conclusion that the 20th Century was the warmest in the last 1000 years, he said "We don't accept this. We challenge this". Wibjörn Karlén said the IPCC report "relies extensively on an attempt to reconstruct the global climate during the last 1000 years". In what has become a recurring contrarian theme, he said "This reconstruction shows neither a Medieval Warm Period nor a Little Ice Age. But extensive evidence shows that both these events occurred on a global scale and that climates fluctuated significantly." Mann notes that MBH99 shows both, but the Medieval Warm Period is shown as reaching only mid-20th century levels of warmth and not more recent levels.
A hearing of the United States Senate Committee on Commerce, Science and Transportation, chaired by Senator John McCain, was held on 18 July 2000 to discuss the U.S. National Assessment on Climate Change (NACC) report on the Potential Consequences of Climate Variability and Change which had been released in June for a 60-day public comment period. Witnesses included Fred Singer, whose statement cited the Oregon Petition against the Kyoto Protocol to claim that his skeptic views on human causes of climate change were not fringe. He said there had probably been no global warming since the 1940s, and "Satellite data show no appreciable warming of the global atmosphere since 1979. In fact, if one ignores the unusual El Nino year of 1998, one sees a cooling trend." From this, he concluded that "The post-1980 global warming trend from surface thermometers is not credible. The absence of such warming would do away with the widely touted 'hockey stick' graph (with its 'unusual' temperature rise in the past 100 years)". The NACC report as published stated that "New studies indicate that temperatures in recent decades are higher than at any time in at least the past 1,000 years" and featured graphs showing "1000 Years of Global CO
2 and Temperature Change". Its list of sources said that the temperature data was from MBH99, but the graph did not show error bars or show which part was reconstruction and which was the instrumental record.
Contrarian John Lawrence Daly commented on the TAR draft and the NACC report in a blog posting which alleged that the IPCC 1995 report which reported "a discernible human influence on global climate" had also "presented this graph (Fig 1.) of temperature change since 900 AD", showing a graph which resembled the IPCC 1990 Figure 7.1.c schematic but with changed wording. He wrote that this graph "asserts that temperatures during the Medieval Warm Period were higher than those of today", and described climate changes as due to solar variation. He said that the MBH99 hockey stick graph swiftly "altered the whole landscape of how past climate history was to be interpreted by the greenhouse sciences" and "in one scientific coup overturned the whole of climate history", so that soon afterwards "Overturning its own previous view in the 1995 report, the IPCC presented the `Hockey Stick' as the new orthodoxy with hardly an apology or explanation for the abrupt U-turn since its 1995 report." Around two years later he revised his post to refer to IPCC 1990 rather than the 1995 report.
IPCC Third Assessment Report, 2001
The Working Group 1 (WG1) part of the IPCC Third Assessment Report (TAR) included a subsection on multi-proxy synthesis of recent temperature change. This noted five earlier large-scale palaeoclimate reconstructions, then discussed the Mann, Bradley & Hughes 1998 reconstruction going back to 1400 AD and its extension back to 1000 AD in Mann, Bradley & Hughes 1999 (MBH99), while emphasising the substantial uncertainties in the earlier period. The MBH99 conclusion that the 1990s were likely to have been the warmest decade, and 1998 the warmest year, of the past millennium in the Northern Hemisphere, with "likely" defined as "66–90% chance", was supported by reconstructions by Crowley & Lowery 2000 and by Jones et al. 1998 using different data and methods. The Pollack, Huang & Shen 1998 reconstruction covering the past 500 years gave independent support for this conclusion, which was compared against the independent (extra-tropical, warm-season) tree-ring density NH temperature reconstruction of Briffa 2000.
Its Figure 2.21 showed smoothed curves from the MBH99, Jones et al. and Briffa reconstructions, together with modern thermometer data as a red line and the grey shaded 95% confidence range from MBH99. Above it, figure 2.20 was adapted from MBH99. Figure 5 in WG1 Technical Summary B (as shown to the right) repeated this figure without the linear trend line declining from AD 1000 to 1850.
This iconic graph adapted from MBH99 was featured prominently in the WG1 Summary for Policymakers under a graph of the instrumental temperature record for the past 140 years. The text stated that it was "likely that, in the Northern Hemisphere, the 1990s was the warmest decade and 1998 the warmest year" in the past 1,000 years. Versions of these graphs also featured less prominently in the short Synthesis Report Summary for Policymakers, which included a sentence stating that "The increase in surface temperature over the 20th century for the Northern Hemisphere is likely to have been greater than that for any other century in the last thousand years", and the Synthesis Report - Questions.
The Working Group 1 scientific basis report was agreed unanimously by all member government representatives in January 2001 at a meeting held in Shanghai, China. A large poster of the IPCC illustration based on the MBH99 graph formed the backdrop when Sir John T. Houghton, as Co-Chair of the working group, presented the report in an announcement shown on television, leading to wide publicity.
The original MBH98 and MBH99 papers avoided undue representation of large numbers of tree ring proxies by using a principal component analysis step to summarise these proxy networks, but from 2001 Mann stopped using this method and introduced a multivariate Climate Field Reconstruction (CFR) technique based on the regularized expectation–maximization (RegEM) method which did not require this PCA step. A paper he published jointly with Scott Rutherford examined the accuracy of this method, and discussed the issue that regression methods of reconstruction tended to underestimate the amplitude of variation.
Controversy after IPCC Third Assessment Report
IPCC graph enters political controversy
Rather than displaying all of the long-term temperature reconstructions, the opening figure of the Working Group 1 Summary for Policymakers in the IPCC Third Assessment Report (TAR) highlighted an IPCC illustration based only on the MBH99 paper, and a poster of the hockey stick graph was the backdrop when the report was presented in January 2001, in a televised announcement. The graph was seen by mass media and the public as central to the IPCC case for global warming, which had actually been based on other unrelated evidence. Jerry Mahlman, who had coined the "hockey stick" nickname, described this emphasis on the graph as "a colossal mistake, just as it was a mistake for the climate-science-writing press to amplify it". He added that it was "not the smoking gun. That's the data we've had for the past 150 years, which is quite consistent with the expectation that the climate is continuing to warm." From an expert viewpoint the graph was, like all newly published science, preliminary and uncertain, but it was widely used to publicise the issue of global warming. The 1999 study had been a pioneering work in progress, and had emphasised the uncertainties, but publicity often played this down. Mann later said "The label was always a caricature and it became a stick to beat us with".
Controversy over the graph extended outside the scientific community, with accusations from political opponents of climate science. Science historian Spencer Weart states that "The dedicated minority who denied that there was any global warming problem promptly attacked the calculations." The graph was targeted by those opposing ratification of the Kyoto Protocol on global warming. As Mann said, "Advocates on both sides of the climate-change debate at various times have misrepresented the results for their own purposes". Environmental groups presented the graph flatteringly, and the caution about uncertainty in the original graph tended to be understated or removed: a "hockey stick" graph without error bars featured in the U.S. National Assessment on Climate Change report. Similar graphs were used by those disputing the findings with the claim that the graph was inaccurate. When a later Wall Street Journal editorial used a graph without error bars in this way, Gerald North described this as "very misleading, in fact downright dishonest". Funding was provided by the American Petroleum Institute for research critical of the graph.
A paper by Chris de Freitas published by the Canadian Society of Petroleum Geologists in June 2002 argued against the IPCC findings and the Kyoto Protocol, claiming that global warming posed no danger and CO
2 was innocuous. A section disputing the "hockey stick" curve concluded it was merely a mathematical construct promoted by the IPCC to support the "notion" that recent temperatures were unprecedented. Towards the end of 2002, the book Taken By Storm : the troubled science, policy, and politics of global warming by Christopher Essex and Ross McKitrick, published with assistance from the Fraser Institute, included a chapter about the graph titled "T-Rex Plays Hockey".
Iconic use of the IPCC graph came to symbolise conflict in which mainstream climate scientists were criticised, with some sceptics focussing on the hockey stick graph in the hope that they could damage the credence given to climate scientists.
Soon & Baliunas and Inhofe's hoax accusation
An early attempt to refute the hockey stick graph appeared in a joint paper by Willie Soon, who had already argued that climate change was primarily due to solar variation, and Sallie Baliunas who had contested whether ozone depletion was due to man-made chemicals. The Soon and Baliunas literature review used data from previous papers to argue that the Medieval Warm Period had been warmer than the 20th century, and that recent warming was not unusual. They sent their paper to the editor Chris de Freitas, an opponent of action to curb carbon dioxide emissions who has been characterized by Fred Pearce as a "climate contrarian". Chris de Freitas approved the paper for publication in the relatively obscure journal Climate Research, where it appeared on 31 January 2003. In March Soon and Baliunas published an extended paper in Energy & Environment along with others including David Legates. Two scientists cited in the papers later said that their work was misrepresented.
The Bush administration's Council on Environmental Quality chief of staff Philip Cooney, a lawyer who had formerly been a lobbyist for the American Petroleum Institute, edited the draft first Environmental Protection Agency Report on the Environment to remove all references to reconstructions showing world temperatures rising over the last 1,000 years, and inserted a reference to Soon & Baliunas. He wrote in a 21 April 2003 memo that "The recent paper of Soon-Baliunas contradicts a dogmatic view held by many in the climate science community".
The Climate Research paper was criticised by many other scientists, including several of the journal's editors. In a BBC interview, while Legates said their paper showed the MBH data and methods were invalid, Phil Jones said "This isn't a scientific paper, it's absolutely awful." On 8 July Eos featured a detailed rebuttal of both papers by 13 scientists including Mann and Jones, presenting strong evidence that Soon and Baliunas had used improper statistical methods. Responding to the controversy, the publisher of Climate Research upgraded Hans von Storch from editor to editor in chief as of 1 August 2003. After seeing a preprint of the Eos rebuttal, von Storch decided that the Soon and Baliunas paper was seriously flawed and should not have been published as it was. He proposed a new editorial system, and an editorial saying that the review process had failed.
When the McCain-Lieberman bill proposing restrictions on greenhouse gases was being debated in the Senate on 28 July 2003, Senator James M. Inhofe made a two-hour speech opposing the bill. He cited the Soon and Baliunas paper to support his conclusion: "Wake up, America. With all the hysteria, all the fear, all the phony science, could it be that manmade global warming is the greatest hoax ever perpetrated on the American people? I believe it is." Inhofe convened a hearing of the United States Senate Committee on Environment and Public Works held on 29 July 2003, examining work by the small group of researchers saying there was no evidence of significant human-caused global warming. Three scientists were invited, Mann giving testimony supporting the consensus position, opposed by long-term skeptics Willie Soon and David Legates. The Soon and Baliunas paper was discussed. Senator Jeffords read out an email in which von Storch stated his view "that the review of the Soon et al. paper failed to detect significant methodological flaws in the paper. The critique published in the Eos journal by Mann et al. is valid." In reply, Mann testified "I believe it is the mainstream view of just about every scientist in my field that I have talked to that there is little that is valid in that paper. They got just about everything wrong." He later recalled that he "left that meeting having demonstrated what the mainstream views on climate science are".
The publisher of Climate Research agreed that the flawed Soon and Baliunas paper should not have been published uncorrected, but von Storch's proposals to improve the editorial process were rejected, and von Storch with three other board members resigned. News of his resignation was discussed at the senate committee hearing.
McIntyre and McKitrick 2003
Ratification of the Kyoto Protocol became a major political issue in Canada, and the government issued pamphlets which said that the "20th century was the warmest globally in the past 1,000 years". Toronto businessman Stephen McIntyre saw this as based on the hockey stick graph, and in 2003 he became interested in the IPCC process which had featured the graph prominently. With a background in mineral exploration, including the oil and gas exploration company CGX Energy, he felt that he had the mathematical expertise and experience to independently audit the graph. McIntyre downloaded datasets for MBH99 from a ftp server, but could not locate the ftp site for MBH98 datasets and on 8 April wrote to Mann to request this information. Following email exchanges, Mann's assistant sent the information as text files around 23 April 2003.
McIntyre then made a series of comments about the data on the internet discussion group climateskeptics, and Sonja Boehmer-Christiansen suggested that he should write and submit an article on the topic. She edited the little-known social science journal Energy & Environment which avoided standard peer review and had recently published the extended Soon and Baliunas paper. McIntyre agreed, and made contact with University of Guelph economics professor Ross McKitrick, a senior fellow of the Fraser Institute which opposed the Kyoto treaty, and co-author of Taken By Storm: The Troubled Science, Policy and Politics of Global Warming.
McIntyre drafted an article before they first met on 19 September 2003, and they then worked together intensively on an extensive re-write. McKitrick suggested submitting the paper to Nature, but after drafting a short version to fit the word limit they submitted the full paper to Energy & Environment on 2 October. After review, resubmission on 14 October and further corrections, the paper was published on the web on 27 October 2003, only three and a half weeks after its first submission. Boehmer-Christiansen later said that she had published the paper quickly "for policy impact reasons, eg publication well before COP9", the United Nations Framework Convention on Climate Change negotiations in December 2003.
At the same time that the McIntyre and McKitrick (MM03) paper "Corrections to the Mann et al. (1998) Proxy Data Base and Northern Hemisphere Average Temperature Series" was published on the web, McIntyre set up climate2003 as a web site for the paper.
McIntyre and McKitrick said that they had not been able to replicate the Mann, Bradley and Hughes results due to problems with the data: although the sparse data for the earlier periods was difficult to analyse, their criticism was comprehensively refuted by Wahl & Ammann 2007.
The McIntyre & McKitrick 2003 paper (MM03) said that Mann, Bradley & Hughes 1998 (MBH98) "hockey stick" shape was "primarily an artefact of poor data handling and use of obsolete proxy records". It listed data issues, and stated that when they applied the MBH98 method to corrected data, "The major finding is that the values in the early 15th century exceed any values in the 20th century." They disputed infilled data and had computed principal components analysis using standard algorithms, but said that these "algorithms fail in the presence of missing data". When they used this method on revised data they got different results, and concluded that the "hockey stick" shape "is primarily an artefact of poor data handling, obsolete data and incorrect calculation of principal components".
A draft response by Mann, Bradley and Hughes was put on the University of Virginia website on 1 November 2003, and amended two days later. They said that MM03 appeared seriously flawed as it "used neither the data nor the procedures of MBH98", having deleted key proxy information. In particular, MM03 had misunderstood the stepwise reconstruction technique MBH98 applied. This made use of all the progressively richer and more widespread networks available for later periods by calculating separately principal components for each period of overlapping datasets, for example 1400–1980, 1450–1980, and so on. In treating these as one series with missing information, MM03 had eliminated whole datasets covering the 15th century. The data which MM03 reported difficulty in finding had been available since May 2000 on the public File Transfer Protocol site for the MBH98 paper. Mann, Bradley and Hughes commented that "The standard protocol for scientific journals receiving critical comments on a published paper is to provide the authors being criticized with an opportunity to review the criticism prior to publication, and offer them the chance to respond. Mann and colleagues were given no such opportunity." In 2007 the IPCC AR4 noted the MM03 claim that MBH98 could not be replicated, and reported that "Wahl and Ammann (2007) showed that this was a consequence of differences in the way McIntyre and McKitrick (2003) had implemented the method of Mann et al. (1998) and that the original reconstruction could be closely duplicated using the original proxy data."
Publicity and Washington briefing
On the day of publication, the ExxonMobil funded lobbying website Tech Central Station issued a press release headed "TCS Newsflash: Important Global Warming Study Audited – Numerous Errors Found; New Research Reveals the UN IPCC 'Hockey Stick' Theory of Climate Change is Flawed" announcing that "Canadian business executive Stephen McIntyre and economist Ross McKitrick have presented more evidence that the 20th century wasn't the warmest on record". In a Senate debate on 29 October, a day before the McCain-Lieberman bill vote, Senator Jim Inhofe misrepresented the claims made in the MM03 paper and said that it demonstrated high Medieval Warm Period temperatures in the 15th century (during the Little Ice Age). In attacking the MBH papers, he erroneously described Mann as being in charge of the IPCC. In the same debate, Senator Olympia Snowe used the hockey stick graph to demonstrate the reality of climate change. On the morning of the vote, USA Today carried an op-ed by Tech Central Station editor Nick Shulz saying that MM03 "upsets a key scientific claim about climate change", and that "Mann never made his data available online". The vote was 55–43 against the McCain-Lieberman bill. After Mann and associates showed the newspaper that the data was available online, as it had been for years, USA Today issued a correction on 13 November.
McIntyre was flown to Washington, D.C. to brief business leaders and the staff of Senator Jim Inhofe. On 18 November McIntyre and McKitrick traveled there to present a briefing, sponsored by the George C. Marshall Institute and the Competitive Enterprise Institute, to United States Congress staffers and others. At an event at the George C. Marshall Institute, co-hosted by Myron Ebell of the Cooler Heads Coalition, McIntyre said that he had contacted Mann for the data set but found problems in replicating the curves of the graph because of missing or wrong data. He first met McKitrick, for "lunch at the exact hour that Hurricane Isabel hit Toronto" (19 September 2003). They prepared their corrections in a proxy data set using 1999 data, and using publicly disclosed methods produced a reconstruction which differed from MBH98 in showing high peaks of temperature in the 15th century. They were not saying that these temperatures had occurred, but that Mann's results were incorrect. When they published their paper, it attracted attention, with David Appell being the first reporter to take an interest. They said that after Appell's article was published with comments from Mann, they had followed links to Mann's FTP site and on 29 October copied data files which were subsequently deleted from the site.
In an immediate response to these briefings, Mann, Bradley and Hughes said that the analysis by McIntyre and McKitrick was botched and showed numerous statistical errors including selective removal of records to invent 15th century warming. Climatologist Tom Wigley of the National Center for Atmospheric Research described McIntyre and McKitrick's arguments as "seriously flawed" and "silly", noting that as well as the MBH99 paper around a dozen independent studies had suggested higher temperatures in the late 20th century. George Shambaugh of Georgetown University said he leant in favor of Mann on a statistical basis, geoscientist Michael Oppenheimer compared those arguing over the existence of human-caused global warming with tobacco industry scientists who tried to obscure the link with lung cancer. Against these points, William O'Keefe of the Marshall Institute (previously with the American Petroleum Institute) said there was value in the skeptics keeping the debate going, "We have to encourage healthy debate".
von Storch and Zorita 2004
The statistical methods used in the MBH reconstruction were questioned in a 2004 paper by Hans von Storch with a team including Eduardo Zorita, which said that the methodology used to average the data and the wide uncertainties might have hidden abrupt climate changes, possibly as large as the 20th century spike in measured temperatures. They used the pseudoproxy method which Mann and Rutherford had developed in 2002, and like them found that regression methods of reconstruction tended to underestimate the amplitude of variation, a problem covered by the wide error bars in MBH99. It was a reasonable critique of nearly all the reconstructions at that time, but MBH were singled out. Tim Osborn and Keith Briffa responded, highlighting this conclusion of von Storch et al.
Zorita and von Storch later claimed their paper was a breakthrough in moving the question from "the reality of the blade of the hockey stick" to focus on "the real problems, namely the 'wobbliness' of the shaft of the hockey-stick, and the suppressing of valid scientific questions by gate keeping". In their initial press release, von Storch called the hockey stick "quatsch" ("nonsense" or "garbage") but other researchers subsequently found that the von Storch paper had an undisclosed additional step which had overstated the wobbliness. By detrending data before estimating statistical relationships it had removed the main pattern of variation. The von Storch et al. view that the graph was defective overall was refuted by Wahl, Ritson and Ammann (2006), who pointed to this incorrect implementation of the reconstruction procedure. Stefan Rahmstorf added that the paper had shown only results supporting its conclusions, but its supplementary online material included contradictory results which supported MBH.
Reconstructions, Inhofe and State of Fear
Borehole climate reconstructions in a paper by Pollack and Smerdon, published in June 2004, supported estimates of a surface warming of around 1 °C (1.8 °F) over the period from 1500 to 2000.
In a study published in November 2004 Edward R. Cook, Jan Esper and Rosanne D'Arrigo re-examined their 2002 paper, and now supported MBH. They concluded that "annual temperatures up to AD 2000 over extra-tropical NH land areas have probably exceeded by about 0.3 °C the warmest previous interval over the past 1162 years".
In a Senate speech on 4 January 2005, Inhofe repeated his assertion that "the threat of catastrophic global warming" was the "greatest hoax ever perpetrated on the American people". He singled out the hockey stick graph and Mann for criticism, accusing Mann of having "effectively erased the well-known phenomena of the Medieval Warming Period-when, by the way, it was warmer than it is today-and the Little Ice Age". He quoted von Storch as criticising the graph. In a CBS News opinion piece, Chris Mooney said that Inhofe had extensively cited Michael Crichton's fictional thriller, State of Fear, mistakenly describing Crichton as a "scientist", and had misrepresented three scientists as disputing the "hockey stick" when they had been challenging a completely different paper which Mann had co-authored.
McIntyre and McKitrick 2005
In 2004 Stephen McIntyre blogged on his website climate2003.com about his efforts with Ross McKitrick to get an extended analysis of the hockey stick into the journal Nature. At this stage Nature contacted Mann, Bradley, and Hughes, about minor errors in the online supplement to MBH98. In a corrigendum published on 1 July 2004 they acknowledged that McIntyre and McKitrick had pointed out errors in proxy data that had been included as supplementary information, and supplied a full corrected listing of the data. They included a documented archive of all the data used in MBH98, and expanded details of their methods. They stated, "None of these errors affect our previously published results."
Following the review process, Nature rejected the comment from McIntyre and McKitrick, who then put the record of their submitted paper and the referees' reports up on their web site. This caught the attention of Richard A. Muller, who had previously supported criticism of the hockey stick paper. On 15 October Muller published his view that the graph was "an artifact of poor mathematics", summarising the as yet unpublished comment including its claim that the principal components procedure produced hockey stick shapes from random data. He said that the "discovery hit me like a bombshell".
On 14 October the McIntyre and McKitrick comment was submitted to Geophysical Research Letters, a publication of the American Geophysical Union, and the AGU consented to it being shown at their 13–17 December conference. McIntyre attended the conference, and on 17 December presented a poster session showing his principal components argument about the MBH papers. He found that "People who were not mathematically inclined were intrigued by a graphic showing 8 hockeysticks - 7 simulated and 1 MBH (the same sort of graphic as the one put up here a while ago, but just showing 1 simulation.) Quantity seems to matter in the demonstration. No one could tell the difference without being told." On 17 January 2005 the M&M comment was accepted by GRL for publication as a paper.
McIntyre commented on climate2003.com on 26 October 2004, "Maybe I'll start blogging some odds and ends that I'm working on. I'm going to post up some more observations on some of the blog criticisms."
On 10 December Mann and nine other scientists launched the RealClimate website as "a resource where the public can go to see what actual scientists working in the field have to say about the latest issues".
Principal components analysis methodology
In their renewed criticism, McIntyre & McKitrick 2005 (MM05) found a minor technical statistical error in the Mann, Bradley & Hughes 1998 (MBH98) method, and said it would produce hockey stick shapes from random data. This claim was given widespread publicity and political spin, enabling the George W. Bush administration to assert that the 1997 Kyoto Protocol was discredited. Scientists found that the issues raised by McIntyre and McKitrick were minor and did not affect the main conclusions of MBH98 or Mann, Bradley & Hughes 1999. Reconstructions using different statistical methods had produced similar "hockey stick" graphs. Mann himself had already stopped using the criticised statistical method in 2001, when he changed over to the RegEM climate field reconstruction method.
The available climate proxy records were not spaced evenly over the northern hemisphere: some areas were covered by closely spaced networks with numerous tree-ring proxies, but in many areas only sparse proxy temperature records were available, such as lake sediments, ice cores or corals. To achieve balance, the MBH 1998 (and 1999) studies represented each dense network by using principal component analysis (PCA) to find the leading patterns of variation (PC1, PC2, PC3 etc.) ranked by the percentage of variation they explained. To establish how many significant principal components should be kept so that the patterns put together characterized the original dataset, they used an objective selection rule procedure which involved creating randomised surrogate datasets with the same characteristics and treating them with exactly the same conventions as the original data. The temperature records were of various lengths, the shortest being the instrumental record from 1902 to 1980, and their convention centered data over this modern calibration period. The selection rule found two significant patterns for the North American tree ring network (NOAMER); PC1 emphasized high altitude tree ring data from the Western U.S. showing a cooler period followed by 20th century warming, PC2 emphasised lower elevation tree ring series showing less of a 20th-century trend. This is an acceptable convention, the more conventional method of centering data over the whole period of the study (from 1400 to 1980) produces a very similar outcome but changes the order of PCs and requires more PCs to produce a valid result. Mann did not use the PCA step after 2001, his subsequent reconstructions used the RegEM Climate Field Reconstruction technique incorporating all available individual proxy records instead of replacing groups of records with principal components; tests have shown that the results are nearly identical.
The McIntyre and McKitrick analysis called the PCA centering over the 1902–1980 modern period "an unusual data transformation which strongly affects the resulting PCs". When they centered NOAMER data over the whole 1400–1980 period, this changed the order of principal components so that the warming pattern of high altitude tree ring data was demoted from PC1 to PC4. Instead of recalculating the objective selection rule which increased the number of significant PCs from two to five, they only kept PC1 and PC2. This removed the significant 20th century warming pattern of PC4, discarding data that produced the "hockey stick" shape. They said that "In the controversial 15th century period, the MBH98 method effectively selects only one species (bristlecone pine) into the critical North American PC1", but subsequent investigation showed that the "hockey stick" shape remained with the correct selection rule, even when bristlecone pine proxies were removed.
Their MM05 paper said that the MBH98 (1902–1980 centering) "method, when tested on persistent red noise, nearly always produces a hockey stick shaped first principal component (PC1)", by picking out "series that randomly 'trend' up or down during the ending sub-segment of the series". Though modern centering produces a small bias in this way, the MM05 methods exaggerated the effect. Tests of the MBH98 methodology on pseudoproxies formed with noise varying from red noise to white noise found that this effect caused only very small differences which were within the uncertainty range and had no significance for the final reconstruction. Red noise for surrogate datasets should have the characteristics of natural variation, but the statistical method used by McIntyre and McKitrick produced "persistent red noise" based on 20th century warming trends which showed inflated long-term swings, and overstated the tendency of the MBH98 method to produce hockey stick shapes. Their use of this persistent red noise invalidated their claim that "the MBH98 15th century reconstruction lacks statistical significance", and there was also a data handling error in the MM05 method. Studies using appropriate red noise found that MBH98 passed the threshold for statistical skill, but the MM05 reconstructions failed verification tests.
To demonstrate that some simulations using their persistent red noise "bore a quite remarkable similarity to the actual MBH98 temperature reconstruction", McIntyre and McKitrick produced illustrations for comparison. Figure 4.4 of the Wegman Report showed 12 of these pre-selected simulations. It called this "One of the most compelling illustrations that McIntyre and McKitrick have produced", and said that the "MBH98 algorithm found ‘hockey stick’ trend in each of the independent replications". McIntyre and McKitrick's code selected 100 simulations with the highest "hockey stick index" from the 10,000 simulations they had carried out, and their illustrations were taken from this pre-selected 1%.
In a public relations campaign two weeks before the McIntyre and McKitrick paper was published, the Canadian National Post for 27 January carried a front-page article alleging that "A pivotal global warming study central to the Kyoto Protocol contains serious flaws caused by a computer programming glitch and other faulty methodology, according to new Canadian research." It reprinted in two parts a long article by Marcel Crok which had appeared in Natuurwetenschap & Techniek under the heading "Proof that mankind causes climate change is refuted, Kyoto protocol based on flawed statistics" and the assertion that the MBH99 finding of exceptional late 20th century warmth was "the central pillar of the Kyoto Protocol", despite the protocol having been adopted in December 1997, before either of the MBH papers had been published. The Bush administration had already decided to disregard the Kyoto Protocol which was to come into effect later that month, and this enabled them to say that the protocol was discredited.
McIntyre & McKitrick 2005 (MM05) was published in Geophysical Research Letters on 12 February 2005. They also published an extended critique in Energy & Environment responding to criticism of their 2003 paper and alleging that other reconstructions were not independent as there was "much overlapping" of authors. Two days later, a lead article in the Wall Street Journal said that McIntyre's new paper was "circulating inside energy companies and government agencies. Canada's environment ministry has ordered a review", and though McIntyre did not take strong position on whether or not fossil-fuel use was causing global warming, "He just says he has found a flaw in a main leg supporting the global-warming consensus, the consensus that led to an international initiative taking effect this week: Kyoto."
Technical issues were discussed in RealClimate on 18 February in a blog entry by Gavin Schmidt and Caspar Ammann, and in a BBC News interview Schmidt said that by using a different convention but not altering subsequent steps in the analysis accordingly, McIntyre and McKitrick had removed significant data which would have given the same result as the MBH papers.
On 4 April 2005, McKitrick gave a presentation to the Asia-Pacific Economic Cooperation Study Centre outlining the arguments of MM05, alleging that the TAR had given undue prominence given to the hockey stick graph, and discussing publicity given to the TAR conclusions in Canada. He said, "In the 1995 Second Assessment Report of the IPCC, there was no hockey stick. Instead the millennial climate history contained a MWP and a subsequent Little Ice Age, as shown as in Figure 3." The figure, headed "World Climate History according to IPCC in 1995", resembled the schematic 7.1(c) from IPCC 1990, and corrections to refer to IPCC 1990 were made on 22 July 2005.
At the end of April Science published a reconstruction by J. Oerlemans based on glacier length records from different parts of the world, and found consistent independent evidence for the period from 1600 to 1990 supporting other reconstructions regarding magnitude and timing of global warming. In May the University Corporation for Atmospheric Research advised media about a detailed analysis by Eugene Wahl and Caspar Ammann, first presented at the American Geophysical Union’s December 2004 meeting in San Francisco, which used their own code to replicate the MBH results, and found the MBH method to be robust even with modifications. Their work contradicted the claims by McIntyre and McKitrick about high 15th century global temperatures and allegations of methodological bias towards a hockey stick outcomes, and they concluded that the criticisms of the hockey stick graph were groundless.
The increasing politicisation of the issue was demonstrated when, on 23 June 2005, Rep. Joe Barton, chairman of the House Committee on Energy and Commerce wrote joint letters with Ed Whitfield, Chairman of the Subcommittee on Oversight and Investigations, referring to issues raised by the 14 February 2005 article in the Wall Street Journal and demanding full records on climate research. The letters were sent to the IPCC Chairman Rajendra Pachauri, National Science Foundation Director Arden Bement, and to the three scientists Mann, Bradley and Hughes. The letters told the scientists to provide not just data and methods, but also personal information about their finances and careers, information about grants provided to the institutions they had worked for, and the exact computer codes used to generate their results.
Sherwood Boehlert, chairman of the House Science Committee, told his fellow Republican Joe Barton it was a "misguided and illegitimate investigation" into something that should properly be under the jurisdiction of the Science Committee, and wrote "My primary concern about your investigation is that its purpose seems to be to intimidate scientists rather than to learn from them, and to substitute congressional political review for scientific review." Barton's committee spokesman sent a sarcastic response to this, and to Democrat Henry A. Waxman's letter asking Barton to withdraw the letters and saying he had "failed to hold a single hearing on the subject of global warming" during eleven years as chairman, and had "vociferously opposed all legislative efforts in the Committee to address global warming ... These letters do not appear to be a serious attempt to understand the science of global warming. Some might interpret them as a transparent effort to bully and harass climate change experts who have reached conclusions with which you disagree." The U.S. National Academy of Sciences (NAS) president Ralph J. Cicerone wrote to Barton that "A congressional investigation, based on the authority of the House Commerce Committee, is probably not the best way to resolve a scientific issue, and a focus on individual scientists can be intimidating", and proposed that the NAS should appoint an independent panel to investigate. Barton dismissed this offer.
Mann, Bradley and Hughes sent formal letters giving their detailed responses to Barton and Whitfield. On 15 July, Mann wrote emphasising that the full data and necessary methods information was already publicly available in full accordance with National Science Foundation (NSF) requirements, so that other scientists had been able to reproduce their work. NSF policy was that computer codes "are considered the intellectual property of researchers and are not subject to disclosure", as the NSF had advised McIntyre and McKitrick in 2003, but notwithstanding these property rights, the program used to generate the original MBH98 temperature reconstructions had been made available at the Mann et al. public ftp site.
Many scientists protested against Barton's investigation, with 20 prominent climatologists questioning his approach. Alan I. Leshner wrote to him on behalf of the American Association for the Advancement of Science expressing deep concern about the letters, which gave "the impression of a search for some basis on which to discredit these particular scientists and findings, rather than a search for understanding". He stated that MBH had given out their full data and descriptions of methods, and were not the only evidence in the IPCC TAR that recent temperatures were likely the warmest in 1,000 years; "a variety of independent lines of evidence, summarized in a number of peer-reviewed publications, were cited in support". Thomas Crowley argued that the aim was intimidation of climate researchers in general, and Bradley thought the letters were intended to damage confidence in the IPCC during preparation of its next report. A Washington Post editorial on 23 July which described the investigation as harassment quoted Bradley as saying it was "intrusive, far-reaching and intimidating", and Alan I. Leshner of the AAAS describing it as unprecedented in the 22 years he had been a government scientist; he thought it could "have a chilling effect on the willingness of people to work in areas that are politically relevant". Benjamin D. Santer told the New Scientist "There are people who believe that if they bring down Mike Mann, they can bring down the IPCC."
Congressman Boehlert said the investigation was as "at best foolhardy" with the tone of the letters showing the committee's "inexperience" in relation to science. Barton was given support by global warming sceptic Myron Ebell of the Competitive Enterprise Institute, who said "We've always wanted to get the science on trial ... we would like to figure out a way to get this into a court of law", and "this could work". In his Junk Science column on Fox News, Steven Milloy said Barton's inquiry was reasonable.
The July 2005 issue of the Journal of Climate published a paper it had accepted for publication the previous September, co-authored by Scott Rutherford, Mann, Osborn, Briffa, Jones, Bradley and Hughes, which examined the sensitivity of proxy based reconstruction to method and found that a wide range of alternative statistical approaches gave nearly indistinguishable results. In particular, omitting principal component analysis made no significant difference.
In comments on MM05 made in October, Peter Huybers showed that McIntyre and McKitrick had omitted a critical step in calculating significance levels, and MBH98 had shown it correctly. Though the disputed principal components analysis method would in theory have some effect, its influence on the amplitude of the final reconstruction was very small. In their comment, Hans von Storch and Eduardo Zorita examined McIntyre and McKitrick's claim that normalising data prior to principal component analysis by centering in relation to the calibration period of 1902–1980, instead of the whole period, would nearly always produce hockey stick shaped leading principal components. They found that it caused only very minor deviations which would not have a significant impact on the result. McIntyre and McKitrick contributed replies to these comments.
In November 2005, Science Committee chair Sherwood Boehlert requested the National Academy of Science to arrange a review of climate reconstructions including the hockey stick studies, and its National Research Council set up a special committee to investigate and report.
On 28 February 2006 Wahl & Ammann 2007 was accepted for publication, and an "in press" copy was made available on the internet. Two more reconstructions were published, using different methodologies and supporting the main conclusions of MBH. Rosanne D'Arrigo, Rob Wilson and Gordon Jacoby suggested that medieval temperatures had been almost 0.7 °C cooler than the late 20th century but less homogenous, Osborn and Briffa found the spatial extent of recent warmth more significant than that during the medieval warm period. They were followed in April by a third reconstruction led by Gabriele C. Hegerl.
Al Gore's film An Inconvenient Truth, which premiered in May 2006, included a section on Lonnie Thompson's ice core measurements showing a correlation between CO
2 levels and temperature going back 650,000 years. Gore showed this "thermometer" graph going back a thousand years for a "couple of reasons", the first being that "so called skeptics" will sometimes say "Oh, this whole thing is cyclical phenomenon. There was a medieval warming period after all", but as shown on the graph, "compared to what is going on now, there is just no comparison". The book issued at the same time includes a similar statement beside a graph like Figure 7 from Thompson's 2004 paper, and adds that the skeptics "launched a fierce attack against another measurement of the 1,000 year correlation between CO
2 and temperature known as 'the hockey stick', a graphic image representing the research of Michael Mann and his colleagues. But in fact, scientists have confirmed the same basic conclusions in multiple ways–with Thompson's ice core record as one of the most definitive."
National Research Council Report
At the request of the U.S. Congress, initiated by Representative Sherwood Boehlert as chairman of the U.S. House of Representatives Committee on Science, a special "Committee on Surface Temperature Reconstructions for the Past 2,000 Years" was assembled by the National Research Council to quickly prepare a concise report. The NRC Committee, chaired by Gerald North, consisted of 12 scientists and statisticians from different disciplines. Its task was "to summarize current scientific information on the temperature record for the past two millennia, describe the main areas of uncertainty and how significant they are, describe the principal methodologies used and any problems with these approaches, and explain how central is the debate over the paleoclimate temperature record to the state of scientific knowledge on global climate change". The NRC report went through a rigorous review process involving 15 independent experts. The report provided a summary and an overview, followed by 11 technical chapters covering the instrumental and proxy records, statistical procedures, paleoclimate models, and the synthesis of large-scale temperature reconstructions with an assessment of the "strengths, limitations, and prospects for improvement" in techniques used.
The North Report concluded "with a high level of confidence that global mean surface temperature was higher during the last few decades of the 20th century than during any comparable period during the preceding four centuries", justified by consistent evidence from a wide variety of geographically diverse proxies, but "Less confidence can be placed in large-scale surface temperature reconstructions for the period from 900 to 1600". It broadly agreed with the basic findings of the original MBH studies which had subsequently been supported by other reconstructions and proxy records, while emphasising uncertainties over earlier periods. The contested principal component analysis methodology had a small tendency to bias results so was not recommended, but it had little influence on the final reconstructions, and other methods produced similar results.
Committee on Energy and Commerce Report (Wegman Report)
There had been an outcry in July 2005 when Joe Barton of the House Committee on Energy and Commerce had issued letters demanding information from Mann, Bradley and Hughes, for what was described as an illegitimate investigation. Barton dismissed the offer of a joint investigation organised by the U.S. National Academy of Sciences (NAS). An initial contact was made on 1 September 2005 to ask statistician Edward Wegman about possible testimony in Congress about a paleoclimate issue, and subsequently Barton's staffer met Wegman to ask for an opinion on the validity of criticisms of the Mann, Bradley & Hughes 1999 reconstruction. Wegman formed a team with Yasmin H. Said (who had been his graduate student) and statistician David W. Scott, three statisticians with no expertise in climatology or physical sciences. They were provided by Barton's staffer with material to review over the next nine months. This existence of this team was first made public in a 10 February 2006 report by the Wall Street Journal, and the Wegman report was announced on 14 July 2006 by an article in the Wall Street Journal, and a press release issued by Barton.
The Wegman Report lacked peer review, but was sent out to a number of referees shortly before it was released: one of the referees, Grace Wahba, later said she received the report only 3 days in advance, and her criticisms were ignored.
The Wegman Report was discussed at hearings of the United States House Energy Subcommittee on Oversight and Investigations under its chairman U.S. Rep. Ed Whitfield. The first hearing was held on 19 July 2006, five days after the report was announced and released. Mann was unable to attend this hearing. A second hearing was arranged on 27 July 2006, which he attended.
The report asserted that the critiques of MBH98 and MBH99 by McIntyre and McKitrick (MM) were "valid and compelling", but failed to examine if the suggested corrections made any significant difference to the outcome, though studies including Wahl & Ammann 2007 had found that the hockey stick shape remained after the corrections. The report reiterated the claim that the MBH method created a hockey-stick shape from random red noise, but Wegman failed to respond when the issue was shown to have been caused by an error in McIntyre and McKitrick's methodology, and despite repeated requests did not provide his code for comparison.
A new criticism introduced in the Wegman report presented a social network analysis which implied problems with peer review not being independent, alleging that the many co-authors Mann had worked with after the MBH studies had compromised the independence of scientists: this argument was dismissed by North, who said that report's claim "that there was too much reliance on peer review, which was not necessarily independent" misunderstood the peer review process in science. The peer review process of the Wegman report itself was questioned. In 2007, Wegman and Said published a paper based on this social network analysis. In 2010 this paper was found to include plagiarism which also appeared to be in the Wegman Report: Wegman said that material in it had been "basically copied and pasted" by a student who was the "most knowledgeable" member of his team, as she had taken a one-week course on network analysis with Kathleen Carley. Carley described the paper as an opinion piece lacking data needed to support its argument, and John Quiggin gave his expert view that the Wegman report's analysis showed nothing more than a normal network of co-authorship.
Allegations were made in the Wegman Report that paleoclimatologists supposedly did not seem to interact with "the statistical community": Mann testified that many statisticians working in climatology had been offended by this claim, he himself had been on the American Meteorological Society Committee on Probability and Statistics along with other scientists and statisticians, the National Center for Atmospheric Research Geophysical Statistics Project had provided such interaction for over a decade, and as a postdoctoral student Mann had participated in its inaugural workshop in 1994. In testimony, von Storch referred to "Statistical Analysis in Climate Research" which he had co-authored with the statistician Francis Zwiers.
The Wegman report also alleged inadequate sharing of methods, code and data: Mann testified that these had been available since May 2000 in full accordance with National Science Foundation requirements, and they had gone beyond these requirements to make their full proprietary computer codes public. Despite congressman Waxman pressing Wegman to release the code Ritson had requested, Wegman still declined to "disclose the details of our methods" and Mann said "It would appear that Dr. Wegman has completely failed to live up to the very standards he has publicly demanded of others."
IPCC Fourth Assessment Report, 2007
The IPCC Fourth Assessment Report (AR4) published in 2007 included a chapter on Paleoclimate, with a section on the last 2,000 years. This featured a graph showing 12 proxy based temperature reconstructions, including the three highlighted in the IPCC Third Assessment Report (TAR); Mann, Bradley & Hughes 1999 as before, Jones et al. 1998 and Briffa 2000 had both been calibrated by newer studies. In addition, analysis of the Medieval Warm Period cited reconstructions by Crowley & Lowery 2000 (as cited in the TAR) and Osborn & Briffa 2006. Ten of these 14 reconstructions covered 1,000 years or longer. Most reconstructions shared some data series, particularly tree ring data, but newer reconstructions used additional data and covered a wider area, using a variety of statistical methods. The section discussed the divergence problem affecting certain tree ring data.
It concluded, "The weight of current multi-proxy evidence, therefore, suggests greater 20th-century warmth, in comparison with temperature levels of the previous 400 years, than was shown in the TAR. On the evidence of the previous and four new reconstructions that reach back more than 1 kyr, it is likely that the 20th century was the warmest in at least the past 1.3 kyr." The SPM statement in the IPCC TAR of 2001 had been that it was "likely that, in the Northern Hemisphere, the 1990s was the warmest decade and 1998 the warmest year" in the past 1,000 years. The AR4 SPM statement was that "Average Northern Hemisphere temperatures during the second half of the 20th century were very likely higher than during any other 50-year period in the last 500 years and likely the highest in at least the past 1,300 years. Some recent studies indicate greater variability in Northern Hemisphere temperatures than suggested in the TAR, particularly finding that cooler periods existed in the 12th to 14th, 17th and 19th centuries. Warmer periods prior to the 20th century are within the uncertainty range given in the TAR."
Hans von Storch review
In May 2007, Hans von Storch reviewed the changes in thought caused by the hockey stick controversy writing:
- In October 2004 we were lucky to publish in Science our critique of the 'hockey-stick' reconstruction of the temperature of the last 1000 years. Now, two and half years later, it may be worth reviewing what has happened since then.
- At the EGU General Assembly a few weeks ago there were no less than three papers from groups in Copenhagen and Bern assessing critically the merits of methods used to reconstruct historical climate variable from proxies; Bürger’s papers in 2005; Moberg’s paper in Nature in 2005; various papers on borehole temperature; The National Academy of Science Report from 2006 – all of which have helped to clarify that the hockey-stick methodologies lead indeed to questionable historical reconstructions. The 4th Assessment Report of the IPCC now presents a whole range of historical reconstructions instead of favoring prematurely just one hypothesis as reliable.
McIntyre was critical of this Nature blog entry because von Storch did not acknowledge the role of McIntyre and McKitrick:
- They then proceed to discuss various articles on the Hockey Stick mentioning Bürger, Moberg, borehole papers, the NAS report, but failing to mention McIntyre and McKitrick. Pretty annoying.
However von Storch replied that:
- This was on purpose, as we do not think that McIntyre has substantially contributed in the published peer-reviewed literature to the debate about the statistical merits of the MBH and related method. They have published one peer-reviewed article on a statistical aspect, and we have published a response – acknowledging that they would have a valid point in principle, but the critique would not matter in the case of the hockey-stick ... we see in principle two scientific inputs of McIntyre into the general debate – one valid point, which is however probably not relevant in this context, and another which has not been properly documented.
Further reconstructions were published, using additional proxies and different methodology. Mann identifies Juckes et al. 2007 and Lee, Zwiers & Tsao 2008 for examples. In July 2008 Huang, Pollack and Shen published a suite of borehole reconstructions covering 20,000 years. They showed warm episodes in the mid-Holocene and the Medieval period, a little ice age and 20th century warming reaching temperatures higher than Medieval Warm Period peak temperatures in any of the reconstructions: they described this finding as consistent with the IPCC AR4 conclusions.
In a paper published by PNAS on 9 September 2008, Mann and colleagues produced updated reconstructions of Earth surface temperature for the past two millennia. This reconstruction used a more diverse dataset that was significantly larger than the original tree-ring study, at more than 1,200 proxy records. They used two complementary methods, both of which showed a similar "hockey stick" graph with recent increases in northern hemisphere surface temperature are anomalous relative to at least the past 1300 years. Mann said, "Ten years ago, the availability of data became quite sparse by the time you got back to 1,000 AD, and what we had then was weighted towards tree-ring data; but now you can go back 1,300 years without using tree-ring data at all and still get a verifiable conclusion." In a PNAS response, McIntyre and McKitrick said that they perceived a number of problems, including that Mann et al used some data with the axes upside down. Mann et al. replied that McIntyre and McKitrick "raise no valid issues regarding our paper" and the "claim that 'upside down' data were used is bizarre", as the methods "are insensitive to the sign of predictors". They also said that excluding the contentious datasets has little effect on the result.
The hockey stick graph was given further support by Kaufman et al. 2009 which reconstructed the climate of the Arctic over the last 2,000 years, and a new method of analysis using Bayesian statistics developed by Martin Tingley and Peter Huybers.
Climatic Research Unit email controversy
In the Climatic Research Unit email controversy (also known as "Climategate") which began in November 2009, extracts from a few of the stolen emails and other documents hacked from a server at the Climatic Research Unit (CRU) at the University of East Anglia (UEA) were taken out of context to support allegations against scientists working on the instrumental temperature record and on climate reconstructions.
The most quoted phrase took words from an e-mail of 16 November 1999 written by Phil Jones which referred to a graph he was preparing as a diagram for the cover of the World Meteorological Organization (WMO) statement on the status of global climate in 1999. Jones wrote: "I've just completed Mike's Nature trick of adding in the real temps to each series for the last 20 years (ie, from 1981 onwards) and from 1961 for Keith's to hide the decline." In science, the term "trick" is slang for a clever (and legitimate) technique, in this case Michael E. Mann's technique for comparing two different data sets, and "the decline" referred to the already published divergence problem with tree ring density proxies affecting the post 1960 part of Keith Briffa's reconstruction graph. Despite this and the fact that 1999 had just seen record breaking global temperatures, the email was widely misquoted as a "trick" to "hide the decline" as though it referred to a decline in measured global temperatures, an accusation made publicly by the politicians Sarah Palin and Jim Inhofe.
Questions were raised about the Soon and Baliunas controversy and a 2003 email from Mann suggesting "we have to stop considering Climate Research as a legitimate peer-reviewed journal. Perhaps we should encourage our colleagues in the climate research community to no longer submit to, or cite papers in, this journal." The allegation by Pat Michaels of the Cato Institute that pressure from Jones and Mann was responsible for the resignations at Climate Research was rejected by Hans von Storch, who said that he had resigned "with no outside pressure, because of insufficient quality control on a bad paper – a skeptic's paper, at that". Michaels also alleged a bias against letting sceptics like himself publish in peer reviewed journals; Mann said that the only bias was a requirement for good quality papers, and other climate skeptics had succeeded in getting their work in mainstream journals.
Eight independent investigations of the allegations and the emails all found that there was no evidence of fraud or scientific misconduct by the scientists. One report, by the United States Environmental Protection Agency (EPA), considered detailed petitions raised by conservative activists and business groups with reference to the emails: the EPA examined every email and concluded that there was no merit to the claims in the petitions, which "routinely misunderstood the scientific issues", reached "faulty scientific conclusions", "resorted to hyperbole", and "often cherry-pick language that creates the suggestion or appearance of impropriety, without looking deeper into the issues".
A 2010 opinion piece by David Frank, Jan Esper, Eduardo Zorita and Rob Wilson (Frank et al. 2010) noted that by then over two dozen large-scale climate reconstructions had been published, showing a broad consensus that there had been exceptional 20th century warming after earlier climatic phases, notably the Medieval Warm Period and Little Ice Age. There were still issues of large-scale natural variability to be resolved, especially for the lowest frequency variations, and they called for further research to improve expert assessment of proxies and to develop reconstruction methods explicitly allowing for structural uncertainties in the process.
New studies using different methods continued to extend the period covered by reconstructions. Ljungqvist's 2,000 year extratropical Northern Hemisphere reconstruction generally agreed well with Mann et al. 2008, though it used different methods and covered a different area. Studies by Christiansen and Ljungqvist investigated previous underestimation of low-frequency variability, and reaffirmed Mann et al.'s conclusions about the Little Ice Age and the Medieval Warm Period. as did Ljungqvist et al. 2012 which used a larger network of proxies than previous studies. Marcott et al. 2013 used seafloor and lake bed sediment proxies to reconstruct global temperatures over the past 11,300 years, the last 1,000 years of which confirmed the original MBH99 hockey stick graph.
- Pearce 2010, pp. 80–85, Connor 2013
- Weart 2011c, Fingerprints (1990s–2000s)
- Jones et al. 2009.
- Wahl & Ammann 2007
- Weart 2011c, The Hockey Stick and Beyond
- Folland et al. 2001, 184.108.40.206 Multi-proxy synthesis of recent temperature change Archived 4 June 2011 at the Wayback Machine
- Monastersky 2006, p. 10.
- BBC News & 16 July 2004.
- Pearce & 2010_pt3 "Part three: Hockey stick graph took pride of place in IPCC report, despite doubts".
- Revkin & 5 August 2003 (NYT).
- The Decay of the Hockey Stick, Nature "Climate Feedback" blog post by von Storch. "... we do not think that McIntyre has substantially contributed in the published peer-reviewed literature to the debate about the statistical merits of the MBH and related method." (comment by von Storch & Zorita, May 7, 2007 07:35 PM, in response to multiple comments on their failure to acknowledge McIntyre and McKitrick's contributions)
- Pearce & 2010_pt4, "Part four: Climate change debate overheated after sceptics grasped 'hockey stick'".
- North 2006b, 22:10
- Vergano & 15 May 2011.
- Vergano & 16 May 2011.
- Quiggin 2006.
- Frank et al. 2010.
- Jansen et al. 2007, Section 6.6: The Last 2,000 Years.
- Jones et al. 2009, pp. 34, 36.
- Weart 2011f
- Mann 2012, pp. 274–275.
Jacoby & D'Arrigo 1989.
- Pearce 2010, pp. 37–39; Weart 2011o, Global Warming as a Political Issue (1980s)
- Folland et al. 1990, pp. 199–202.
- Pearce 2010, pp. 45–46.
- Jones et al. 2009, p. 36.
- Wahl & Ammann 2007.
- Jones et al. 2009, pp. 21–22.
- Nicholls et al. 1996, pp. 173–176, fig 3.20; Hughes & Diaz 1994.
- Pearce 2010, p. 44.
- Briffa et al. 1998.
- Pearce 2010, pp. 79–85; Cushman 1998.
- Boykoff & Boykoff 2004
- Michaels 1996
- Bradley & Jones 1993.
- Mann et al. 2008
- Jones & Mann 2004
- Mann 2012, pp. 28–34, 270
- Mann, Park & Bradley 1995.
- Mann 2012, pp. 40–48
- Mann 2012, pp. 47–48
- Mann 2012, pp. 43, 45
- Ammann & Wahl 2007
- Mann 2012, pp. 43, 48
- Mann, Bradley & Hughes 1998
- Hegerl 1998
- Mann 2012, pp. 48–50
- Stevens 1998.
- Jones 1998.
- Mann 2012, p. 106, Michaels 1998
- Marshall Institute 1998.
- Mann 2012, p. 106, Soon & Baliunas 1998, Mann 1998.
- Pollack, Huang & Shen 1998
- Jones et al. 1998
- Mann 2012, pp. 50–51; Jacoby & D'Arrigo 1989; Bradley 1996.
- Mann 2012, pp. 51–53; Graybill & Idso 1993.
- Mann, Bradley & Hughes 1999
- UMass press release & 3 March 1999.
- Stevens 1999.
- Weart 2011c, The influential 1999 "hockey stick" reconstruction
- Pearce 2010, pp. 50–51
- Briffa & Osborn 1999.
- Pearce 2010, p. 48; Jones and Davies, quoted in UEA press release & 24 Nov. 2009; ICCER 2010, pp. 59–60: "The WMO report is a short document produced annually. It does not have the status or importance of the IPCC reports."
- Briffa 2000
- Crowley & Lowery 2000
- Jones 2000.
- Mann 2012, p. 107, Sullivan 2000
- McCain 2000
- Singer 2000
- NACC 2000
- Daly 2001
- Albritton et al. 2001, Technical Summary B Archived 4 March 2016 at the Wayback Machine, Figure 5 Archived 30 September 2012 at the Wayback Machine.
- IPCC WG1 SPM 2001, Figure 1(b).
- IPCC TAR SYR 2001 Summary for Policymakers Archived 4 April 2013 at the Wayback Machine: Question 2 Archived 4 June 2011 at the Wayback Machine, Figure SPM-10b Archived 30 September 2012 at the Wayback Machine, Question 9 Archived 4 April 2013 at the Wayback Machine; Figure 9-1b Archived 30 September 2012 at the Wayback Machine, Figure 2-3 Archived 30 September 2012 at the Wayback Machine.
- Kirby & 22 Jan. 2001 (BBC News)
- Mann 2012, pp. 104–105, 306; Mann & Rutherford 2002
- de Freitas 2002: "... global temperature has not risen appreciably in the last 20 years. ... Rather than try to reduce innocuous carbon dioxide emissions, we would do better to focus on air pollution."
- Fraser Institute 2002, p. 5 (Chairman's Message).
- Table of contents for Taken by storm. OCLC 50790140., Table of Contents, archived 30 June 2004
- Essex & McKitrick (2002, pp. 154–155): "On the basis of the hockey stick graph, many people refer to 1998 as "very likely" the warmest year of the millennium. Big Panel scientists believe it shows 1998 to be the warmest year for the whole world since AD1000."
- Pearce 2010, p. 41.
- Weart 2011c, footnote 48, (p. 19, n1 in pdf).
- Pearce 2010, pp. 130–131.
- Monastersky 2003.
- Soon & Baliunas 2003.
- Pearce 2010, pp. 133, 136–137 describes de Freitas as "a man with known sceptical views" and a "climate contrarian" who "was a driving force behind the creation of an early sceptic organisation in Canada, Friends of Science",
Also, see Mooney 2004: "Soon and Baliunas had specifically sent their paper to one Chris de Freitas at Climate Research, an editor known for opposing curbs on carbon dioxide."
- Revkin 2005; Waxman 2007
- Mann et al. 2003.
- Inhofe & 4 Jan. 2005 (speech); quoted in Congressional Record & 28 July 2003.
- HCEPW & 29 July 2003 (hearing).
- Appell 2005.
- Mann 2012, pp. 122–123
- McKitrick, Ross; McIntyre, Stephen (November 2003), Ross McKitrick, archived from the original on 27 November 2003, retrieved 10 September 2012
- McIntyre & 28 Oct. 2003 (blog).
- Thacker 2005b.
Mann 2012, pp. 122–123.
- Appell, David (2004), Quark Soup: Timing of M&M in E&E, archived from the original on 2 December 2003, retrieved 10 September 2012
- Mann 2012, p. 122
- Pearce 2010, p. 92.
- McIntyre & McKitrick 2003a.
- McIntyre & 29 Oct. 2003.
- Mann, Bradley & Hughes 2003
- Jansen et al. 2007, Sec. 220.127.116.11: What Do Reconstructions Based on Palaeoclimatic Proxies Show?, p. 466.
- TCS & 27 Oct. 2003.
- Mann 2012, pp. 123–124
- Schulz & 28 Oct. 2003 (op-ed, USA Today).
- USA Today & 13 Nov. 2003: correction×.
- Thacker 2005b
- McKitrick, Ross; McIntyre, Stephen (1 December 2003), Ross McKitrick, archived from the original on 3 December 2003, retrieved 10 September 2012
- Vergano & 18 Nov. 2003 (USA Today).
- McIntyre & McKitrick 2003b.
- ICCER 2010, von Storch et al. 2004.
- Osborn & Briffa 2004.
- von Storch & Zorita 2007.
- Mann 2012, pp. 105, 295
- Wahl, Ritson & Ammann 2006.
- Mann 2012, p. 296; Rahmstorf 2006
- Pollack & Smerdon 2004.
- Cook, Esper & D'Arrigo 2004.
- Inhofe & 4 Jan. 2005 (speech). Mann et al. 2005.
- Mooney & 11 Jan. 2005 (CBS News).
- Pearce 2010, pp. 93–96
- McIntyre, Stephen (2004), Welcome to Climate2003, archived from the original on 2 September 2004, retrieved 10 September 2012, McIntyre, Stephen; McKitrick, Ross (1 July 2004), M&M03 Page, archived from the original on 12 September 2004, retrieved 10 September 2012
- Mann, Bradley & Hughes 2004, Mann 2012, pp. 304–305.
- Mann 2012, pp. 130, 140, 304; Muller 2004.
- McIntyre & McKitrick 2005.
- McIntyre & 26 Oct. 2004.
- McIntyre & 3 Feb. 2005.
- Mann 2012, pp. 306–307
- Mann 2012, pp. 131–136
- Huybers 2005
- Mann 2012, pp. 136–137, 306–307
- Rutherford et al. 2005.
- Mann 2012, pp. 137, 306–307
- Wahl & Ammann 2007
- von Storch & Zorita 2005.
- Mann 2012, pp. 139–140, 307–308
- Wegman, Said & Scott 2006, p. 33
- Mann 2012, pp. 242–243, 362–363
- Pearce 2010, pp. 95–96, Mann 2012, pp. 140–141, Crok 2005a, Crok 2005b
- McIntyre & McKitrick 2005, McKitrick & McIntyre 2005
- Regalado & 14 Feb. 2005 (WSJ).
- Schmidt & Ammann 2005.
- Rincon & 16 March 2005 (BBC News).
- McKitrick 2005.
- Oerlemans 2005.
- UCAR news release & 11 May 2005.
- Monastersky 2005.
- HCEC & 23 June 2005; Barton & Whitfield 2005.
- Washington Post editorial & 23 July 2005, Hunting Witches".
- Eilperin & 18 July 2005 (Washington Post).
- Waxman & 1 July 2005 (letter).
- Mann 2005; Schmidt & Rahmstorf 2005.
- Eilperin & 18 July 2005; Twenty scientists 2005.
- Leshner 2005. Leshner was CEO of the AAAS and Executive Publisher of the journal Science.
- Pease & 18 July 2005 (BBC News).
- Pearce 2006
- Milloy & 31 July 2005 (Fox News).
- Huybers 2005.
- Revkin & 22 June 2006 (NYT).
- D'Arrigo, Wilson & Jacoby 2006.
- Osborn & Briffa 2006.
- North et al. 2006, pp. 113–115.
- Hegerl et al. 2006.
- Hoke 2006.
- Thompson et al. 2003.
- Gore 2006, pp. 63–65.
- North et al. 2006, pp. vii, Appendix C: Biosketches of Committee Members (142–146).
- North et al. 2006, pp. viii, xi
- North et al. 2006, pp. xiii–xiv, 28
- North et al. 2006, pp. 1–3
- North et al. 2006, pp. 3–4
- North et al. 2006, pp. 112–116
- NAS press conference & 22 June 2006.
- Regalado 2006a
- Said 2007
- Mann 2012, pp. 160, 357, Said 2005
- WSJ editorial & 14 July 2006, Hockey Stick Hokum.
- HCEC "fact-sheet" 2006 (press release).
- Wegman, Said & Scott 2006
- North, interviewed by Monastersky & 6 Sept. 2006.
- HCEC Hearings & 19 July 2006, p. 1.
- HCEC Hearings & 19 July 2006, p. III.
- Wegman, Said & Scott 2006, pp. 34, 49
- Wegman, Said & Scott 2006, pp. 1–5, 7
- HCEC Hearings & 19 July 2006, pp. 591, 697–698.
- Ritson 2006
- HCEC Hearings & 19 July 2006, p. 769.
- Wegman, Said & Scott 2006, pp. 1–5
- HCEC Hearings, 19 July 2006, pp. 63–64, 83, 98, 592, 835–836.
- HCEC Hearings & 19 July 2006, pp. 765–766.
- Mann, 2012 & 174–175, 318–319
- AR4 WG1 SPM A Palaeoclimatic Perspective
- Heffernan 2007a.
- McIntyre & 3 May 2007.
- Heffernan 2007b.
- Mann 2012, pp. 140, 308
- Huang, Pollack & Shen 2008
- Black & 1 Sep. 2008 (BBC News).
- McIntyre & McKitrick 2009.
- Mann, Bradley & Hughes 2009.
- Kaufman et al. 2009; UCAR news release & 3 Sept. 2009; Bello 2009.
- Appell 2009; Tingley & Huybers 2010a
- Chameides 2010.
- UEA press release & 23 Nov. 2009.
- Pearce & 2010_pt2, "Part two: How the 'climategate' scandal is bogus and based on climate sceptics' lies".
- Hickman & 20 Nov. 2009 (Guardian).
- Nature editorial & 3 December 2009 "Climatologists under pressure".
- Johnson, Naik & 24 Nov. 2009 (WSJ).
- Michaels & 18 Dec. 2009 (WSJ).
- von Storch & 22 Dec. 2009 (WSJ).
- Mann & 31 Dec. 2009 (WSJ).
- The eight major investigations covered by secondary sources include: House of Commons Science and Technology Committee (UK); Independent Climate Change Review (UK); International Science Assessment Panel Archived 9 May 2013 at the Wayback Machine (UK); Pennsylvania State University first panel Archived 25 September 2010 at the Wayback Machine and second panel Archived 30 January 2012 at the Wayback Machine (US); United States Environmental Protection Agency (US); Department of Commerce (US); National Science Foundation (US)
- Ljungqvist 2010
- Christiansen & Ljungqvist 2012
- Lemonick 2013.
References in chronological sequence
- Lamb, H. (1965), "The early medieval warm epoch and its sequel", Palaeogeography, Palaeoclimatology, Palaeoecology, 1: 13–37, Bibcode:1965PPP.....1...13L, doi:10.1016/0031-0182(65)90004-0.
- Landsberg, H. E.; Groveman, B. S.; Hakkarinen, I. M. (1978), "A simple method for approximating the annual temperature of the northern hemisphere" (PDF), Geophysical Research Letters, 5 (6): 505–506, Bibcode:1978GeoRL...5..505L, doi:10.1029/GL005i006p00505[permanent dead link].
- Groveman, B. S.; Landsberg, H. E. (1979), "Simulated northern hemisphere temperature departures 1579–1880" (PDF), Geophysical Research Letters, 6 (10): 767–769, Bibcode:1979GeoRL...6..767G, doi:10.1029/GL006i010p00767[permanent dead link].
- Jacoby, Gordon C.; D'Arrigo, Roseanne (February 1989), "Reconstructed Northern Hemisphere annual temperature since 1671 based on high-latitude tree-ring data from North America", Climatic Change, 14 (1): 39–59, Bibcode:1989ClCh...14...39J, doi:10.1007/BF00140174.
- Folland; et al. (1990), "Chap. 7: Observed Climate Variation and Change" (PDF), Missing or empty
|title=(help), in IPCC FAR WG1 (1990).
- IPCC FAR WG1 (1990), Houghton, J.T.; Jenkins, G.J.; Ephraums, J.J. (eds.), Climate Change: The IPCC Scientific Assessment (1990), Report prepared for Intergovernmental Panel on Climate Change by Working Group I, Cambridge University Press, ISBN 0-521-40360-X (pb: 0-521-40720-6).
- Fritts, Harold C. (1 January 1991), Reconstructing large-scale climatic patterns from tree-ring data : a diagnostic analysis, Tucson: University of Arizona Press, ISBN 0-8165-1218-3, abstract
- Bradley; et al. (1991), "Global Change: The last 2000 years. Report of Working Group 1." (PDF), Global Changes of the Past, UCAR/Office for Interdisciplinary Earth Studies, Boulder, Coloradoa, pp. 11–24.
- Folland; et al. (1992), "Section C - Observed Climate Variability and Change" (PDF), Missing or empty
|title=(help), in IPCC supplementary report, 1992.
- Graybill, Donald A.; Idso, Sherwood B. (January 1993), "Detecting the aerial fertilization effect of atmospheric CO2 enrichment in tree-ring chronologies", Global Biogeochemical Cycles, 7 (1): 81–95, Bibcode:1993GBioC...7...81G, doi:10.1029/92GB02533.
- Mann, M. E.; Park, J. (June 1993), "Spatial correlations of interdecadal variation in global surface temperatures", Geophysical Research Letters, 20 (11): 1055–1058, Bibcode:1993GeoRL..20.1055M, doi:10.1029/93GL00752.
- Bradley, Raymond S.; Jones, Philip D. (December 1993), "'Little Ice Age' summer temperature variations; their nature and relevance to recent global warming trends" (PDF), The Holocene, 3 (4): 367–376, doi:10.1177/095968369300300409.
- Hughes, Malcolm K.; Diaz, Henry F. (1 March 1994), "Was there a 'medieval warm period', and if so, where and when?", Climatic Change, 26 (2–3): 109–142, Bibcode:1994ClCh...26..109H, doi:10.1007/BF01092410.
- Mann, M. E.; Park, J. (20 December 1994), "Global scale modes of surface temperature variability on interannual to century time scales" (PDF), Geophysical Research Letters, 99: 25819–25833, Bibcode:1994JGR....9925819M, doi:10.1029/94jd02396.
- Mann, Michael E.; Park, Jeffrey; Bradley, Raymond S. (16 November 1995), "Global interdecadal and century-scale climate oscillations during the past five centuries", Nature, 378 (6554): 266–270, Bibcode:1995Natur.378..266M, doi:10.1038/378266a0.
- Lean, J.; Beer, J.; Bradley, R. (December 1995), "Reconstruction of solar irradiance since 1610: Implications for climate change" (PDF), Geophysical Research Letters, 22 (23): 3195–3198, Bibcode:1995GeoRL..22.3195L, doi:10.1029/95GL03093.
- Bradley, Raymond S. (1996), "Are there optimum sites for global paleotemperature reconstruction?" (PDF), in Jones, Phil; Bradley, Raymond S.; Jouzel, Jean (eds.), Climate Variations and Forcing Mechanisms of the Last 2000 years, NATO ASI Series, 141, Springer-Verlag, Berlin, pp. 603–624.
- Nicholls; et al. (1996), "Chap. 3: Observed Climate Variability and Change", Missing or empty
|title=(help), in IPCC SAR WG1 1996.
- IPCC SAR WG1 (1996), Houghton, J.T.; Meira Filho, L.G.; Callander, B.A.; Harris, N.; Kattenberg, A.; Maskell, K. (eds.), Climate Change 1995: The Science of Climate Change, Contribution of Working Group I to the Second Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 0-521-56433-6 (pb: 0-521-56436-0) pdf.
- Michaels, Pat (18 March 1996), Feature: Congressional Brouhaha Over U.N. Report, World Climate Report, archived from the original on 29 November 2014, retrieved 1 January 2013.
- Lamb, H. H.; Clayton, K. M.; Wigley, T. M. L. (1997), "The Climatic Research Unit at Twenty-five Years", in Hulme, Michael; Barrow, Elaine (eds.), Climates of the British Isles: present, past and future, Routledge, ISBN 978-0-415-13016-5.
- Overpeck, J.; Hughen, K.; Hardy, R.; Bradley, R.; et al. (14 November 1997), "Arctic Environmental Change of the Last Four Centuries", Science, 278 (5341): 1251–1256, Bibcode:1997Sci...278.1251O, doi:10.1126/science.278.5341.1251.
- Fisher, D. A. (1997), "High resolution reconstructed Northern Hemisphere temperatures for the last few centuries: using regional average tree ring, ice core and historical annual time series", Paper U32C-7 in Supplement to EOS. Transactions.
- Briffa, Keith R.; Schweingruber, F. H.; Jones, Phil D.; Osborn, Tim J.; Shiyatov, S. G.; Vaganov, E. A. (12 February 1998), "Reduced sensitivity of recent tree-growth to temperature at high northern latitudes" (PDF), Nature, 391 (6668): 678–682, Bibcode:1998Natur.391..678B, doi:10.1038/35596[permanent dead link].
- Mann, Michael E.; Bradley, Raymond S.; Hughes, Malcolm K. (23 April 1998), "Global-scale temperature patterns and climate forcing over the past six centuries" (PDF), Nature, 392 (6678): 779–787, Bibcode:1998Natur.392..779M, doi:10.1038/33859. Corrigendum: Mann, Bradley & Hughes 2004.
- Hegerl, G. (23 April 1998), "The past as guide to the future" (PDF), Nature, 392 (6678): 758–759, Bibcode:1998Natur.392..758H, doi:10.1038/33799.
- Jones, Phil D. (24 April 1998), "CLIMATE CHANGE: It Was the Best of Times, It Was the Worst of Times", Science, 280 (5363): 544–545, doi:10.1126/science.280.5363.544.
- Cushman, John H., Jr. (26 April 1998), "Industrial Group Plans To Battle Climate Treaty", New York Times, retrieved 5 December 2013.
- Stevens, William K. (28 April 1998), "New Evidence Finds This Is Warmest Century in 600 Years", New York Times, retrieved 7 March 2011.
- Jones, Phil D.; Briffa, K. R.; Barnett, T. P.; Tett, S. F. B. (May 1998), "High-resolution palaeoclimatic records for the last millennium: interpretation, integration and comparison with General Circulation Model control-run temperatures", The Holocene, 8 (4): 455–471, doi:10.1191/095968398667194956.
- Michaels, Pat (11 May 1998), Feature: Science Pundits Miss Big Picture Again, World Climate Report, archived from the original on 29 November 2014, retrieved 30 December 2012.
- Briffa, K. R.; Jones, P. D.; Schweingruber, F. H.; Osborn, T. J. (4 June 1998), "Influence of volcanic eruptions on Northern Hemisphere summer temperature over the past 600 years" (PDF), Nature, 393 (6684): 450–455, Bibcode:1998Natur.393..450B, doi:10.1038/30943, archived from the original (PDF) on 1 April 2012.
- Marshall Institute (30 June 1998), 1997: Warmest Year Since 1400?, George C. Marshall Institute, archived from the original on 21 September 2011, retrieved 8 May 2012.
- Soon, Willie; Baliunas, Sallie (10 August 1998), Cutting Edge: The Summer of Our Discontent, World Climate Report, archived from the original on 29 November 2014, retrieved 1 January 2013.
- Mann, Michael E. (28 September 1998), Cutting Edge: On Reconstructing Past Centuries' Temperatures, World Climate Report, archived from the original on 29 November 2014, retrieved 1 January 2013.
- Pollack, Henry N.; Huang, Shaopeng; Shen, Po-Yu (9 October 1998), "Climate change record in subsurface temperatures: A global perspective" (PDF), Science, 282 (5387): 279–281, Bibcode:1998Sci...282..279P, doi:10.1126/science.282.5387.279, PMID 9765150.
- 1998 Was Warmest Year of Millennium, UMass Amherst Climate Researchers Report, UMass Amherst Office of News & Information, 3 March 1999, archived from the original on 29 June 2011, retrieved 6 March 2011.
- Mann, Michael E.; Bradley, Raymond S.; Hughes, Malcolm K. (1999), "Northern hemisphere temperatures during the past millennium: Inferences, uncertainties, and limitations" (PDF), Geophysical Research Letters, 26 (6): 759–762, Bibcode:1999GeoRL..26..759M, doi:10.1029/1999GL900070.
- Stevens, William K. (9 March 1999), "Song of the Millennium: Cool Prelude and a Fiery Coda", New York Times (Science News). (source for graph)
- Briffa, Keith R.; Osborn, Timothy J. (7 May 1999), "CLIMATE WARMING: Seeing the Wood from the Trees", Science, 284 (5416): 926–927, doi:10.1126/science.284.5416.926.
- Briffa, Keith R. (1 January 2000), "Annual climate variability in the Holocene: interpreting the message of ancient trees", Quaternary Science Reviews, 19 (1–5): 87–105, Bibcode:2000QSRv...19...87B, doi:10.1016/S0277-3791(99)00056-6.
- Huang, Shaopeng; Pollack, Henry N.; Shen, Po-Yu (17 February 2000), "Temperature trends over the past five centuries reconstructed from borehole temperatures" (PDF), Nature, 403 (6771): 756–758, Bibcode:2000Natur.403..756H, doi:10.1038/35001556, PMID 10693801.
- Crowley, Thomas J.; Lowery, Thomas S. (February 2000), "How Warm Was the Medieval Warm Period?", AMBIO: A Journal of the Human Environment, 29 (1): 51–54, doi:10.1579/0044-7447-29.1.51.
- Sullivan, Bruce (30 May 2000), Scientists Say Global Warming Theory is a Lot of Hot Air, CNSNews.com, archived from the original on 8 September 2005, retrieved 30 December 2012.
- Jones, Phil (June 2000), CRU Information Sheet no. 5: The Millennial Temperature Record, University of East Anglia, retrieved 7 March 2011.
- Kirby, Alex (22 January 2001). "SCI/TECH: Human effect on climate 'beyond doubt'". BBC News. Retrieved 21 October 2012.
- Briffa, K. R.; Osborn, T. J.; Schweingruber, F. H.; Harris, I. C.; Jones, P. D.; Shiyatov, S. G.; Vaganov, E. A. (16 February 2001), "Low-frequency temperature variations from a northern tree ring density network", Journal of Geophysical Research, 106 (D3): 2929, Bibcode:2001JGR...106.2929B, doi:10.1029/2000JD900617.
- Broecker, W. S. (23 February 2001), "PALEOCLIMATE: Was the Medieval Warm Period Global?" (PDF), Science, 291 (5508): 1497–1499, doi:10.1126/science.291.5508.1497, PMID 11234078, archived from the original (PDF) on 19 March 2013
- Schneider, T. (March 2001), "Analysis of Incomplete Climate Data: Estimation of Mean Values and Covariance Matrices and Imputation of Missing Values", Journal of Climate, 14 (5): 853–853, Bibcode:2001JCli...14..853S, doi:10.1175/1520-0442(2001)014<0853:AOICDE>2.0.CO;2.
- Daly, John L. (2001), The Hockey Stick: A New Low in Climate Science, Archived from the original on 14 April 2001, retrieved 2012-10-18CS1 maint: BOT: original-url status unknown (link) (graph attribution corrected by ).
- Jones, P. D.; Osborn, T. J.; Briffa, K. R. (27 April 2001), "The Evolution of Climate over the Last Millennium", Science, 292 (5517): 662–667, Bibcode:2001Sci...292..662J, doi:10.1126/science.1059126, PMID 11326088.
- IPCC WG1 SPM (2001), "Summary for Policymakers", archived from the original on 7 March 2016 Missing or empty
|title=(help), in IPCC TAR WG1 2001.
- Albritton; et al. (2001), "Technical Summary", archived from the original on 24 December 2011 Missing or empty
|title=(help), in IPCC TAR WG1 2001.
- Folland; et al. (2001), "Chapter 2: Observed Climate Variability and Change", archived from the original on 6 October 2014 Missing or empty
|title=(help), in IPCC TAR WG1 2001.
- IPCC TAR WG1 (2001), Houghton, J.T.; Ding, Y.; Griggs, D.J.; Noguer, M.; van der Linden, P.J.; Dai, X.; Maskell, K.; Johnson, C.A. (eds.), Climate Change 2001: The Scientific Basis, Contribution of Working Group I to the Third Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 0-521-80767-0, archived from the original on 30 March 2016 (pb: 0-521-01495-6).
- IPCC TAR SYR (2001), Watson, R. T.; the Core Writing Team (eds.), Climate Change 2001: Synthesis Report, Contribution of Working Groups I, II, and III to the Third Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 0 521 80770 0 (pb: 0-521-01507-3).
- Esper, J.; Cook, E. R.; Schweingruber, F. H. (22 March 2002), "Low-Frequency Signals in Long Tree-Ring Chronologies for Reconstructing Past Temperature Variability" (PDF), Science, 295 (5563): 2250–2253, Bibcode:2002Sci...295.2250E, doi:10.1126/science.1066208, PMID 11910106.
- Flatow, Ira (29 March 2002), Interview: Michael Mann discusses a study that shows the pattern of global warming in the previous centuries may actually be part of a natural climate cycle, as evidenced by tree ring data (PDF), NPR Science Friday, retrieved 7 March 2011.
- Mann, M. E.; Rutherford, S. (31 May 2002), "Climate reconstruction using 'Pseudoproxies'" (PDF), Geophysical Research Letters, 29 (10): 139–1–139–4, Bibcode:2002GeoRL..29.1501M, doi:10.1029/2001GL014554.
- de Freitas, C. R. (June 2002), "Are observed changes in the concentration of carbon dioxide in the atmosphere really dangerous?" (PDF), Bulletin of Canadian Petroleum Geology, 30 (2): 297, 307–311, archived from the original (PDF) on 26 May 2003, retrieved 15 July 2011.
- Essex, Christopher; McKitrick, Ross (2002), Taken By Storm : the troubled science, policy, and politics of global warming, Toronto, Ont.: Key Porter Books, ISBN 1-55263-212-1.
- Fraser Institute (2002), 2002 Annual Report (PDF), archived from the original (PDF) on 11 August 2011, retrieved 16 July 2011.
- Soon, Wille; Baliunas, Sallie (31 January 2003), "Proxy climatic and environmental changes of the past 1000 years" (PDF), Climate Research, 23 (2): 89–110, Bibcode:2003ClRes..23...89S, doi:10.3354/cr023089.
- U.S. Senate (28 July 2003), "Hearing: Science of Climate Change", Congressional Record, U.S. Government Printing Office, 149 (113): S10022, retrieved 31 August 2012
- Committee on Environment and Public Works (29 July 2003), "Climate History and the Science Underlying Fate, Transport, and Health Effects of Mercury Emissions", Senate Hearing 108-359, U.S. Government Printing Office, retrieved 6 March 2011.
- Revkin, Andrew C. (5 August 2003), "Politics Reasserts Itself in the Debate Over Climate Change and Its Hazards", New York Times, retrieved 26 February 2012.
- Mann, Michael E.; Jones, Phil D. (14 August 2003), "Global surface temperatures over the past two millennia" (PDF), Geophysical Research Letters, 30 (15), Bibcode:2003GeoRL..30.1820M, doi:10.1029/2003GL017814.
- Monastersky, Richard (4 September 2003), "Storm Brews Over Global Warming", Chronicle of Higher Education, retrieved 6 March 2011.
- McIntyre, Stephen; McKitrick, Ross (November 2003), "Corrections to the Mann et al. (1998) Proxy Data Base and Northern Hemispheric Average Temperature Series" (PDF), Energy & Environment, 14 (6): 751–771, doi:10.1260/095830503322793632, ISSN 0958-305X ("MM03").
- Tech Central Station (27 October 2003), TCS Newsflash: Important Global Warming Study Audited -- Numerous Errors Found; New Research Reveals the UN IPCC 'Hockey Stick' Theory of Climate Change is Flawed, Business Wire, retrieved 20 September 2012.
- McIntyre, Stephen (28 October 2003), "A. Chronology of Data Correspondence", Climate2003 https://web.archive.org/web/20031211211711/http://www.climate2003.com/file.issues.htm, archived from the original on 11 December 2003, retrieved 10 September 2012 Missing or empty
- McIntyre, Stephen (29 October 2003), Welcome to Climate2003, Climate2003, archived from the original on 29 October 2003, retrieved 10 September 2012.
- Schulz, Nick (28 October 2003), "Researchers question key global-warming study [op-ed]", USA Today, archived from the original on 25 July 2004. [See correction of 13 November.]
- Mann, Michael E.; Bradley, Raymond S.; Hughes, Malcolm K. (3 November 2003), Note on Paper by McIntyre and McKitrick in Energy and Environment (PDF), University of Virginia website, archived from the original (PDF) on 6 November 2003, retrieved 28 November 2012, linked from Comments on McIntyre and McKitrick Paper as archived on 9 December 2003.
- USA Today (13 November 2003), "Corrections & Clarifications" (PDF), USA Today. [Correction to Schulz op-ed of 28 October.]
- Vergano, Dan (18 November 2003), "Global warming debate heats up Capitol Hill", USA Today.
- McIntyre, Stephen; McKitrick, Ross (18 November 2003), The IPCC, the "Hockey Stick" Curve, and the Illusion of Experience (PDF), Washington, D.C.: George C. Marshall Institute Washington Roundtable on Science and Public policy, archived from the original (PDF) on 7 May 2004.
- Mann, Michael E.; Ammann, Caspar M.; Bradley, Ray; Briffa, Keith R.; Jones, Philip D.; Osborn, Tim; Crowley, Tom; Hughes, Malcolm; et al. (2003), "On Past Temperatures and Anomalous Late-20th Century Warmth" (PDF), Eos, Transactions American Geophysical Union, 84 (27): 256, Bibcode:2003EOSTr..84..256M, doi:10.1029/2003EO270003.
- Thompson, L.G.; Mosley-Thompson, E.; Davis, M.E.; Lin, P.-N.; Henderson, K.; Mashiotta, T.A. (2003), "Tropical glacier and ice core evidence of climate change on annual to millennial time scales." (PDF), Climatic Change, 59: 137–155, doi:10.1007/978-94-015-1252-7_8, archived from the original (PDF) on 4 December 2010.
- Briffa, K. R.; Osborn, T. J.; Schweingruber, F. H. (January 2004), "Large-scale temperature inferences from tree rings: A review", Global and Planetary Change, 40 (1–2): 11–26, Bibcode:2004GPC....40...11B, doi:10.1016/S0921-8181(03)00095-X.
- Jones, P. D.; Mann, M. E. (6 May 2004), "Climate over past millennia" (PDF), Reviews of Geophysics, 42 (2), Bibcode:2004RvGeo..42.2002J, doi:10.1029/2003RG000143.
- Pollack, Henry N.; Smerdon, Jason E. (5 June 2004), "Borehole climate reconstructions: Spatial structure and hemispheric averages", Journal of Geophysical Research, 109 (D11106), Bibcode:2004JGRD..10911106P, doi:10.1029/2003JD004163.
- Boykoff, M.; Boykoff, J. (July 2004), "Balance as bias: global warming and the US prestige press1" (PDF), Global Environmental Change Part A, 14 (2): 125–136, doi:10.1016/j.gloenvcha.2003.10.001, archived from the original (PDF) on 6 November 2015.
- Mann, Michael E.; Bradley, Raymond S.; Hughes, Malcolm K. (1 July 2004), "Corrigendum: Global-scale temperature patterns and climate forcing over the past six centuries" (PDF), Nature, 430 (6995): 105–105, Bibcode:2004Natur.430..105M, doi:10.1038/nature02478.
- "Climate legacy of 'hockey stick'". BBC News. 16 July 2004. Retrieved 8 May 2007.
- Mooney, Chris (13 September 2004), "CSI | Déjà vu All Over Again", Skeptical Inquirer, retrieved 4 December 2011.
- Muller, Richard (15 October 2004), Global Warming Bombshell, Technology Review.
- von Storch, Hans; Zorita, Eduardo; Jones, Julie M.; Dimitriev, Yegor; González-Rouco, Fidel; Tett, Simon F. B. (22 October 2004), "Reconstructing Past Climate from Noisy Data", Science, 306 (5696): 679–682, Bibcode:2004Sci...306..679V, doi:10.1126/science.1096109, PMID 15459344.
- Osborn, Timothy J.; Briffa, Keith R. (22 October 2004), "CLIMATE: the Real Color of Climate Change?" (PDF), Science, 306 (5696): 621–622, doi:10.1126/science.1104416, PMID 15459347.
- McIntyre, Stephen (26 October 2004), "Oct. 26, 2004 "SPAGHETTI DIAGRAMS"", Webpage of Stephen McIntyre, Climate2003, archived from the original on 24 January 2005, retrieved 10 September 2012.
- Cook, Edward R.; Esper, Jan; D'Arrigo, Rosanne D. (November 2004), "Extra-tropical Northern Hemisphere land temperature variability over the past 1000 years", Quaternary Science Reviews, 23 (20–22): 2063–2074, Bibcode:2004QSRv...23.2063C, doi:10.1016/j.quascirev.2004.08.013.
- Inhofe, James M. (4 January 2005), Climate Change Update Senate Floor Statement, U.S. Senator James M. Inhofe, archived from the original on 12 January 2005, retrieved 7 March 2011.
- Mann, Michael; Rahmstorf, Stefan; Schmidt, Gavin; Steig, Eric; Connolley, William (10 January 2005), Senator Inhofe on Climate Change, RealClimate, retrieved 7 March 2011.
- Mooney, Chris (11 January 2005), Warmed Over, CBS News, retrieved 7 March 2011. Reprinted from The American Prospect, 10 January 2005.
- Crok, Marcel (January 2005), Proof that mankind causes climate change is refuted, Kyoto protocol based on flawed statistics (PDF), Natuurwetenschap & Techniek, retrieved 29 November 2012, 1 February 2005 issue, online publication linked from Climate Audit on 27 January.
- Crok, Marcel (27 January 2005), Breaking the hockey stick, National Post, archived from the original on 20 August 2011, retrieved 29 November 2012.
- McIntyre, Steve (3 February 2005), "Climateaudit", Climate Audit, Climate Audit, archived from the original on 4 February 2005, retrieved 10 September 2012.
- Moberg, Anders; Sonechkin, Dmitry M.; Holmgren, Karin; Datsenko, Nina M.; Karlén, Wibjörn; Lauritzen, S. E. (10 February 2005), "Highly variable Northern Hemisphere temperatures reconstructed from low- and high-resolution proxy data", Nature, 433 (7026): 613–617, Bibcode:2005Natur.433..613M, doi:10.1038/nature03265, PMID 15703742. Corrigendum: Moberg et al. 2006.
- McIntyre, Stephen; McKitrick, Ross (12 February 2005), "Hockey sticks, principal components, and spurious significance", Geophysical Research Letters, 32 (3): L03710, Bibcode:2005GeoRL..32.3710M, doi:10.1029/2004GL021750.
- McKitrick, R.; McIntyre, S. (2005), "The M&M Critique of the MBH98 Northern Hemisphere Climate Index: Update and Implications" (PDF), Energy & Environment, 16: 69–100, doi:10.1260/0958305053516226, archived from the original (PDF) on 25 March 2005.
- Regalado, Antonio (14 February 2005), "In Climate Debate, The 'Hockey Stick' Leads to a Face-Off", Wall Street Journal[dead link].
- Schmidt, Gavin; Ammann, Caspar (18 February 2005), Dummies guide to the latest "Hockey Stick" controversy, RealClimate, retrieved 7 March 2011.
- Appell, David (21 February 2005), "Behind the Hockey Stick", Scientific American [webpage], retrieved 7 March 2011CS1 maint: extra punctuation (link).
- Said, Yasmin H. (2005), Agent-Based Simulation of Ecological Alcohol Systems, A dissertation submitted in partial fulfillment of the requirements for the degree of Doctorate of Philosophy at George Mason University (PDF), George Mason University, archived from the original (PDF) on 5 September 2006 (Spring Semester 2005).
- Rincon, Paul (16 March 2005). "Row over climate 'hockey stick'". BBC News. Retrieved 4 March 2011.
- McKitrick, Ross (4 April 2005), "What is the 'Hockey Stick' Debate About?", (PDF), Managing Climate Change—Practicalities and Realities in a Post-Kyoto Future, Parliament House, Canberra Australia: Australia Asia Pacific Economic Cooperation Study Centre https://web.archive.org/web/20060919154910/http://www.uoguelph.ca/~rmckitri/research/APEC-hockey.pdf, Archived from the original on 19 September 2006 Missing or empty
|title=(help)CS1 maint: BOT: original-url status unknown (link) ().
- Oerlemans, J. (29 April 2005), "Extracting a Climate Signal from 169 Glacier Records" (PDF), Science, 308 (5722): 675–677, Bibcode:2005Sci...308..675O, doi:10.1126/science.1107046, PMID 15746388.
- Revkin, Andrew C. (8 June 2005), "Bush Aide Softened Greenhouse Gas Links to Global Warming", The New York Times, retrieved 29 January 2013.
- Media Advisory: The Hockey Stick Controversy - New Analysis Reproduces Graph of Late 20th Century Temperature Rise, University Corporation for Atmospheric Research, 11 May 2005, archived from the original on 27 December 2005, retrieved 4 March 2011.
- House Committee on Energy and Commerce (23 June 2005), Letters Requesting Information Regarding Global Warming Studies, United States House Committee on Energy and Commerce, archived from the original on 28 June 2005, retrieved 4 March 2011.
- Barton, Joe; Whitfield, Ed (23 June 2005), Letter to Dr. Michael Mann (PDF), United States House Committee on Energy and Commerce, archived from the original (PDF) on 7 February 2012, retrieved 4 March 2011.
- Waxman, Henry A. (1 July 2005), Letter to Chairman Barton (PDF), henrywaxman.house.gov, archived from the original (PDF) on 7 October 2009.
- Monastersky, Richard (1 July 2005), "Congressman Demands Complete Records on Climate Research by 3 Scientists Who Support Theory of Global Warming", The Chronicle of Higher Education, retrieved 4 March 2011.
- Leshner, Alan I. (13 July 2005), Letter to Joe Barton (PDF).
- Mann, Michael E. (15 July 2005), Letter to Chairman Barton and Chairman Whitfield (PDF), RealClimate, archived from the original (PDF) on 27 July 2011, retrieved 4 March 2011.
- Twenty scientists (15 July 2005), Letter to Chairman Barton and Chairman Whitfield (PDF), RealClimate, archived from the original (PDF) on 27 July 2011.
- Schmidt, Gavin; Rahmstorf, Stefan (18 July 2005), Scientists respond to Barton, RealClimate, retrieved 4 March 2011.
- Eilperin, Juliet (18 July 2005), "GOP Chairmen Face Off on Global Warming", Washington Post.
- Pease, Roland (18 July 2005). "Politics plays climate 'hockey'". BBC News. Retrieved 4 March 2011.
- Editorial (23 July 2005), "Hunting Witches", Washington Post.
- Milloy, Steven (31 July 2005). "Tree Ring Circus - Opinion - FOXNews.com". Fox News. Archived from the original on 8 February 2011. Retrieved 9 March 2011.
- Rutherford, S.; Mann, Michael E.; Osborn, T. J.; Briffa, Keith R.; Jones, Phil D.; Bradley, Raymond S.; Hughes, Malcolm K. (July 2005), "Proxy-Based Northern Hemisphere Surface Temperature Reconstructions: Sensitivity to Method, Predictor Network, Target Season, and Target Domain" (PDF), Journal of Climate, 18 (13): 2308–2329, Bibcode:2005JCli...18.2308R, doi:10.1175/JCLI3351.1.
- Huybers, P. (21 October 2005), "Comment on "Hockey sticks, principal components, and spurious significance" by S. McIntyre and R. McKitrick" (PDF), Geophysical Research Letters, 32 (L20705), Bibcode:2005GeoRL..3220705H, doi:10.1029/2005GL023395, archived from the original (PDF) on 3 May 2013.
- von Storch, Hans; Zorita, Eduardo (21 October 2005), "Comment on "Hockey sticks, principal components, and spurious significance" by S. McIntyre and R. McKitrick" (PDF), Geophysical Research Letters, 32 (L20701), Bibcode:2005GeoRL..3220701V, doi:10.1029/2005GL022753, archived from the original (PDF) on 9 March 2012.
- Thacker, Paul D. (31 October 2005), "Skeptics get a journal" (PDF), Environmental Science & Technology, 39 (21): 432A–437A, Bibcode:2005EnST...39..432P, doi:10.1021/es053378b, PMID 16294841.
- Thacker, Paul D. (1 November 2005), "How a global-warming skeptic became famous", Environmental Science & Technology, 39 (21): 436A–437A, Bibcode:2005EnST...39..432P, doi:10.1021/es053378b, PMID 16294841.
- Bürger, G.; Cubasch, U. (14 December 2005), "Are multiproxy climate reconstructions robust?", Geophysical Research Letters, 32 (23), Bibcode:2005GeoRL..3223711B, doi:10.1029/2005GL024155.
- D'Arrigo, Rosanne; Wilson, Rob; Jacoby, Gordon (7 February 2006), "On the long-term context for late twentieth century warming", Journal of Geophysical Research, 111 (D03103), Bibcode:2006JGRD..11103103D, doi:10.1029/2005JD006352.
- Osborn, Timothy J.; Briffa, Keith R. (10 February 2006), "The Spatial Extent of 20th-Century Warmth in the Context of the Past 1200 Years" (PDF), Science, 311 (5762): 841–844, Bibcode:2006Sci...311..841O, doi:10.1126/science.1120514, PMID 16469924.
- Regalado, Antonio (10 February 2006), "Academy to Referee Climate-Change Fight", Wall Street Journal, retrieved 30 January 2013.
- Moberg, Anders; Sonechkin, Dimitry M.; Holmgren, Karin; Datsenko, Nina M.; Karlén, Wibjörn; Lauritzen, Stein-Erik (23 February 2006), "Corrigendum: Highly variable Northern Hemisphere temperatures reconstructed from low- and high-resolution proxy data", Nature, 439 (7079): 1014, Bibcode:2006Natur.439.1014M, doi:10.1038/nature04575.
- Hegerl, Gabriele C.; Crowley, Thomas J.; Hyde, William T.; Frame, David J. (20 April 2006), "Climate sensitivity constrained by temperature reconstructions over the past seven centuries", Nature, 440 (7087): 1029–1032, Bibcode:2006Natur.440.1029H, doi:10.1038/nature04679, PMID 16625192.
- Wahl, Eugene R.; Ritson, David M.; Ammann, Casper M. (28 April 2006), "Comment on 'Reconstructing Past Climate from Noisy Data'" (PDF), Science, 312 (5773): 529b–529b, doi:10.1126/science.1120866, PMID 16645079.
- Smith, Claire L.; Baker, Andy; Fairchild, Ian J.; Frisia, Silvia; Borsato, Andrea (3 May 2006), "Reconstructing hemispheric-scale climates from multiple stalagmite records", International Journal of Climatology, 26 (10): 1417–1424, Bibcode:2006IJCli..26.1417S, doi:10.1002/joc.1329, Figure 1.
- Gore, Al (26 May 2006), An inconvenient truth: the planetary emergency of global warming and what we can do about it, London: Bloomsbury, pp. 63–65, ISBN 0-7475-8906-2,
Rodale Books; First Edition (May 26, 2006).
- Hoke, Greg (2006), "An Inconvenient Truth - Transcript", Ice Cores: The 650,000 Record, archived from the original on 5 November 2006, retrieved 7 March 2011.
- "[Audio recording of National Academies press conference]". The National Academies. 22 June 2006. Real Audio or mp3 download.
- North, Gerald R.; Biondi, Franco; Bloomfield, Peter; Christy, John R.; Cuffey, Kurt M.; Dickinson, Robert E.; Druffel, Ellen R. M.; Nychka, Douglas; Otto-Bliesner, B.; Roberts, N.; Turekian, K.; Wallace, J. (22 June 2006), Surface temperature reconstructions for the last 2,000 years, Washington, D.C.: National Academies Press, ISBN 0-309-10225-1. (North Report).
- Office of News and Public Information (22 June 2006), 'High Confidence' That Planet Is Warmest in 400 Years, The National Academies, retrieved 18 August 2012.
- Boehlert, Sherwood (22 June 2006), Statement by Science Committee Chairman Sherwood Boehlert (R-NY) regarding the National Academy of Sciences Report, Surface Temperature Reconstructions for the Last 2,000 Years: (PDF), Committee on Science - U.S. House of Representatives, archived from the original (PDF) on 29 June 2006, retrieved 7 September 2012.
- RealClimate (22 June 2006), National Academies Synthesis Report, RealClimate, retrieved 1 August 2010.
- Revkin, Andrew C. (22 June 2006), "Science Panel Backs Study on Warming Climate", New York Times.
- Pielke, Roger, Jr. (22 June 2006), "Quick Reaction to the NRC Hockey Stick Report", Prometheus: The Science Policy Blog (CIRES), archived from the original on 3 July 2010, retrieved 5 October 2012. (Announcement of North et al. 2006.)
- von Storch, Hans; Zorita, Eduardo (22 June 2006), Press release and comment on the NAS report "Surface Temperature Reconstructions for the last 200 Years".
- Heilprin, John (22 June 2006 (updated 23 June 2006)). "Study: Earth is hottest now in 2,000 years; humans responsible for much of the warming". USA Today. Retrieved 6 September 2012. Check date values in:
- "Backing for 'hockey stick' graph". BBC News. 23 June 2006. Retrieved 6 September 2012..
- Daley, Beth (23 June 2006), "National panel supports '98 global warming evidence", The Boston Globe, retrieved 18 August 2012.
- NewsMax.com (23 June 2006), Sen. Inhofe: NAS Report Refutes Global Warming Theory, Newsmax Media, archived from the original on 29 January 2013, retrieved 7 September 2012.
- Regalado, Antonio (23 June 2006), "Panel Study Fails To Settle Debate On Past Climates", Wall Street Journal.
- Brumfiel, Geoff (29 June 2006), "Academy affirms hockey-stick graph", Nature, 441 (7097): 1032–3, Bibcode:2006Natur.441.1032B, doi:10.1038/4411032a, PMID 16810211.
- Rahmstorf, Stefan (30 June 2006), "Testing Climate Reconstructions" (PDF), Science, 312 (5782): 1872–1873, doi:10.1126/science.312.5782.1872b, PMID 16809508.
- Editorial (14 July 2006), "Hockey Stick Hokum", Wall Street Journal.
- Mongabay.com (16 July 2006), War of words over new climate change report, 'hockey stick' model: Leading scientist says House climate report is "politicized", Mongabay.com, archived from the original on 7 May 2013.
- U.S. House Committee on Energy and Commerce — Press Office (), Report Raises New Questions About Climate Change Assessments (PDF), archived from the original (PDF) on 2006-07-19 Check date values in:
|date=(help)CS1 maint: extra punctuation (link).
- Wegman, Edward J.; Said, Yasmin H.; Scott, David W. (2006), "Ad Hoc Committee Report On The 'Hockey Stick' Global Climate Reconstruction" (PDF), Congressional Report, United States House Committee on Energy and Commerce (published 14 July 2006), archived from the original (PDF) on 16 July 2006, retrieved 22 October 2012 (View static 404 page) Check date values in:
|accessdate=(help) (Wegman Report).
- Quiggin, John (15 July 2006), Adventures in social network analysis, Crooked Timber, retrieved 1 August 2010.
- RealClimate (19 July 2006), The missing piece at the Wegman hearing, RealClimate, retrieved 1 August 2010.
- House Committee on Energy and Commerce (19 and 27 July 2006), "Questions surrounding the 'Hockey stick' temperature studes; implications for climate change assessments", Hearings before the Subcommittee on Oversight and Investigations of the Committee on Energy and Commerce, 109th Congress, Second session, U.S. Government Printing Office, retrieved 2010-08-01 Check date values in:
|date=(help) (154 MB PDF).
- Bradley, Raymond S.; Hughes, Malcolm K.; Mann, Michael E. (10 August 2006), "Authors were clear about hockey-stick uncertainties", Nature, 442 (7103): 627, Bibcode:2006Natur.442..627B, doi:10.1038/442627b, PMID 16900179.
- Ritson, David (16 August 2006), letter to Congressman Henry Waxman (PDF), retrieved 10 February 2013, enclosure: e-mailed requests.
- North, Gerald (29 August 2006), "Surface Temperature Reconstructions for the Last Millennium", seminar at Texas A&M University, archived from the original (mp4 audio and presentation) on 7 March 2012, retrieved 12 February 2012.
- Monastersky, Richard (moderator) (6 September 2006), "A Scientific Graph Stands Trial", The Chronicle of Higher Education — Live Discussions, archived from the original on 30 September 2007.
- Monastersky, Richard (8 September 2006), "Climate Science on Trial", The Chronicle of Higher Education, retrieved 6 March 2011.
- Pearce, Fred (4 November 2006), Climate change special: State of denial - environment, New Scientist, retrieved 30 October 2012.
- von Storch, Hans; Zorita, Eduardo (3 May 2007), Climate Feedback: The decay of the hockey stick, Nature Climate Change [blog], retrieved 7 March 2011CS1 maint: extra punctuation (link).
- McIntyre, Steve (3 May 2007), "von Storch and Zorita blog on the Hockey Stick", Climate Audit, Climate Audit, retrieved 1 August 2010.
- Heffernan, Olive (3 May 2007), Hans von Storch and Eduardo Zorita on the Hockey stick effect, Blogs.nature.com, retrieved 1 August 2010.,
- Heffernan, Olive (3 May 2007), Hans von Storch, Blogs.nature.com, retrieved 1 August 2010.
- Ammann, C. M.; Wahl, E. R. (24 August 2007), "The importance of the geophysical context in statistical evaluations of climate reconstruction procedures" (PDF), Climatic Change, 85: 71–88, doi:10.1007/s10584-007-9276-x.
- Wahl, Eugene R.; Ammann, Caspar M. (31 August 2007), "Robustness of the Mann, Bradley, Hughes reconstruction of Northern Hemisphere surface temperatures: Examination of criticisms based on the nature and processing of proxy climate evidence" (PDF), Climatic Change, 85 (1–2): 33–69, doi:10.1007/s10584-006-9105-7.
- Said, Yasmin H. (7 September 2007), "Experiences with Congressional Testimony: Statistics and The Hockey Stick", Data and Statistical Sciences Colloquium Series (PDF), George Mason University, archived from the original (PDF) on 16 February 2010.
- Juckes, M. N.; Allen, M. R.; Briffa, K. R.; Esper, J.; Hegerl, G. C.; Moberg, Anders; Osborn, T. J.; Weber, S. L. (5 October 2007), "Millennial temperature reconstruction intercomparison and evaluation" (PDF), Climate of the Past, 3 (4): 591–609, doi:10.5194/cp-3-591-2007.
- Waxman, Henry (12 December 2007), "Committee Report: White House Engaged in Systematic Effort to Manipulate Climate Change Science", Committee on Oversight and Government Reform, United States House of Representatives, retrieved 9 December 2011 Report pp. 21–25.
- Jansen; et al. (2007), "Chapter 6: Palaeoclimate", archived from the original on 28 November 2011 Missing or empty
|title=(help), in IPCC AR4 WG1 2007.
- IPCC AR4 WG1 (2007), Solomon, S.; Qin, D.; Manning, M.; Chen, Z.; Marquis, M.; Avery, K.B.; Tignor, M.; Miller, H.L. (eds.), Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 978-0-521-88009-1 (pb: 978-0-521-70596-7).
- Said, Yasmin H.; Wegman, Edward J.; Sharabati, Walid K.; Rigsby, John T. (January 2008), "Social networks of author–coauthor relationships", Computational Statistics & Data Analysis, 51 (4): 2177–2184, doi:10.1016/j.csda.2007.07.021. Retracted.
- Huang, S.; Pollack, H. N.; Shen, P. Y. (4 July 2008), "A late Quaternary climate reconstruction based on borehole heat flux data, borehole temperature data, and the instrumental record" (PDF), Geophysical Research Letters, 35 (L13703): L13703, Bibcode:2008GeoRL..3513703H, doi:10.1029/2008GL034187, archived from the original (PDF) on 27 February 2012.
- Lee, Terry C. K.; Zwiers, Francis W.; Tsao, Min (1 August 2008), "Evaluation of proxy-based millennial reconstruction methods", Climate Dynamics, 31 (2–3): 263–281, Bibcode:2008ClDy...31..263L, doi:10.1007/s00382-007-0351-9.
- Black, Richard (1 September 2008). "Climate 'hockey stick' is revived". BBC News. Retrieved 18 May 2011.
- Mann, Michael E.; Zhang, Zhihua; Hughes, Malcolm K.; Bradley, Raymond S.; Miller, Sonya K.; Rutherford, Scott; Ni, Fenbiao (9 September 2008), "Proxy-based reconstructions of hemispheric and global surface temperature variations over the past two millennia", Proceedings of the National Academy of Sciences of the United States of America, 105 (36): 13252–13257, Bibcode:2008PNAS..10513252M, doi:10.1073/pnas.0805721105, PMC 2527990, PMID 18765811.
- Muller, Richard (2008), Physics for future presidents: the science behind the headlines, New York, NY: W.W. Norton & Co., ISBN 978-0-393-06627-2.
- Weart, Spencer R. (2008), The Discovery of Global Warming (revised ed.), Harvard University Press, ISBN 0-674-03189-X. Provides an overview of The Discovery of Global Warming website.
- Jones, Phil D.; Briffa, Keith R.; Osborn, T. J.; Lough, J. M.; van Ommen, T. D.; Vinther, B. M.; Luterbacher, J.; Wahl, Eugene R.; et al. (February 2009), "High-resolution palaeoclimatology of the last millennium: a review of current status and future prospects" (PDF), The Holocene, 19 (1): 3–49, doi:10.1177/0959683608098952.
- McIntyre, Stephen; McKitrick, Ross (February 2009), "Proxy inconsistency and other problems in millennial paleoclimate reconstructions", Proc. Natl. Acad. Sci. U.S.A., 106 (6): E10, author reply E11, Bibcode:2009PNAS..106...10M, doi:10.1073/pnas.0812509106, PMC 2647809, PMID 19188613.
- Mann, Michael E.; Bradley, Raymond S.; Hughes, Malcolm K. (10 February 2009), "Reply to McIntyre and McKitrick: Proxy-based temperature reconstructions are robust", Proc. Natl. Acad. Sci. U.S.A., 106 (6): E11, Bibcode:2009PNAS..106...11M, doi:10.1073/pnas.0812936106, PMC 2644169.
- Arctic Warming Overtakes 2,000 Years of Natural Cooling, University Corporation for Atmospheric Research, 3 September 2009, archived from the original on 27 April 2011, retrieved 19 May 2011.
- Bello, David (4 September 2009), "Global Warming Reverses Long-Term Arctic Cooling", Scientific American [webpage], retrieved 19 May 2011CS1 maint: extra punctuation (link).
- Kaufman, Darrel; Schneider, David P.; McKay, Nicholas P.; Ammann, Caspar M.; Bradley, Raymond S.; Briffa, Keith R.; Miller, Gifford H.; Otto-Bliesner, Bette L.; Overpeck, Jonathan T.; Vinther, Bo M.; Arctic Lakes 2k Project Members (4 September 2009), "Recent warming reverses long-term arctic cooling" (PDF), Science, 325 (5945): 1236–1239, Bibcode:2009Sci...325.1236K, doi:10.1126/science.1173983, PMID 19729653.
- Appell, David (28 October 2009), "Novel Analysis Confirms Climate "Hockey Stick" Graph", Scientific American [webpage], retrieved 27 May 2011CS1 maint: extra punctuation (link).
- Hickman, Leo (20 November 2009), "Climate sceptics claim leaked emails are evidence of collusion among scientists", The Guardian, London.
- Communications Office (23 November 2009), Climatic Research Unit update - 17.45 November 23, University of East Anglia, archived from the original on 2 December 2009, retrieved 2012-03-08.
- Communications Office (24 November 2009), CRU update 2, University of East Anglia, archived from the original on 11 December 2009, retrieved 7 March 2011.
- Johnson, Keith; Naik, Gautam (24 November 2009), "Lawmakers Probe Climate Emails", Wall Street Journal, archived from the original on 25 November 2009.
- Mann, Michael E.; Zhang, Zhihua; Rutherford, Scott; Bradley, Raymond S.; Hughes, Malcolm K.; Shindell, Ddrew; Ammann, Caspar M.; Faluvegi, Greg; et al. (27 November 2009), "Global Signatures and Dynamical Origins of the Little Ice Age and Medieval Climate Anomaly" (PDF), Science, 326 (5957): 1256–1260, Bibcode:2009Sci...326.1256M, doi:10.1126/science.1177303, PMID 19965474.
- Nature editorial (3 December 2009), "Climatologists under pressure", Nature, 462 (7273): 545, Bibcode:2009Natur.462..545., doi:10.1038/462545a, PMID 19956212.
- Borenstein, Seth (3 December 2009), "Business & Technology : Obama science advisers grilled over hacked e-mails", Seattle Times Newspaper, retrieved 11 December 2012.
- Michaels, Pat (18 December 2009), "How to Manufacture a Climate Consensus", Wall Street Journal.
- von Storch, Hans (22 December 2009), "Good Science, Bad Politics", Wall Street Journal.
- Mann, Michael E. (31 December 2009), "Science Must Be Unpolluted by Politics", Wall Street Journal.
- Weart, Spencer R. (December 2009), "Climate over Millennia (Hockey Stick graph)", The Discovery of Global Warming, retrieved 6 March 2011.
- Pearce, Fred (9 February 2010), "Part two: How the 'climategate' scandal is bogus and based on climate sceptics' lies", Environment, The Guardian, London, retrieved 8 March 2012.
- Pearce, Fred (9 February 2010), "Part three: Hockey stick graph took pride of place in IPCC report, despite doubts", Environment, The Guardian, London, retrieved 8 March 2012.
- Pearce, Fred (9 February 2010), "Part four: Climate change debate overheated after sceptics grasped 'hockey stick'", Environment, The Guardian, London, retrieved 8 March 2010.
- Tingley, Martin P.; Huybers, Peter (May 2010), "A Bayesian Algorithm for Reconstructing Climate Anomalies in Space and Time. Part I: Development and Applications to Paleoclimate Reconstruction Problems", Journal of Climate, 23 (10): 2759–2781, Bibcode:2010JCli...23.2759T, doi:10.1175/2009JCLI3015.1.
- Tingley, Martin P.; Huybers, Peter (May 2010), "A Bayesian Algorithm for Reconstructing Climate Anomalies in Space and Time. Part II: Comparison with the Regularized Expectation–Maximization Algorithm", Journal of Climate, 23 (10): 2782–2800, Bibcode:2010JCli...23.2782T, doi:10.1175/2009JCLI3016.1.
- Frank, David; Esper, Jan; Zorita, Eduardo; Wilson, Rob (14 May 2010), "A noodle, hockey stick, and spaghetti plate: A perspective on high-resolution paleoclimatology", Wiley Interdisciplinary Reviews: Climate Change, 1 (4): 507–516, doi:10.1002/wcc.53.
- Russell, Sir Muir; Boulton, Geoffrey; Clark, Peter; Eyton, David; Norton, James (7 July 2010), The Independent Climate Change E-mails Review (PDF) "ICCER".
- Chameides, Bill (30 August 2010), "Climategate Redux", Scientific American [webpage], retrieved 4 March 2012CS1 maint: extra punctuation (link).
- Ljungqvist, F. C. (September 2010), "A New Reconstruction of Temperature Variability in the Extra-Tropical Northern Hemisphere During the Last Two Millennia" (PDF), Geografiska Annaler: Series A, Physical Geography, 92 (3): 339–351, doi:10.1111/j.1468-0459.2010.00399.x.
- Vergano, Dan (8 October 2010), "University investigating prominent climate science critic", USA Today.
- Vergano, Dan (22 November 2010), "Experts claim 2006 climate report plagiarized", USA Today.
- Pearce, Fred (2010), The Climate Files: The Battle for the Truth About Global Warming, Random House UK, ISBN 0-85265-229-1.
- Vergano, Dan (15 May 2011), "Climate study gets pulled after charges of plagiarism", USA Today.
- Vergano, Dan (16 May 2011), "Retracted climate critics' study panned by expert", USA Today.
- Nature editorial (26 May 2011), "Copy and paste", Nature, 473 (7348): 419–420, Bibcode:2011Natur.473R.419., doi:10.1038/473419b, PMID 21614031.
- Kintisch, Eli (2 June 2011), Journal Retracts Disputed Network Analysis Paper on Climate, ScienceInsider, archived from the original on 7 June 2011.
- Weart, Spencer R. (2003–2011), The Discovery of Global Warming (website), American Institute of Physics. Chapters are available as pdf files.
- Weart, Spencer R. (February 2011), "Modern Temperature Trend", The Discovery of Global Warming, retrieved 6 March 2011. Available as a pdf.
- Weart, Spencer R. (February 2011), "The Carbon Dioxide Greenhouse Effect", The Discovery of Global Warming, retrieved 6 March 2011. Available as a pdf.
- Weart, Spencer R. (December 2011), "Government: The View from Washington, DC", The Discovery of Global Warming, retrieved 6 March 2011. Available as a pdf.
- Christiansen, B.; Ljungqvist, F. C. (December 2011), "Reconstruction of the Extratropical NH Mean Temperature over the Last Millennium with a Method that Preserves Low-Frequency Variability", Journal of Climate, 24 (23): 6013–6034, Bibcode:2011JCli...24.6013C, doi:10.1175/2011JCLI4145.1. (reply to comments by A. Moberg)
- Ljungqvist, F. C.; Krusic, P. J.; Brattström, G.; Sundqvist, H. S. (3 February 2012), "Northern Hemisphere temperature patterns in the last 12 centuries", Climate of the Past, 8: 227–249, Bibcode:2012CliPa...8..227L, doi:10.5194/cp-8-227-2012.
- Vergano, Dan (22 February 2012), "University reprimands climate science critic for plagiarism", USA Today.
- Mann, Michael E. (6 March 2012), The Hockey Stick and the Climate Wars: Dispatches from the Front Lines, Columbia University Press, ISBN 978-0-231-15254-9.
- Christiansen, B.; Ljungqvist, F. C. (18 April 2012), "The extra-tropical Northern Hemisphere temperature in the last two millennia: Reconstructions of low-frequency variability" (PDF), Climate of the Past, 8 (2): 765–786, Bibcode:2012CliPa...8..765C, doi:10.5194/cp-8-765-2012.
- Connor, Steve (24 January 2013), "How the 'Kochtopus' stifled green debate - Climate Change - Environment", The Independent.
- Lemonick, Michael D. (7 March 2013), Climate to Warm Beyond Levels Seen for 11,300 Years, Climate Central, retrieved 10 March 2013.
- Gillis, Justin (7 March 2013), "Global Temperatures Highest in 4,000 Years, Study Says - NYTimes.com", New York Times, retrieved 10 March 2013.
- Marcott, S. A.; Shakun, J. D.; Clark, P. U.; Mix, A. C. (8 March 2013), "A Reconstruction of Regional and Global Temperature for the Past 11,300 Years", Science, 339 (6124): 1198–1201, Bibcode:2013Sci...339.1198M, doi:10.1126/science.1228026, PMID 23471405.
- PAGES 2k Consortium (21 April 2013), "Continental-scale temperature variability during the past two millennia", Nature Geoscience, 6 (5): 339–346, Bibcode:2013NatGe...6..339P, doi:10.1038/ngeo1797 (78 researchers, corresponding author Darrell S. Kaufman).