The scientific method is an empirical method of acquiring knowledge that has characterized the development of science since at least the 17th century (with notable practitioners in previous centuries). It involves careful observation, applying rigorous skepticism about what is observed, given that cognitive assumptions can distort how one interprets the observation. It involves formulating hypotheses, via induction, based on such observations; experimental and measurement-based testing of deductions drawn from the hypotheses; and refinement (or elimination) of the hypotheses based on the experimental findings. These are principles of the scientific method, as distinguished from a definitive series of steps applicable to all scientific enterprises.
Although procedures vary from one field of inquiry to another, the underlying process is frequently the same from one field to another. The process in the scientific method involves making conjectures (hypothetical explanations), deriving predictions from the hypotheses as logical consequences, and then carrying out experiments or empirical observations based on those predictions.[a] A hypothesis is a conjecture, based on knowledge obtained while seeking answers to the question. The hypothesis might be very specific, or it might be broad. Scientists then test hypotheses by conducting experiments or studies. A scientific hypothesis must be falsifiable, implying that it is possible to identify a possible outcome of an experiment or observation that conflicts with predictions deduced from the hypothesis; otherwise, the hypothesis cannot be meaningfully tested.
The purpose of an experiment is to determine whether observations[A][a][b] agree with or conflict with the expectations deduced from a hypothesis.: Book I, [6.54] pp.372, 408 [b] Experiments can take place anywhere from a garage to CERN's Large Hadron Collider. There are difficulties in a formulaic statement of method, however. Though the scientific method is often presented as a fixed sequence of steps, it represents rather a set of general principles. Not all steps take place in every scientific inquiry (nor to the same degree), and they are not always in the same order.
Important debates in the history of science concern skepticism that anything can be known for sure (such as views of Francisco Sanches), rationalism (especially as advocated by René Descartes), inductivism, empiricism (as argued for by Francis Bacon, then rising to particular prominence with Isaac Newton and his followers), and hypothetico-deductivism, which came to the fore in the early 19th century.
The term "scientific method" emerged in the 19th century, when a significant institutional development of science was taking place and terminologies establishing clear boundaries between science and non-science, such as "scientist" and "pseudoscience", appeared. Throughout the 1830s and 1850s, at which time Baconianism was popular, naturalists like William Whewell, John Herschel, John Stuart Mill engaged in debates over "induction" and "facts" and were focused on how to generate knowledge. In the late 19th and early 20th centuries, a debate over realism vs. antirealism was conducted as powerful scientific theories extended beyond the realm of the observable.
- Problem-solving via scientific method
- See Notes section § Problem-solving via scientific method
The term "scientific method" came into popular use in the twentieth century; Dewey 1910, How We Think inspired popular guidelines, popping up in dictionaries and science textbooks, although there was little scientific consensus over its meaning. Although there was growth through the middle of the twentieth century, by the 1960s and 1970s numerous influential philosophers of science such as Thomas Kuhn and Paul Feyerabend had questioned the universality of the "scientific method" and in doing so largely replaced the notion of science as a homogeneous and universal method with that of it being a heterogeneous and local practice. In particular, Paul Feyerabend, in the 1975 first edition of his book Against Method, argued against there being any universal rules of science; Popper 1963, Gauch 2003, and Tow 2010 disagree with Feyerabend's claim; problem solvers, and researchers are to be prudent with their resources during their inquiry.[B][c]
Later stances include physicist Lee Smolin's 2013 essay "There Is No Scientific Method", in which he espouses two ethical principles,[e] and historian of science Daniel Thurs's chapter in the 2015 book Newton's Apple and Other Myths about Science, which concluded that the scientific method is a myth or, at best, an idealization. As myths are beliefs, they are subject to the narrative fallacy as Taleb points out. Philosophers Robert Nola and Howard Sankey, in their 2007 book Theories of Scientific Method, said that debates over scientific method continue, and argued that Feyerabend, despite the title of Against Method, accepted certain rules of method and attempted to justify those rules with a meta methodology. Staddon (2017) argues it is a mistake to try following rules in the absence of an algorithmic scientific method; in that case, "science is best understood through examples".[f] But algorithmic methods, such as disproof of existing theory by experiment have been used since Alhacen (1027) Book of Optics,[b] and Galileo (1638) Two New Sciences, still stand as scientific method, which contradicts Feyerabend's stance. [C][D]
The ubiquitous element in the scientific method is empiricism. This is in opposition to stringent forms of rationalism: the scientific method embodies the position that reason alone cannot solve a particular scientific problem. A strong formulation of the scientific method is not always aligned with a form of empiricism in which the empirical data is put forward in the form of experience or other abstracted forms of knowledge; in current scientific practice, however, the use of scientific modelling and reliance on abstract typologies and theories is normally accepted. The scientific method counters claims that revelation, political or religious dogma, appeals to tradition, commonly held beliefs, common sense, or currently held theories pose the only possible means of demonstrating truth.
Different early expressions of empiricism and the scientific method can be found throughout history, for instance with the ancient Stoics, Epicurus, Alhazen,[E] Avicenna, Roger Bacon, and William of Ockham. From the 16th century onwards, experiments were advocated by Francis Bacon, and performed by Giambattista della Porta, Johannes Kepler,[i] and Galileo Galilei.[j] There was particular development aided by theoretical works by Francisco Sanches, John Locke, George Berkeley, and David Hume.
A sea voyage from America to Europe afforded C. S. Peirce the distance to clarify his ideas,[F] gradually resulting in the hypothetico-deductive model. Formulated in the 20th century, the model has undergone significant revision since first proposed (for a more formal discussion, see § Elements of the scientific method).
The scientific method is the process by which science is carried out. As in other areas of inquiry, science (through the scientific method) can build on previous knowledge and develop a more sophisticated understanding of its topics of study over time.[k] This model can be seen to underlie the scientific revolution.
The overall process involves making conjectures (hypotheses), deriving predictions from them as logical consequences, and then carrying out experiments based on those predictions to determine whether the original conjecture was correct. There are difficulties in a formulaic statement of method, however. Though the scientific method is often presented as a fixed sequence of steps, these actions are better considered as general principles. Not all steps take place in every scientific inquiry (nor to the same degree), and they are not always done in the same order. As noted by scientist and philosopher William Whewell (1794–1866), "invention, sagacity, [and] genius" are required at every step.
Formulation of a question
The question can refer to the explanation of a specific observation,[A] as in "Why is the sky blue?" but can also be open-ended, as in "How can I design a drug to cure this particular disease?" This stage frequently involves finding and evaluating evidence from previous experiments, personal scientific observations or assertions, as well as the work of other scientists. If the answer is already known, a different question that builds on the evidence can be posed. When applying the scientific method to research, determining a good question can be very difficult and it will affect the outcome of the investigation.
A hypothesis is a conjecture, based on knowledge obtained while formulating the question, that may explain any given behavior. The hypothesis might be very specific; for example, Einstein's equivalence principle or Francis Crick's "DNA makes RNA makes protein",[l] or it might be broad; for example, "unknown species of life dwell in the unexplored depths of the oceans". See § Hypothesis development
A statistical hypothesis is a conjecture about a given statistical population. For example, the population might be people with a particular disease. One conjecture might be that a new drug will cure the disease in some of the people in that population, as in a clinical trial of the drug. A null hypothesis would conjecture that the statistical hypothesis is false; for example, that the new drug does nothing, and that any cure in the population would be caused by chance (a random variable).
An alternative to the null hypothesis, to be falsifiable, must say that a treatment program with the drug does better than chance. To test the statement a treatment program with the drug does better than chance, an experiment is designed in which a portion of the population (the control group), is to be left untreated, while another, separate portion of the population is to be treated. t-Tests could then specify how large the treated groups, and how large the control groups are to be, in order to infer whether some course of treatment of the population has resulted in a cure of some of them, in each of the groups.[m] The groups are examined, in turn by the researchers, in a protocol.[n]
Strong inference could alternatively propose multiple alternative hypotheses embodied in randomized controlled trials, treatments A, B, C, ... , (say in a blinded experiment with varying dosages, or with lifestyle changes, and so forth) so as not to introduce confirmation bias in favor of a specific course of treatment. Ethical considerations could be used, to minimize the numbers in the untreated groups, e.g., use almost every treatment in every group, but excluding A, B, C, ..., respectively as controls.[o][p]
The prediction step deduces the logical consequences of the hypothesis before the outcome is known. These predictions are expectations for the results of testing. If the result is already known, it is evidence that is ready to be considered in acceptance or rejection of the hypothesis. The evidence is also stronger if the actual result of the predictive test is not already known, as tampering with the test can be ruled out, as can hindsight bias (see postdiction). Ideally, the prediction must also distinguish the hypothesis from likely alternatives; if two hypotheses make the same prediction, observing the prediction to be correct is not evidence for either one over the other. (These statements about the relative strength of evidence can be mathematically derived using Bayes' Theorem).[q]
The consequence, therefore, is to be stated at the same time or briefly after the statement of the hypothesis, but before the experimental result is known.
Likewise, the test protocol is to be stated before execution of the test. These requirements become precautions against tampering, and aid the reproducibility of the experiment.
Suitable tests of a hypothesis compare the expected values from the tests of that hypothesis with the actual results of those tests. Scientists (and other people) can then secure, or discard, their hypotheses by conducting suitable experiments.
An analysis determines, from the results of the experiment, the next actions to take. The expected values from the test of the alternative hypothesis are compared to the expected values resulting from the null hypothesis (that is, a prediction of no difference in the status quo). The difference between expected versus actual indicates which hypothesis better explains the resulting data from the experiment. In cases where an experiment is repeated many times, a statistical analysis such as a chi-squared test whether the null hypothesis is true, may be required.
Evidence from other scientists, and from experience are available for incorporation at any stage in the process. Depending on the complexity of the experiment, iteration of the process may be required to gather sufficient evidence to answer the question with confidence, or to build up other answers to highly specific questions, to answer a single broader question.
When the evidence has falsified the alternative hypothesis, a new hypothesis is required; if the evidence does not conclusively justify discarding the alternative hypothesis, other predictions from the alternative hypothesis might be considered. Pragmatic considerations, such as the resources available to continue inquiry, might guide the investigation's further course.[B] When evidence for a hypothesis strongly supports that hypothesis, further questioning can follow, for insight into the broader inquiry under investigation.
- Question: Previous investigation of DNA had determined its chemical composition (the four nucleotides), the structure of each individual nucleotide, and other properties. DNA had been identified as the carrier of genetic information by the Avery–MacLeod–McCarty experiment in 1944, but the mechanism of how genetic information was stored in DNA was unclear.
- Hypothesis: Linus Pauling, Francis Crick and James D. Watson hypothesized that DNA had a helical structure.
- Prediction: If DNA had a helical structure, its X-ray diffraction pattern would be X-shaped. This prediction was determined using the mathematics of the helix transform, which had been derived by Cochran, Crick, and Vand (and independently by Stokes). This prediction was a mathematical construct, completely independent from the biological problem at hand.
- Experiment: Rosalind Franklin used pure DNA to perform X-ray diffraction to produce photo 51. The results showed an X-shape.
- Analysis: When Watson saw the detailed diffraction pattern, he immediately recognized it as a helix.[c] He and Crick then produced their model, using this information along with the previously known information about DNA's composition, especially Chargaff's rules of base pairing.
The discovery became the starting point for many further studies involving the genetic material, such as the field of molecular genetics, and it was awarded the Nobel Prize in 1962. Each step of the example is examined in more detail later in the article.
The scientific method also includes other components required even when all the iterations of the steps above have been completed:
If an experiment cannot be repeated to produce the same results, this implies that the original results might have been in error. As a result, it is common for a single experiment to be performed multiple times, especially when there are uncontrolled variables or other indications of experimental error. For significant or surprising results, other scientists may also attempt to replicate the results for themselves, especially if those results would be important to their own work. Replication has become a contentious issue in social and biomedical science where treatments are administered to groups of individuals. Typically an experimental group gets the treatment, such as a drug, and the control group gets a placebo. John Ioannidis in 2005 pointed out that the method being used has led to many findings that cannot be replicated.
The process of peer review involves evaluation of the experiment by experts, who typically give their opinions anonymously. Some journals request that the experimenter provide lists of possible peer reviewers, especially if the field is highly specialized. Peer review does not certify the correctness of the results, only that, in the opinion of the reviewer, the experiments themselves were sound (based on the description supplied by the experimenter). If the work passes peer review, which occasionally may require new experiments requested by the reviewers, it will be published in a peer-reviewed scientific journal. The specific journal that publishes the results indicates the perceived quality of the work.[r]
Data recording and sharing
Scientists typically are careful in recording their data, a requirement promoted by Ludwik Fleck (1896–1961) and others. Though not typically required, they might be requested to supply this data to other scientists who wish to replicate their original results (or parts of their original results), extending to the sharing of any experimental samples that may be difficult to obtain. See §Communication and community.
Institutional researchers might acquire an instrument to institutionalize their tests. These instruments would utilize observations of the real world, which might agree with, or perhaps conflict with, their predictions deduced from their hypothesis. These institutions thereby reduce the research function to a cost/benefit, is expressed as money, and the time and attention of the researchers to be expended, in exchange for a report to their constituents.
Current large instruments, such as CERN's Large Hadron Collider (LHC), or LIGO, or the National Ignition Facility (NIF), or the International Space Station (ISS), or the James Webb Space Telescope (JWST), entail expected costs of billions of dollars, and timeframes extending over decades. These kinds of institutions affect public policy, on a national or even international basis, and the researchers would require shared access to such machines and their adjunct infrastructure.[s] See Perceptual control theory, §Open-loop and closed-loop feedback
Elements of the scientific method
There are different ways of outlining the basic method used for scientific inquiry. The scientific community and philosophers of science generally agree on the following classification of method components. These methodological elements and organization of procedures tend to be more characteristic of experimental sciences than social sciences. Nonetheless, the cycle of formulating hypotheses, testing and analyzing the results, and formulating new hypotheses, will resemble the cycle described below.
The scientific method is an iterative, cyclical process through which information is continually revised. It is generally recognized to develop advances in knowledge through the following elements, in varying combinations or contributions:
- Characterizations (observations, definitions, and measurements of the subject of inquiry)
- Hypotheses (theoretical, hypothetical explanations of observations and measurements of the subject)
- Predictions (inductive and deductive reasoning from the hypothesis or theory)
- Experiments (tests of all of the above)
Each element of the scientific method is subject to peer review for possible mistakes. These activities do not describe all that scientists do but apply mostly to experimental sciences (e.g., physics, chemistry, biology, and psychology). The elements above are often taught in the educational system as "the scientific method".[A]
The scientific method is not a single recipe: it requires intelligence, imagination, and creativity. In this sense, it is not a mindless set of standards and procedures to follow, but is rather an ongoing cycle, constantly developing more useful, accurate, and comprehensive models and methods. For example, when Einstein developed the Special and General Theories of Relativity, he did not in any way refute or discount Newton's Principia. On the contrary, if the astronomically massive, the feather-light, and the extremely fast are removed from Einstein's theories – all phenomena Newton could not have observed – Newton's equations are what remain. Einstein's theories are expansions and refinements of Newton's theories and, thus, increase confidence in Newton's work.
- Define a question
- Gather information and resources (observe)
- Form an explanatory hypothesis
- Test the hypothesis by performing an experiment and collecting data in a reproducible manner
- Analyze the data
- Interpret the data and draw conclusions that serve as a starting point for a new hypothesis
- Publish results
- Retest (frequently done by other scientists)
The iterative cycle inherent in this step-by-step method goes from point 3 to 6 back to 3 again.
While this schema outlines a typical hypothesis/testing method, many philosophers, historians, and sociologists of science, including Paul Feyerabend,[t] claim that such descriptions of scientific method have little relation to the ways that science is actually practiced.
The scientific method depends upon increasingly sophisticated characterizations of the subjects of investigation. (The subjects can also be called unsolved problems or the unknowns.)[A] For example, Benjamin Franklin conjectured, correctly, that St. Elmo's fire was electrical in nature, but it has taken a long series of experiments and theoretical changes to establish this. While seeking the pertinent properties of the subjects, careful thought may also entail some definitions and observations; the observations often demand careful measurements and/or counting.
The systematic, careful collection of measurements or counts of relevant quantities is often the critical difference between pseudo-sciences, such as alchemy, and science, such as chemistry or biology. Scientific measurements are usually tabulated, graphed, or mapped, and statistical manipulations, such as correlation and regression, performed on them. The measurements might be made in a controlled setting, such as a laboratory, or made on more or less inaccessible or unmanipulatable objects such as stars or human populations. The measurements often require specialized scientific instruments such as thermometers, spectroscopes, particle accelerators, or voltmeters, and the progress of a scientific field is usually intimately tied to their invention and improvement.
I am not accustomed to saying anything with certainty after only one or two observations.
Measurements in scientific work are also usually accompanied by estimates of their uncertainty. The uncertainty is often estimated by making repeated measurements of the desired quantity. Uncertainties may also be calculated by consideration of the uncertainties of the individual underlying quantities used. Counts of things, such as the number of people in a nation at a particular time, may also have an uncertainty due to data collection limitations. Or counts may represent a sample of desired quantities, with an uncertainty that depends upon the sampling method used and the number of samples taken.
Measurements demand the use of operational definitions of relevant quantities. That is, a scientific quantity is described or defined by how it is measured, as opposed to some more vague, inexact, or "idealized" definition. For example, electric current, measured in amperes, may be operationally defined in terms of the mass of silver deposited in a certain time on an electrode in an electrochemical device that is described in some detail. The operational definition of a thing often relies on comparisons with standards: the operational definition of "mass" ultimately relies on the use of an artifact, such as a particular kilogram of platinum-iridium kept in a laboratory in France.
The scientific definition of a term sometimes differs substantially from its natural language usage. For example, mass and weight overlap in meaning in common discourse, but have distinct meanings in mechanics. Scientific quantities are often characterized by their units of measure which can later be described in terms of conventional physical units when communicating the work.
New theories are sometimes developed after realizing certain terms have not previously been sufficiently clearly defined. For example, Albert Einstein's first paper on relativity begins by defining simultaneity and the means for determining length. These ideas were skipped over by Isaac Newton with, "I do not define time, space, place and motion, as being well known to all." Einstein's paper then demonstrates that they (viz., absolute time and length independent of motion) were approximations. Francis Crick cautions us that when characterizing a subject, however, it can be premature to define something when it remains ill-understood. In Crick's study of consciousness, he actually found it easier to study awareness in the visual system, rather than to study free will, for example. His cautionary example was the gene; the gene was much more poorly understood before Watson and Crick's pioneering discovery of the structure of DNA; it would have been counterproductive to spend much time on the definition of the gene, before them.
The history of the discovery of the structure of DNA is a classic example of the elements of the scientific method: in 1950 it was known that genetic inheritance had a mathematical description, starting with the studies of Gregor Mendel, and that DNA contained genetic information (Oswald Avery's transforming principle). But the mechanism of storing genetic information (i.e., genes) in DNA was unclear. Researchers in Bragg's laboratory at Cambridge University made X-ray diffraction pictures of various molecules, starting with crystals of salt, and proceeding to more complicated substances. Using clues painstakingly assembled over decades, beginning with its chemical composition, it was determined that it should be possible to characterize the physical structure of DNA, and the X-ray images would be the vehicle. ..2. DNA-hypotheses
Another example: precession of Mercury
The characterization element can require extended and extensive study, even centuries. It took thousands of years of measurements, from the Chaldean, Indian, Persian, Greek, Arabic, and European astronomers, to fully record the motion of planet Earth. Newton was able to include those measurements into the consequences of his laws of motion. But the perihelion of the planet Mercury's orbit exhibits a precession that cannot be fully explained by Newton's laws of motion (see diagram to the right), as Leverrier pointed out in 1859. The observed difference for Mercury's precession between Newtonian theory and observation was one of the things that occurred to Albert Einstein as a possible early test of his theory of General relativity. His relativistic calculations matched observation much more closely than did Newtonian theory. The difference is approximately 43 arc-seconds per century.
A hypothesis is a suggested explanation of a phenomenon, or alternately a reasoned proposal suggesting a possible correlation between or among a set of phenomena.
Normally hypotheses have the form of a mathematical model. Sometimes, but not always, they can also be formulated as existential statements, stating that some particular instance of the phenomenon being studied has some characteristic and causal explanations, which have the general form of universal statements, stating that every instance of the phenomenon has a particular characteristic.
Scientists are free to use whatever resources they have – their own creativity, ideas from other fields, inductive reasoning, Bayesian inference, and so on – to imagine possible explanations for a phenomenon under study. Albert Einstein once observed that "there is no logical bridge between phenomena and their theoretical principles."[u] Charles Sanders Peirce, borrowing a page from Aristotle (Prior Analytics, 2.25) described the incipient stages of inquiry, instigated by the "irritation of doubt" to venture a plausible guess, as abductive reasoning.: II, p.290 The history of science is filled with stories of scientists claiming a "flash of inspiration", or a hunch, which then motivated them to look for evidence to support or refute their idea. Michael Polanyi made such creativity the centerpiece of his discussion of methodology.
the success of a hypothesis, or its service to science, lies not simply in its perceived "truth", or power to displace, subsume or reduce a predecessor idea, but perhaps more in its ability to stimulate the research that will illuminate ... bald suppositions and areas of vagueness.— William Glen, The Mass-Extinction Debates
In general scientists tend to look for theories that are "elegant" or "beautiful". Scientists often use these terms to refer to a theory that is following the known facts but is nevertheless relatively simple and easy to handle. Occam's Razor serves as a rule of thumb for choosing the most desirable amongst a group of equally explanatory hypotheses.
Linus Pauling proposed that DNA might be a triple helix. This hypothesis was also considered by Francis Crick and James D. Watson but discarded. When Watson and Crick learned of Pauling's hypothesis, they understood from existing data that Pauling was wrong. and that Pauling would soon admit his difficulties with that structure. So, the race was on to figure out the correct structure (except that Pauling did not realize at the time that he was in a race) ..3. DNA-predictions
Predictions from the hypothesis
Any useful hypothesis will enable predictions, by reasoning including deductive reasoning. It might predict the outcome of an experiment in a laboratory setting or the observation of a phenomenon in nature. The prediction can also be statistical and deal only with probabilities.
It is essential that the outcome of testing such a prediction be currently unknown. Only in this case does a successful outcome increase the probability that the hypothesis is true. If the outcome is already known, it is called a consequence and should have already been considered while formulating the hypothesis.
If the predictions are not accessible by observation or experience, the hypothesis is not yet testable and so will remain to that extent unscientific in a strict sense. A new technology or theory might make the necessary experiments feasible. For example, while a hypothesis on the existence of other intelligent species may be convincing with scientifically based speculation, no known experiment can test this hypothesis. Therefore, science itself can have little to say about the possibility. In the future, a new technique may allow for an experimental test and the speculation would then become part of accepted science.
James D. Watson, Francis Crick, and others hypothesized that DNA had a helical structure. This implied that DNA's X-ray diffraction pattern would be 'x shaped'. This prediction followed from the work of Cochran, Crick and Vand (and independently by Stokes). The Cochran-Crick-Vand-Stokes theorem provided a mathematical explanation for the empirical observation that diffraction from helical structures produces x shaped patterns.
In their first paper, Watson and Crick also noted that the double helix structure they proposed provided a simple mechanism for DNA replication, writing, "It has not escaped our notice that the specific pairing we have postulated immediately suggests a possible copying mechanism for the genetic material". ..4. DNA-experiments
Another example: general relativity
Einstein's theory of general relativity makes several specific predictions about the observable structure of spacetime, such as that light bends in a gravitational field, and that the amount of bending depends in a precise way on the strength of that gravitational field. Arthur Eddington's observations made during a 1919 solar eclipse supported General Relativity rather than Newtonian gravitation.
Once predictions are made, they can be sought by experiments. If the test results contradict the predictions, the hypotheses which entailed them are called into question and become less tenable. Sometimes the experiments are conducted incorrectly or are not very well designed when compared to a crucial experiment. If the experimental results confirm the predictions, then the hypotheses are considered more likely to be correct, but might still be wrong and continue to be subject to further testing. The experimental control is a technique for dealing with observational error. This technique uses the contrast between multiple samples, or observations, or populations, under differing conditions, to see what varies or what remains the same. We vary the conditions for the acts of measurement, to help isolate what has changed. Mill's canons can then help us figure out what the important factor is. Factor analysis is one technique for discovering the important factor in an effect.
Depending on the predictions, the experiments can have different shapes. It could be a classical experiment in a laboratory setting, a double-blind study or an archaeological excavation. Even taking a plane from New York to Paris is an experiment that tests the aerodynamical hypotheses used for constructing the plane.
Scientists assume an attitude of openness and accountability on the part of those experimenting. Detailed record-keeping is essential, to aid in recording and reporting on the experimental results, and supports the effectiveness and integrity of the procedure. They will also assist in reproducing the experimental results, likely by others. Traces of this approach can be seen in the work of Hipparchus (190–120 BCE), when determining a value for the precession of the Earth, while controlled experiments can be seen in the works of al-Battani (853–929 CE) and Alhazen (965–1039 CE).[v][w][g]
Watson and Crick showed an initial (and incorrect) proposal for the structure of DNA to a team from King's College London – Rosalind Franklin, Maurice Wilkins, and Raymond Gosling. Franklin immediately spotted the flaws which concerned the water content. Later Watson saw Franklin's detailed X-ray diffraction images which showed an X-shape and was able to confirm the structure was helical. This rekindled Watson and Crick's model building and led to the correct structure. ..1. DNA-characterizations
Evaluation and improvement
The scientific method is iterative. At any stage, it is possible to refine its accuracy and precision, so that some consideration will lead the scientist to repeat an earlier part of the process. Failure to develop an interesting hypothesis may lead a scientist to re-define the subject under consideration. Failure of a hypothesis to produce interesting and testable predictions may lead to reconsideration of the hypothesis or of the definition of the subject. Failure of an experiment to produce interesting results may lead a scientist to reconsider the experimental method, the hypothesis, or the definition of the subject.
By 1027, Alhazen, based on his measurements of the refraction of light, was able to deduce that outer space was less dense than air, that is: "the body of the heavens is rarer than the body of air".
Other scientists may start their own research and enter the process at any stage. They might adopt the characterization and formulate their own hypothesis, or they might adopt the hypothesis and deduce their own predictions. Often the experiment is not done by the person who made the prediction, and the characterization is based on experiments done by someone else. Published results of experiments can also serve as a hypothesis predicting their own reproducibility.
After considerable fruitless experimentation, being discouraged by their superior from continuing, and numerous false starts, Watson and Crick were able to infer the essential structure of DNA by concrete modeling of the physical shapes of the nucleotides which comprise it. They were guided by the bond lengths which had been deduced by Linus Pauling and by Rosalind Franklin's X-ray diffraction images. ..DNA Example
Science is a social enterprise, and scientific work tends to be accepted by the scientific community when it has been confirmed. Crucially, experimental and theoretical results must be reproduced by others within the scientific community. Researchers have given their lives for this vision; Georg Wilhelm Richmann was killed by ball lightning (1753) when attempting to replicate the 1752 kite-flying experiment of Benjamin Franklin.
To protect against bad science and fraudulent data, government research-granting agencies such as the National Science Foundation, and science journals, including Nature and Science, have a policy that researchers must archive their data and methods so that other researchers can test the data and methods and build on the research that has gone before. Scientific data archiving can be done at several national archives in the U.S. or the World Data Center.
Scientific inquiry generally aims to obtain knowledge in the form of testable explanations that scientists can use to predict the results of future experiments. This allows scientists to gain a better understanding of the topic under study, and later to use that understanding to intervene in its causal mechanisms (such as to cure disease). The better an explanation is at making predictions, the more useful it frequently can be, and the more likely it will continue to explain a body of evidence better than its alternatives. The most successful explanations – those which explain and make accurate predictions in a wide range of circumstances – are often called scientific theories.[A]
Most experimental results do not produce large changes in human understanding; improvements in theoretical scientific understanding typically result from a gradual process of development over time, sometimes across different domains of science. Scientific models vary in the extent to which they have been experimentally tested and for how long, and in their acceptance in the scientific community. In general, explanations become accepted over time as evidence accumulates on a given topic, and the explanation in question proves more powerful than its alternatives at explaining the evidence. Often subsequent researchers re-formulate the explanations over time, or combined explanations to produce new explanations.
Properties of scientific inquiry
Scientific knowledge is closely tied to empirical findings and can remain subject to falsification if new experimental observations are incompatible with what is found. That is, no theory can ever be considered final since new problematic evidence might be discovered. If such evidence is found, a new theory may be proposed, or (more commonly) it is found that modifications to the previous theory are sufficient to explain the new evidence. The strength of a theory relates to how long it has persisted without major alteration to its core principles (see invariant explanations).
Theories can also become subsumed by other theories. For example, Newton's laws explained thousands of years of scientific observations of the planets almost perfectly. However, these laws were then determined to be special cases of a more general theory (relativity), which explained both the (previously unexplained) exceptions to Newton's laws and predicted and explained other observations such as the deflection of light by gravity. Thus, in certain cases independent, unconnected, scientific observations can be connected, unified by principles of increasing explanatory power.
Since new theories might be more comprehensive than what preceded them, and thus be able to explain more than previous ones, successor theories might be able to meet a higher standard by explaining a larger body of observations than their predecessors. For example, the theory of evolution explains the diversity of life on Earth, how species adapt to their environments, and many other patterns observed in the natural world; its most recent major modification was unification with genetics to form the modern evolutionary synthesis. In subsequent modifications, it has also subsumed aspects of many other fields such as biochemistry and molecular biology.
Beliefs and biases
Scientific methodology often directs that hypotheses be tested in controlled conditions wherever possible. This is frequently possible in certain areas, such as in the biological sciences, and more difficult in other areas, such as in astronomy.
The practice of experimental control and reproducibility can have the effect of diminishing the potentially harmful effects of circumstance, and to a degree, personal bias. For example, pre-existing beliefs can alter the interpretation of results, as in confirmation bias; this is a heuristic that leads a person with a particular belief to see things as reinforcing their belief, even if another observer might disagree (in other words, people tend to observe what they expect to observe).
[T]he action of thought is excited by the irritation of doubt, and ceases when belief is attained.
A historical example is the belief that the legs of a galloping horse are splayed at the point when none of the horse's legs touch the ground, to the point of this image being included in paintings by its supporters. However, the first stop-action pictures of a horse's gallop by Eadweard Muybridge showed this to be false, and that the legs are instead gathered together.
Another important human bias that plays a role is a preference for new, surprising statements (see Appeal to novelty), which can result in a search for evidence that the new is true. Poorly attested beliefs can be believed and acted upon via a less rigorous heuristic.
Goldhaber and Nieto published in 2010 the observation that if theoretical structures with "many closely neighboring subjects are described by connecting theoretical concepts, then the theoretical structure acquires a robustness which makes it increasingly hard – though certainly never impossible – to overturn". When a narrative is constructed its elements become easier to believe.
Fleck 1979, p. 27 notes "Words and ideas are originally phonetic and mental equivalences of the experiences coinciding with them. ... Such proto-ideas are at first always too broad and insufficiently specialized. ... Once a structurally complete and closed system of opinions consisting of many details and relations has been formed, it offers enduring resistance to anything that contradicts it". Sometimes, these relations have their elements assumed a priori, or contain some other logical or methodological flaw in the process that ultimately produced them. Donald M. MacKay has analyzed these elements in terms of limits to the accuracy of measurement and has related them to instrumental elements in a category of measurement.[x]
Models of scientific inquiry
The classical model of scientific inquiry derives from Aristotle, who distinguished the forms of approximate and exact reasoning, set out the threefold scheme of abductive, deductive, and inductive inference, and also treated the compound forms such as reasoning by analogy.
The hypothetico-deductive model or method is a proposed description of the scientific method. Here, predictions from the hypothesis are central: if you assume the hypothesis to be true, what consequences follow?
If a subsequent empirical investigation does not demonstrate that these consequences or predictions correspond to the observable world, the hypothesis can be concluded to be false.
In 1877, Charles Sanders Peirce (1839–1914) characterized inquiry in general not as the pursuit of truth per se but as the struggle to move from irritating, inhibitory doubts born of surprises, disagreements, and the like, and to reach a secure belief, the belief being that on which one is prepared to act. He framed scientific inquiry as part of a broader spectrum and as spurred, like inquiry generally, by actual doubt, not mere verbal or hyperbolic doubt, which he held to be fruitless.[y] He outlined four methods of settling opinion, ordered from least to most successful:
- The method of tenacity (policy of sticking to initial belief) – which brings comforts and decisiveness but leads to trying to ignore contrary information and others' views as if truth were intrinsically private, not public. It goes against the social impulse and easily falters since one may well notice when another's opinion is as good as one's own initial opinion. Its successes can shine but tend to be transitory.[z]
- The method of authority – which overcomes disagreements but sometimes brutally. Its successes can be majestic and long-lived, but it cannot operate thoroughly enough to suppress doubts indefinitely, especially when people learn of other societies' present and past.
- The method of the a priori – which promotes conformity less brutally but fosters opinions as something like tastes, arising in conversation and comparisons of perspectives in terms of "what is agreeable to reason." Thereby it depends on fashion in paradigms and goes in circles over time. It is more intellectual and respectable but, like the first two methods, sustains accidental and capricious beliefs, destining some minds to doubt it.
- The scientific method – the method wherein inquiry regards itself as fallible and purposely tests itself and criticizes, corrects, and improves itself.
Peirce held that slow, stumbling ratiocination can be dangerously inferior to instinct and traditional sentiment in practical matters, and that the scientific method is best suited to theoretical research, which in turn should not be trammeled by the other methods and practical ends; reason's "first rule" is that, in order to learn, one must desire to learn and, as a corollary, must not block the way of inquiry. The scientific method excels the others by being deliberately designed to arrive – eventually – at the most secure beliefs, upon which the most successful practices can be based. Starting from the idea that people seek not truth per se but instead to subdue irritating, inhibitory doubt, Peirce showed how, through the struggle, some can come to submit to the truth for the sake of belief's integrity, seek as truth the guidance of potential practice correctly to its given goal, and wed themselves to the scientific method.
For Peirce, rational inquiry implies presuppositions about truth and the real; to reason is to presuppose (and at least to hope), as a principle of the reasoner's self-regulation, that the real is discoverable and independent of our vagaries of opinion. In that vein, he defined truth as the correspondence of a sign (in particular, a proposition) to its object and, pragmatically, not as the actual consensus of some definite, finite community (such that to inquire would be to poll the experts), but instead as that final opinion which all investigators would reach sooner or later but still inevitably, if they were to push investigation far enough, even when they start from different points. In tandem he defined the real as a true sign's object (be that object a possibility or quality, or an actuality or brute fact, or a necessity or norm or law), which is what it is independently of any finite community's opinion and, pragmatically, depends only on the final opinion destined in a sufficient investigation. That is a destination as far, or near, as the truth itself to you or me or the given finite community. Thus, his theory of inquiry boils down to "Do the science." Those conceptions of truth and the real involve the idea of a community both without definite limits (and thus potentially self-correcting as far as needed) and capable of definite increase of knowledge. As inference, "logic is rooted in the social principle" since it depends on a standpoint that is, in a sense, unlimited.
Paying special attention to the generation of explanations, Peirce outlined the scientific method as coordination of three kinds of inference in a purposeful cycle aimed at settling doubts, as follows (in §III–IV in "A Neglected Argument" except as otherwise noted):
- Abduction (or retroduction). Guessing, inference to explanatory hypotheses for selection of those best worth trying. From abduction, Peirce distinguishes induction as inferring, based on tests, the proportion of truth in the hypothesis. Every inquiry, whether into ideas, brute facts, or norms and laws, arises from surprising observations in one or more of those realms (and for example at any stage of an inquiry already underway). All explanatory content of theories comes from abduction, which guesses a new or outside idea to account in a simple, economical way for a surprising or complicative phenomenon. Oftenest, even a well-prepared mind guesses wrong. But the modicum of success of our guesses far exceeds that of sheer luck and seems born of attunement to nature by instincts developed or inherent, especially insofar as best guesses are optimally plausible and simple in the sense, said Peirce, of the "facile and natural", as by Galileo's natural light of reason and as distinct from "logical simplicity". Abduction is the most fertile but least secure mode of inference. Its general rationale is inductive: it succeeds often enough and, without it, there is no hope of sufficiently expediting inquiry (often multi-generational) toward new truths. Coordinative method leads from abducing a plausible hypothesis to judging it for its testability and for how its trial would economize inquiry itself. Peirce calls his pragmatism "the logic of abduction". His pragmatic maxim is: "Consider what effects that might conceivably have practical bearings you conceive the objects of your conception to have. Then, your conception of those effects is the whole of your conception of the object". His pragmatism is a method of reducing conceptual confusions fruitfully by equating the meaning of any conception with the conceivable practical implications of its object's conceived effects – a method of experimentational mental reflection hospitable to forming hypotheses and conducive to testing them. It favors efficiency. The hypothesis, being insecure, needs to have practical implications leading at least to mental tests and, in science, lending themselves to scientific tests. A simple but unlikely guess, if uncostly to test for falsity, may belong first in line for testing. A guess is intrinsically worth testing if it has instinctive plausibility or reasoned objective probability, while subjective likelihood, though reasoned, can be misleadingly seductive. Guesses can be chosen for trial strategically, for their caution (for which Peirce gave as an example the game of Twenty Questions), breadth, and incomplexity. One can hope to discover only that which time would reveal through a learner's sufficient experience anyway, so the point is to expedite it; the economy of research is what demands the leap, so to speak, of abduction and governs its art.
- Deduction. Two stages:
- Explication. Unclearly premised, but deductive, analysis of the hypothesis in order to render its parts as clear as possible.
- Demonstration: Deductive argumentation, Euclidean in procedure. Explicit deduction of hypothesis's consequences as predictions, for induction to test, about evidence to be found. Corollarial or, if needed, theorematic.
- Induction. The long-run validity of the rule of induction is deducible from the principle (presuppositional to reasoning, in general,) that the real is only the object of the final opinion to which adequate investigation would lead; anything to which no such process would ever lead would not be real. Induction involving ongoing tests or observations follows a method which, sufficiently persisted in, will diminish its error below any predesignate degree. Three stages:
- Classification. Unclearly premised, but inductive, classing of objects of experience under general ideas.
- Probation: direct inductive argumentation. Crude (the enumeration of instances) or gradual (new estimate of the proportion of truth in the hypothesis after each test). Gradual induction is qualitative or quantitative; if qualitative, then dependent on weightings of qualities or characters; if quantitative, then dependent on measurements, or on statistics, or on countings.
- Sentential Induction. "... which, by inductive reasonings, appraises the different probations singly, then their combinations, then makes self-appraisal of these very appraisals themselves, and passes final judgment on the whole result".
In a 2009 TED talk, Deutsch expounded a criterion for scientific explanation, which is to formulate invariants: "State an explanation [publicly, so that it can be dated and verified by others later] that remains invariant [in the face of apparent change, new information, or unexpected conditions]".
- "A bad explanation is easy to vary.": minute 11:22
- "The search for hard-to-vary explanations is the origin of all progress": minute 15:05
- "That the truth consists of hard-to-vary assertions about reality is the most important fact about the physical world.": minute 16:15
Invariance as a fundamental aspect of a scientific account of reality had long been part of philosophy of science: for example, Friedel Weinert's book The Scientist as Philosopher (2004) noted the presence of the theme in many writings from around 1900 onward, such as works by Henri Poincaré (1902), Ernst Cassirer (1920), Max Born (1949 and 1953), Paul Dirac (1958), Olivier Costa de Beauregard (1966), Eugene Wigner (1967), Lawrence Sklar (1974), Michael Friedman (1983), John D. Norton (1992), Nicholas Maxwell (1993), Alan Cook (1994), Alistair Cameron Crombie (1994), Margaret Morrison (1995), Richard Feynman (1997), Robert Nozick (2001), and Tim Maudlin (2002).
Communication and community
Frequently the scientific method is employed not only by a single person but also by several people cooperating directly or indirectly. Such cooperation can be regarded as an important element of a scientific community. Various standards of scientific methodology are used within such an environment.
Peer review evaluation
Scientific journals use a process of peer review, in which scientists' manuscripts are submitted by editors of scientific journals to (usually one to three, and usually anonymous) fellow scientists familiar with the field for evaluation. In certain journals, the journal itself selects the referees; while in others (especially journals that are extremely specialized), the manuscript author might recommend referees. The referees may or may not recommend publication, or they might recommend publication with suggested modifications, or sometimes, publication in another journal. This standard is practiced to various degrees by different journals and can have the effect of keeping the literature free of obvious errors and generally improve the quality of the material, especially in the journals that use the standard most rigorously. The peer-review process can have limitations when considering research outside the conventional scientific paradigm: problems of "groupthink" can interfere with open and fair deliberation of some new research.
Documentation and replication
Sometimes experimenters may make systematic errors during their experiments, veer from standard methods and practices (Pathological science) for various reasons, or, in rare cases, deliberately report false results. Occasionally because of this then, other scientists might attempt to repeat the experiments to duplicate the results.
Researchers sometimes practice scientific data archiving, such as in compliance with the policies of government funding agencies and scientific journals. In these cases, detailed records of their experimental procedures, raw data, statistical analyses, and source code can be preserved to provide evidence of the methodology and practice of the procedure and assist in any potential future attempts to reproduce the result. These procedural records may also assist in the conception of new experiments to test the hypothesis, and may prove useful to engineers who might examine the potential practical applications of a discovery.
When additional information is needed before a study can be reproduced, the author of the study might be asked to provide it. They might provide it, or if the author refuses to share data, appeals can be made to the journal editors who published the study or to the institution which funded the research.
Since a scientist can't record everything that took place in an experiment, facts selected for their apparent relevance are reported. This may lead, unavoidably, to problems later if some supposedly irrelevant feature is questioned. For example, Heinrich Hertz did not report the size of the room used to test Maxwell's equations, which later turned out to account for a small deviation in the results. The problem is that parts of the theory itself need to be assumed to select and report the experimental conditions. The observations are hence sometimes described as being 'theory-laden'.
Science of complex systems
Science applied to complex systems can involve elements such as transdisciplinarity, systems theory, control theory, and scientific modelling. The Santa Fe Institute studies such systems; Murray Gell-Mann interconnects these topics with message passing.
In general, the scientific method may be difficult to apply stringently to diverse, interconnected systems and large data sets. In particular, practices used within Big data, such as predictive analytics, may be considered to be at odds with the scientific method, as some of the data may have been stripped of the parameters which might be material in alternative hypotheses for an explanation; thus the stripped data would only serve to support the null hypothesis in the predictive analytics application. Fleck 1979, pp. 38–50 notes "a scientific discovery remains incomplete without considerations of the social practices that condition it".
Philosophy and sociology of science
Philosophy of science looks at the underpinning logic of the scientific method, at what separates science from non-science, and the ethic that is implicit in science. There are basic assumptions, derived from philosophy by at least one prominent scientist,[C] that form the base of the scientific method – namely, that reality is objective and consistent, that humans have the capacity to perceive reality accurately, and that rational explanations exist for elements of the real world. These assumptions from methodological naturalism form a basis on which science may be grounded. Logical positivist, empiricist, falsificationist, and other theories have criticized these assumptions and given alternative accounts of the logic of science, but each has also itself been criticized.
Thomas Kuhn examined the history of science in his The Structure of Scientific Revolutions, and found that the actual method used by scientists differed dramatically from the then-espoused method. His observations of science practice are essentially sociological and do not speak to how science is or can be practiced in other times and other cultures.
Norwood Russell Hanson, Imre Lakatos and Thomas Kuhn have done extensive work on the "theory-laden" character of observation. Hanson (1958) first coined the term for the idea that all observation is dependent on the conceptual framework of the observer, using the concept of gestalt to show how preconceptions can affect both observation and description. He opens Chapter 1 with a discussion of the Golgi bodies and their initial rejection as an artefact of staining technique, and a discussion of Brahe and Kepler observing the dawn and seeing a "different" sunrise despite the same physiological phenomenon.[i][aa] Kuhn and Feyerabend acknowledge the pioneering significance of Hanson's work.
Kuhn said[Propose striking this paragraph as inconsistent with the article.] the scientist generally has a theory in mind before designing and undertaking experiments to make empirical observations, and that the "route from theory to measurement can almost never be traveled backward". For Kuhn, this implies that how theory is tested is dictated by the nature of the theory itself, which led Kuhn to argue that "once it has been adopted by a profession ... no theory is recognized to be testable by any quantitative tests that it has not already passed" (revealing Kuhn's rationalist thinking style).
Post-modernism and science wars
Paul Feyerabend similarly examined the history of science, and was led to deny that science is genuinely a methodological process. In his book Against Method he argues that scientific progress is not the result of applying any particular method. In essence, he says that for any specific method or norm of science, one can find a historic episode where violating it has contributed to the progress of science. Thus, if believers in the scientific method wish to express a single universally valid rule, Feyerabend jokingly suggests, it should be 'anything goes'. However, this is uneconomic.[B] Criticisms such as Feyerabend's led to the strong programme, a radical approach to the sociology of science.
The postmodernist critiques of science have themselves been the subject of intense controversy. This ongoing debate, known as the science wars, is the result of conflicting values and assumptions between the postmodernist and realist camps. Whereas postmodernists assert that scientific knowledge is simply another discourse (note that this term has special meaning in this context) and not representative of any form of fundamental truth, realists in the scientific community maintain that scientific knowledge does reveal real and fundamental truths about reality. Many books have been written by scientists which take on this problem and challenge the assertions of the postmodernists while defending science as a legitimate method of deriving truth.
Anthropology and sociology
In anthropology and sociology, following the field research in an academic scientific laboratory by Latour and Woolgar, Karin Knorr Cetina has conducted a comparative study of two scientific fields (namely high energy physics and molecular biology) to conclude that the epistemic practices and reasonings within both scientific communities are different enough to introduce the concept of "epistemic cultures", in contradiction with the idea that a so-called "scientific method" is unique and a unifying concept. Comparing 'epistemic cultures' with Fleck 1935, Thought collectives, (denkkollektiven): Entstehung und Entwicklung einer wissenschaftlichen Tatsache: Einfǖhrung in die Lehre vom Denkstil und DenkkollektivFleck 1979, p. xxvii recognizes that facts have lifetimes, flourishing only after incubation periods. His selected question for investigation (1934) was "HOW, THEN, DID THIS EMPIRICAL FACT ORIGINATE AND IN WHAT DOES IT CONSIST?". But by Fleck 1979, p.27, the thought collectives within the respective fields will have to settle on common specialized terminology, publish their results and further intercommunicate with their colleagues using the common terminology, in order to progress.
Relationship with mathematics
Science is the process of gathering, comparing, and evaluating proposed models against observables. A model can be a simulation, mathematical or chemical formula, or set of proposed steps. Science is like mathematics in that researchers in both disciplines try to distinguish what is known from what is unknown at each stage of discovery. Models, in both science and mathematics, need to be internally consistent and also ought to be falsifiable (capable of disproof). In mathematics, a statement need not yet be proven; at such a stage, that statement would be called a conjecture. But when a statement has attained mathematical proof, that statement gains a kind of immortality which is highly prized by mathematicians, and for which some mathematicians devote their lives.
Mathematical work and scientific work can inspire each other. For example, the technical concept of time arose in science, and timelessness was a hallmark of a mathematical topic. But today, the Poincaré conjecture has been proven using time as a mathematical concept in which objects can flow (see Ricci flow).
Nevertheless, the connection between mathematics and reality (and so science to the extent it describes reality) remains obscure. Eugene Wigner's paper, The Unreasonable Effectiveness of Mathematics in the Natural Sciences, is a very well-known account of the issue from a Nobel Prize-winning physicist. In fact, some observers (including some well-known mathematicians such as Gregory Chaitin, and others such as Lakoff and Núñez) have suggested that mathematics is the result of practitioner bias and human limitation (including cultural ones), somewhat like the post-modernist view of science.
George Pólya's work on problem solving, the construction of mathematical proofs, and heuristic show that the mathematical method and the scientific method differ in detail, while nevertheless resembling each other in using iterative or recursive steps.
|Mathematical method||Scientific method|
|1||Understanding||Characterization from experience and observation|
|2||Analysis||Hypothesis: a proposed explanation|
|3||Synthesis||Deduction: prediction from the hypothesis|
|4||Review/Extend||Test and experiment|
In Pólya's view, understanding involves restating unfamiliar definitions in your own words, resorting to geometrical figures, and questioning what we know and do not know already; analysis, which Pólya takes from Pappus, involves free and heuristic construction of plausible arguments, working backward from the goal, and devising a plan for constructing the proof; synthesis is the strict Euclidean exposition of step-by-step details of the proof; review involves reconsidering and re-examining the result and the path taken to it.
Building on Pólya's work, Imre Lakatos argued that mathematicians actually use contradiction, criticism, and revision as principles for improving their work.[ab] In like manner to science, where truth is sought, but certainty is not found, in Proofs and Refutations, what Lakatos tried to establish was that no theorem of informal mathematics is final or perfect. This means that we should not think that a theorem is ultimately true, only that no counterexample has yet been found. Once a counterexample, i.e. an entity contradicting/not explained by the theorem is found, we adjust the theorem, possibly extending the domain of its validity. This is a continuous way our knowledge accumulates, through the logic and process of proofs and refutations. (However, if axioms are given for a branch of mathematics, this creates a logical system —Wittgenstein 1921 Tractatus Logico-Philosophicus 5.13; Lakatos claimed that proofs from such a system were tautological, i.e. internally logically true, by rewriting forms, as shown by Poincaré, who demonstrated the technique of transforming tautologically true forms (viz. the Euler characteristic) into or out of forms from homology, or more abstractly, from homological algebra.)[ab]
Lakatos proposed an account of mathematical knowledge based on Polya's idea of heuristics. In Proofs and Refutations, Lakatos gave several basic rules for finding proofs and counterexamples to conjectures. He thought that mathematical 'thought experiments' are a valid way to discover mathematical conjectures and proofs.
Relationship with statistics
When the scientific method employs statistics as a key part of its arsenal, there are mathematical and practical issues that can have a deleterious effect on the reliability of the output of scientific methods. This is described in a popular 2005 scientific paper "Why Most Published Research Findings Are False" by John Ioannidis, which is considered foundational to the field of metascience. Much research in metascience seeks to identify poor use of statistics and improve its use.[ac][m] See Preregistration (science)#Rationale
The particular points raised are statistical ("The smaller the studies conducted in a scientific field, the less likely the research findings are to be true" and "The greater the flexibility in designs, definitions, outcomes, and analytical modes in a scientific field, the less likely the research findings are to be true.") and economical ("The greater the financial and other interests and prejudices in a scientific field, the less likely the research findings are to be true" and "The hotter a scientific field (with more scientific teams involved), the less likely the research findings are to be true.") Hence: "Most research findings are false for most research designs and for most fields" and "As shown, the majority of modern biomedical research is operating in areas with very low pre- and poststudy probability for true findings." However: "Nevertheless, most new discoveries will continue to stem from hypothesis-generating research with low or very low pre-study odds," which means that *new* discoveries will come from research that, when that research started, had low or very low odds (a low or very low chance) of succeeding. Hence, if the scientific method is used to expand the frontiers of knowledge, research into areas that are outside the mainstream will yield the newest discoveries. See: Expected value of sample information, False positives and false negatives , Test statistic, and Type I and type II errors
Role of chance in discovery
Somewhere between 33% and 50% of all scientific discoveries are estimated to have been stumbled upon, rather than sought out. This may explain why scientists so often express that they were lucky. Louis Pasteur is credited with the famous saying that "Luck favours the prepared mind", but some psychologists have begun to study what it means to be 'prepared for luck' in the scientific context. Research is showing that scientists are taught various heuristics that tend to harness chance and the unexpected. This is what Nassim Nicholas Taleb calls "Anti-fragility"; while some systems of investigation are fragile in the face of human error, human bias, and randomness, the scientific method is more than resistant or tough – it actually benefits from such randomness in many ways (it is anti-fragile). Taleb believes that the more anti-fragile the system, the more it will flourish in the real world.
Psychologist Kevin Dunbar says the process of discovery often starts with researchers finding bugs in their experiments. These unexpected results lead researchers to try to fix what they think is an error in their method. Eventually, the researcher decides the error is too persistent and systematic to be a coincidence. The highly controlled, cautious, and curious aspects of the scientific method are thus what make it well suited for identifying such persistent systematic errors. At this point, the researcher will begin to think of theoretical explanations for the error, often seeking the help of colleagues across different domains of expertise.
- Armchair theorizing
- Empirical limits in science
- Evidence-based practices
- Fuzzy logic
- Information theory
- Quantitative research
- Rhetoric of science
- Royal Commission on Animal Magnetism
- Scientific law
- Social research
- Strong inference
- Unsupervised learning
Problems and issues
History, philosophy, sociology
- See, for example, Galileo Galilei 1638. His thought experiments disprove Aristotle's physics of falling bodies.
- Book of Optics (circa 1027) After anatomical investigation of the human eye, and an exhaustive study of human visual perception, Alhacen characterizes the first postulate of Euclid's Optics as 'superfluous and useless' (Book I, [6.54] —thereby overturning Euclid's, Ptolemy's, and Galen's emission theory of vision, using logic and deduction from experiment. He showed Euclid's first postulate of Optics to be hypothetical only, and fails to account for his experiments.), and deduces that light must enter the eye, in order for us to see. He describes the camera obscura as part of this investigation.
- The goal shifts: after observing the x-ray diffraction pattern of DNA, and as time was of the essence, Watson and Crick realize that fastest way to discover DNA's structure was not by mathematical analysis, but by building physical models.
- Thus echoing Popper 1963, p. viii
- Smolin espouses ethical principles: 1) "we agree to tell the truth and we agree to be governed by rational argument from public evidence". 2) ..."when the evidence is not sufficient to decide from rational argument, whether one point of view is right or another point of view is right, we agree to encourage competition and diversification"...[d]
- Staddon, John (2017) Scientific Method: How science works, fails to work or pretends to work Taylor and Francis.
- Book of Optics Book Seven, Chapter Two [2.1] p.220: — light travels through transparent bodies, such as air, water, glass, transparent stones, in straight lines. "Indeed, this is observable by means of experiment".
- The full title translation is from Voelkel 2001, p. 60.
- Kepler was driven to this experiment after observing the partial solar eclipse at Graz, July 10, 1600. He used Tycho Brahe's method of observation, which was to project the image of the Sun on a piece of paper through a pinhole aperture, instead of looking directly at the Sun. He disagreed with Brahe's conclusion that total eclipses of the Sun were impossible because there were historical accounts of total eclipses. Instead, he deduced that the size of the aperture controls the sharpness of the projected image (the larger the aperture, the more accurate the image – this fact is now fundamental for optical system design). Voelkel 2001, p. 61, notes that Kepler's 1604 experiments produced the first correct account of vision and the eye, because he realized he could not accurately write about astronomical observation by ignoring the eye. Smith 2004, p. 192 recounts how Kepler used Giambattista della Porta's water-filled glass spheres to model the eye, and using an aperture to represent the entrance pupil of the eye, showed that the entire scene at the entrance pupil focused on a single point of the rear of the glass sphere (representing the retina of the eye). This completed Kepler's investigation of the optical train, as it satisfied his application to astronomy.
- ...an experimental approach was advocated by Galileo in 1638 with the publication of Two New Sciences.
- For example, the concept of falsification (first proposed in 1934) formalizes the attempt to disprove hypotheses rather than to prove them (which would introduce confirmation bias).
- This phrasing is attributed to Marshall Nirenberg.
- Regarding the Misuse of t-Tests
- See Clinical trial protocol. That is, the examination of members of each group is to be uniform, and the steps of the examination are to be pre-defined (before the data is taken), systematic, and not ad hoc.
- See Placebo-controlled study
- See Factorial experiment#Advantages of factorial experiments
- Note: for a discussion of multiple hypotheses, see Bayesian inference#Informal
- In Two New Sciences, there are three 'reviewers': Simplicio, Sagredo, and Salviati, who serve as foil, antagonist, and protagonist. Galileo speaks for himself only briefly. But note that Einstein's 1905 papers were not peer-reviewed before their publication.
- The machinery of the mind can only transform knowledge, but never originate it, unless it be fed with facts of observation. —C.S. Peirce
- "no opinion, however absurd and incredible, can be imagined, which has not been maintained by some of the philosophers". —Descartes
- "A leap is involved in all thinking" —John Dewey
- "And this [experiment using a camera obscura] can be tried anytime". Book I [6.86] p.379
- Book of Optics Book II [3.52] to [3.66] Summary p.444 for Alhazen's experiments on color; pp.343—394 for his physiological experiments on the eye
- The scientific method requires testing and validation a posteriori before ideas are accepted.
- "What one does not in the least doubt one should not pretend to doubt; but a man should train himself to doubt," said Peirce in a brief intellectual autobiography. Peirce held that actual, genuine doubt originates externally, usually in surprise, but also that it is to be sought and cultivated, "provided only that it be the weighty and noble metal itself, and no counterfeit nor paper substitute".
- But see Scientific method and religion.
- Note that Brahe and Kepler are two different observers, intersubjectivity validates Hanson.
- Stillwell's review (p. 381) of Poincaré's efforts on the Euler characteristic notes that it took five iterations for Poincaré to arrive at the Poincaré homology sphere.
- For example, see misuse of p-values.
Problem-solving via scientific method
- In the inquiry-based education paradigm, the stage of "characterization, observation, definition, ..." is more briefly summed up under the rubric of a Question. The question at some stage might be as basic as the 5Ws, or is this answer true?, or who else might know this?, or can I ask them?, and so forth. The questions of the inquirer spiral until the goal is reached.
- Peirce 1899 First rule of logic (F.R.L) Paragraph 1.136: From the first rule of logic, if we truly desire the goal of the inquiry we are not to waste our resources
- Never fail to recognize an idea... .— C. S. Peirce
- Twenty-three hundred years ago, Aristotle proposed that a vacuum did not exist in nature; thirteen hundred years later, Alhazen disproved Aristotle's hypothesis, using experiments on refraction, thus deducing the existence of outer space.
- Alhazen argued the importance of forming questions and subsequently testing them: "How does light travel through transparent bodies? Light travels through transparent bodies in straight lines only... We have explained this exhaustively in our Book of Optics.[g] But let us now mention something to prove this convincingly: the fact that light travels in straight lines is clearly observed in the lights which enter into dark rooms through holes.... [T]he entering light will be clearly observable in the dust which fills the air.
- He demonstrated his conjecture that "light travels through transparent bodies in straight lines only" by placing a straight stick or a taut thread next to the light beam, as quoted in Sambursky 1974, p. 136 to prove that light travels in a straight line.
- David Hockney cites Alhazen several times as the likely source for the portraiture technique using the camera obscura, which Hockney rediscovered with the aid of an optical suggestion from Charles M. Falco. Kitab al-Manazir, which is Alhazen's Book of Optics, at that time denoted Opticae Thesaurus, Alhazen Arabis, was translated from Arabic into Latin for European use as early as 1270. Hockney cites Friedrich Risner's 1572 Basle edition of Opticae Thesaurus. Hockney quotes Alhazen as the first clear description of the camera obscura.
- Distancing oneself from the problem is one technique for solving problems
- Newton, Issac (1999) [1726 (3rd ed.)]. Philosophiæ Naturalis Principia Mathematica [Mathematical Principles of Natural Philosophy]. The Principia: Mathematical Principles of Natural Philosophy. Translated by Cohen, I. Bernard; Whitman, Anne; Budenz, Julia. Includes "A Guide to Newton's Principia" by I. Bernard Cohen, pp. 1–370. (The Principia itself is on pp. 371–946). Berkeley, CA: University of California Press. 791–796 ("Rules of Reasoning in Philosophy"); see also Philosophiæ Naturalis Principia Mathematica#Rules of Reasoning in Philosophy. ISBN 978-0-520-08817-7.
- "scientific method", Oxford Dictionaries: British and World English, 2016, retrieved 2016-05-28
- Oxford English Dictionary (3rd ed.). Oxford: Oxford University Press. 2014 – via OED Online.
- Peirce, Charles Sanders (1908). Wikisource. with added notes. Reprinted with previously unpublished part, Collected Papers v. 6, paragraphs 452–85, The Essential Peirce v. 2, pp. 434–450, and elsewhere. N.B. 435.30 'living institution': Hibbert J. mis-transcribed 'living institution': ("constitution" for "institution") . Hibbert Journal. 7: 90–112 – via
- Popper 1959, p. 273.
- Alhacen (2001). Smith, A. Mark (ed.). Alhacen's Theory of Visual Perception: A Critical Edition, with English Translation and Commentary, of the First Three Books of Alhacen's "De Aspectibus", the Medieval Latin Version of Ibn al-Haytham's "Kitāb al-Manāẓir". Vol. 1: Introduction and Latin text; Vol. 2: English translation. Translated by A. Mark Smith. Philadelphia: American Philosophical Society. ISBN 0-87169-914-1. OCLC 47168716.
- Gauch 2003, p. 3: "The scientific method 'is often misrepresented as a fixed sequence of steps,' rather than being seen for what it truly is, 'a highly variable and creative process' (AAAS 2000:18). The claim here is that science has general principles that must be mastered to increase productivity and enhance perspective, not that these principles provide a simple and automated sequence of steps to follow."
- Gauch 2003, p. 3.
- William Whewell, History of Inductive Science (1837), and in Philosophy of Inductive Science (1840)
- Riccardo Pozzo (2004) The impact of Aristotelianism on modern philosophy. CUA Press. p. 41. ISBN 0-8132-1347-9
- Jim Al-Khalili (4 January 2009). "The 'first true scientist'". BBC News.
- Tracey Tokuhama-Espinosa (2010). Mind, Brain, and Education Science: A Comprehensive Guide to the New Brain-Based Teaching. W.W. Norton & Company. p. 39. ISBN 978-0-393-70607-9.
Alhazen (or Al-Haytham; 965–1039 CE) was perhaps one of the greatest physicists of all times and a product of the Islamic Golden Age or Islamic Renaissance (7th–13th centuries). He made significant contributions to anatomy, astronomy, engineering, mathematics, medicine, ophthalmology, philosophy, physics, psychology, and visual perception and is primarily attributed as the inventor of the scientific method, for which author Bradley Steffens (2006) describes him as the "first scientist".
- Alhazen, Treatise on Light (رسالة في الضوء), translated into English from German by M. Schwarz, from "Abhandlung über das Licht", J. Baarmann (editor and translator from Arabic to German, 1882) Zeitschrift der Deutschen Morgenländischen Gesellschaft Vol 36 as quoted in Sambursky 1974, p. 136.
- Peirce, C.S., Collected Papers v. 1, paragraph 74.
- Albert Einstein (2009) . "On the Method of Theoretical Physics". Einstein's essays in science. Translated by Alan Harris. Dover. pp. 12–21. ISBN 9780486470115.
- Thurs, Daniel (2011). "12. Scientific Methods". In Shank, Michael; Numbers, Ronald; Harrison, Peter (eds.). Wrestling with Nature: From Omens to Science. Chicago: University of Chicago Press. pp. 307–336. ISBN 978-0-226-31783-0.
- Achinstein, Peter (2004). General Introduction. Science Rules: A Historical Introduction to Scientific Methods. Johns Hopkins University Press. pp. 1–5. ISBN 978-0-8018-7943-2.
- Cowles 2020, p. 264
- Popper (1963) Conjectures and Refutations pp=312-365 claims that Trial and error is a universal method.
Tow, David Hunter (11 September 2010). The Future of Life: A Unified Theory of Evolution. Future of Life Series. Future of Life Media (published 2010). p. 262. Retrieved 2016-12-11.
On further examination, however, the scientific method bears a striking similarity to the larger process of evolution itself. [...] Of great significance is the evolutionary algorithm, which uses a simplified subset of the process of natural evolution applied to find the solution to problems that are too complex to solve by traditional analytic methods. In essence, it is a process of accelerated and rigorous trial and error building on previous knowledge to refine an existing hypothesis, or discarding it altogether to find a better model. [...] The evolutionary algorithm is a technique derived from the evolution of knowledge processing applied within the context of science and technology, itself an outcome of evolution. The scientific method continues to evolve through adaptive reward, trial and error, and application of the method to itself.
- Peirce, Charles S. (1899). "F.R.L. [First Rule of Logic]". Collected Papers. v. 1. paragraphs 135–140. Archived from the original on 2012-01-06. Retrieved 2012-01-06.
... in order to learn, one must desire to learn ...
- Peirce, Charles S. (1902), Carnegie application, see MS L75.329330, from Draft D of Memoir 27: "Consequently, to discover is simply to expedite an event that would occur sooner or later, if we had not troubled ourselves to make the discovery. Consequently, the art of discovery is purely a question of economics. The economics of research is, so far as logic is concerned, the leading doctrine concerning the art of discovery. Consequently, the conduct of abduction, which is chiefly a question of heuretic and is the first question of heuretic, is to be governed by economical considerations."
- Peirce, Charles S., Carnegie application (L75, 1902), New Elements of Mathematics v. 4, pp. 37–38: "For it is not sufficient that a hypothesis should be a justifiable one. Any hypothesis which explains the facts is justified critically. But among justifiable hypotheses we have to select that one which is suitable for being tested by experiment."
- McElheny 2004, p. 52: Friday, January 30, 1953. Tea time — Franklin confronts Watson and his paper – "Of course it [Pauling's pre-print] is wrong. DNA is not a helix." However, Watson then visits Wilkins' office, sees photo 51, and immediately recognizes the diffraction pattern of a helical structure. But additional questions remained, requiring additional iterations of their research. For example, the number of strands in the backbone of the helix (Crick suspected 2 strands, but cautioned Watson to examine that more critically), the location of the base pairs (inside the backbone or outside the backbone), etc. One key point was that they realized that the quickest way to reach a result was not to continue a mathematical analysis, but to build a physical model. Later that evening — Watson urges Wilkins to begin model-building immediately. But Wilkins agrees to do so only after Franklin's departure.
- McElheny 2004, pp. 57–59: Saturday, February 28, 1953 — Watson found the base-pairing mechanism which explained Chargaff's rules using his cardboard models.
- Smolin, Lee (May 2013). "There is No Scientific Method". Retrieved 2016-06-07.
- Thurs, Daniel P. (2015), "That the scientific method accurately reflects what scientists actually do", in Numbers, Ronald L.; Kampourakis, Kostas (eds.), Newton's Apple and Other Myths about Science, Harvard University Press, pp. 210–218, ISBN 978-0-674-91547-3,
It's probably best to get the bad news out of the way first, the so-called scientific method is a myth. ... If typical formulations were accurate, the only location true science would be taking place in would be grade-school classrooms.
- Mark Snyder (1984) When Belief Creates Reality Advances in Experimental Social Psychology Volume 18, 1984, Pages 247-305
- Taleb 2007, p. 72 lists ways to avoid the narrative fallacy and confirmation bias; the narrative fallacy being a substitute for explanation.
- Nola, Robert; Sankey, Howard (2007). Theories of Scientific Method: An Introduction. Philosophy and science. 2. Montréal: McGill–Queen's University Press. pp. 1, 300. doi:10.4324/9781315711959. ISBN 9780773533448. OCLC 144602109.
There is a large core of people who think there is such a thing as a scientific method that can be justified, although not all agree as to what this might be. But there are also a growing number of people who think that there is no method to be justified. For some, the whole idea is yesteryear's debate, the continuation of which can be summed up as yet more of the proverbial 'flogging a dead horse'. We beg to differ. ... We shall claim that Feyerabend did endorse various scientific values, did accept rules of method (on a certain understanding of what these are), and did attempt to justify them using a meta methodology somewhat akin to the principle of reflective equilibrium.
- Staddon, John (Sep 2020) Whatever Happened to History of Science?
- Galileo Galilei 1638.
- Peirce, Charles Sanders (1877). Wikisource. . Popular Science Monthly. 12: 286–302 – via
- Smith 2010 Book 7, [4.28] p.270
- Hockney 2006, p. 240: "Truth is sought for its own sake. And those who are engaged upon the quest for anything for its own sake are not interested in other things. Finding the truth is difficult, and the road to it is rough." – Alhazen (Ibn Al-Haytham 965 – c. 1040) Critique of Ptolemy, translated by S. Pines, Actes X Congrès internationale d'histoire des sciences, Vol I Ithaca 1962, as quoted in Sambursky 1974, p. 139. (This quotation is from Alhazen's critique of Ptolemy's books Almagest, Planetary Hypotheses, and Ptolemy's Theory of Visual Perception: An English Translation of the Optics. Translated by A. Mark Smith. American Philosophical Society. 1996. ISBN 9780871698629.)
- Elizabeth Asmis (1985) Epicurus' Scientific Method. Cornell University Press
- various papers (PDF). The optics of Giovan Battista della Porta (1535–1615): A Reassessment Workshop at Technical University of Berlin, 24–25 October 2014. Archived from the original (PDF) on 2018-05-27.
- Kepler, Johannes (1604) Ad Vitellionem paralipomena, quibus astronomiae pars opticae traditur (Supplements to Witelo, in which the optical part of astronomy is treated)[h] as cited in Smith, A. Mark (June 2004). "What Is the History of Medieval Optics Really about?". Proceedings of the American Philosophical Society. 148 (2): 180–194. JSTOR 1558283. PMID 15338543.
- Sanches, Limbrick & Thomson 1988.
- Godfrey-Smith 2003, p. 236.
- Gauch 2003, p. xv: "The thesis of this book, as outlined in Chapter One, is that there are general principles applicable to all the sciences."
- Popper 2005, pp. 17–20, 249–252, 437–438, and elsewhere.
- Leon Lederman, for teaching physics first, illustrates how to avoid confirmation bias: Ian Shelton, in Chile, was initially skeptical that supernova 1987a was real, but possibly an artifact of instrumentation (null hypothesis), so he went outside and disproved his null hypothesis by observing SN 1987a with the naked eye. The Kamiokande experiment, in Japan, independently observed neutrinos from SN 1987a at the same time.
- Peirce, Charles Sanders (1877). Wikisource.. . Popular Science Monthly. 12: 1–15 – via
- Gauch 2003, p. 1: "The scientific method can function in the same way; This is the principle of noncontradiction."
- Francis Bacon (1629) New Organon, lists 4 types of error: Idols of the tribe (error due to the entire human race), the cave (errors due to an individual's own intellect), the marketplace (errors due to false words), and the theater (errors due to incredulous acceptance).
- Peirce, Charles S., Collected Papers v. 5, in paragraph 582, from 1898: "... [rational] inquiry of every type, fully carried out, has the vital power of self-correction and of growth. This is a property so deeply saturating its inmost nature that it may truly be said that there is but one thing needful for learning the truth, and that is a hearty and active desire to learn what is true."
- Taleb, Nassim N. "Antifragility — or— The Property Of Disorder-Loving Systems". Archived from the original on 2013-05-07.
- Lindberg 2007, pp. 2–3: "There is a danger that must be avoided. ... If we wish to do justice to the historical enterprise, we must take the past for what it was. And that means we must resist the temptation to scour the past for examples or precursors of modern science. ...My concern will be with the beginnings of scientific theories, the methods by which they were formulated, and the uses to which they were put; ... "
- Schuster, Daniel P.; Powers, William J., eds. (2005). "Ch. 1". Translational and Experimental Clinical Research. Lippincott Williams & Wilkins. ISBN 9780781755658. This chapter also discusses the different types of research questions and how they are produced.
- Bill and Melinda Gates Foundation (2021) Definition of Clinical Trials
- Hannan EL (June 2008). "Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations". JACC. Cardiovascular Interventions. 1 (3): 211–7. doi:10.1016/j.jcin.2008.01.008. PMID 19463302.
- Carl F Schaefer (1984) "Regarding the Misuse of t-Tests" Anesthesiology 60(5) May 1984 p.505
- Platt, John R. (16 October 1964). "Strong Inference". Science. 146 (3642): 347–. Bibcode:1964Sci...146..347P. doi:10.1126/science.146.3642.347. PMID 17739513.
- McCarty 1985, p. 252.
- X-ray diffraction patterns of DNA by Florence Bell in her Ph.D. thesis (1939) were similar to (although not as good as) "photo 51", but this research was interrupted by the events of World War II.
- McElheny 2004, p. 40: October 1951 — "That's what a helix should look like!" Crick exclaimed in delight (This is the Cochran-Crick-Vand-Stokes theory of the transform of a helix).
- McElheny 2004, p. 43: June 1952 — Watson had succeeded in getting X-ray pictures of TMV showing a diffraction pattern consistent with the transform of a helix.
- Judson 1979, pp. 137–138: "Watson did enough work on Tobacco mosaic virus to produce the diffraction pattern for a helix, per Crick's work on the transform of a helix."
- Cochran W, Crick FHC and Vand V. (1952) "The Structure of Synthetic Polypeptides. I. The Transform of Atoms on a Helix", Acta Crystallogr., 5, 581–586.
- Watson 1968, p. 167: "The instant I saw the picture my mouth fell open and my pulse began to race." Page 168 shows the X-shaped pattern of the B-form of DNA, clearly indicating crucial details of its helical structure to Watson and Crick.
- "Reconstruction of Galileo Galilei's experiment – the inclined plane" (PDF).
- Ioannidis, John P. A. (August 2005). "Why most published research findings are false". PLOS Medicine. 2 (8): e124. doi:10.1371/journal.pmed.0020124. PMC 1182327. PMID 16060722.
- Fleck 1979, pp. xxvii–xxviii.
- "NIH Data Sharing Policy."
- MacKay, Donald M. (1969). Information, Mechanism, and Meaning. Cambridge, MA: MIT Press. pp. 1–4. ISBN 0-262-63032-X.
Invariably one came up against fundamental physical limits to the accuracy of measurement. ... The art of physical measurement seemed to be a matter of compromise, of choosing between reciprocally related uncertainties. ... Multiplying together the conjugate pairs of uncertainty limits mentioned, however, I found that they formed invariant products of not one but two distinct kinds. ... The first group of limits were calculable a priori from a specification of the instrument. The second group could be calculated only a posteriori from a specification of what was done with the instrument. ... In the first case each unit [of information] would add one additional dimension (conceptual category), whereas in the second each unit would add one additional atomic fact.
- National Science Foundation (NSF) (2021) NSF Reports and News
- "LHC long term schedule". lhc-commissioning.web.cern.ch. (2021)
- ligo.caltech.edu (1999) Laser Interferometer Gravitational-Wave Observatory
- NIF (2021) What Is the National Ignition Facility?
- ISS (2021) International Space Station
- JWST (2021) WEBB Space Telescope
- "James (2003) "Complex Systems Theory?"" (PDF).
- Godfrey-Smith, Peter (2009). Theory and Reality: An Introduction to the Philosophy of Science. Chicago: University of Chicago Press. ISBN 978-0-226-30062-7.
- Brody 1993, p. 10 calls this an epistemic cycle; these cycles can occur at high levels of abstraction.
- Einstein & Infeld 1938, p. 92: "To raise new questions, new possibilities, to regard old problems from a new angle, requires creative imagination and marks real advance in science."
- Crawford S, Stucki L (1990). "Peer review and the changing research record". J Am Soc Info Science. 41 (3): 223–228. doi:10.1002/(SICI)1097-4571(199004)41:3<223::AID-ASI14>3.0.CO;2-3.
- Gauch 2003, esp. chapters 5–8.
- René Descartes (1637) Discourse on the Method/Part 2 Part II
- Andreas Vesalius, Epistola, Rationem, Modumque Propinandi Radicis Chynae Decocti (1546), p. 141. Quoted and translated in C.D. O'Malley, Andreas Vesalius of Brussels, (1964), p. 116. As quoted by Bynum & Porter 2005, p. 597: "Andreas Vesalius"
- Crick, Francis (1994), The Astonishing Hypothesis ISBN 0-684-19431-7 p. 20
- McElheny 2004, p. 34.
- "ESO Telescope Sees Star Dance Around Supermassive Black Hole, Proves Einstein Right". Science Release. European Southern Observatory. 16 April 2020.
- Einstein, Albert (1949). The World as I See It. New York: Philosophical Library. pp. 24–28.
- Dewey 1910, p. 26
- Aristotle (trans. 1853) Prior Analytics 2.25 via Wikisource
- Glen 1994, pp. 37–38.
- Judson 1979, p. 157. "'The structure that we propose is a three-chain structure, each chain being a helix' – Linus Pauling"
- McElheny 2004, pp. 49–50: January 28, 1953 — Watson read Pauling's pre-print, and realized that in Pauling's model, DNA's phosphate groups had to be un-ionized. But DNA is an acid, which contradicts Pauling's model.
- McElheny 2004, p. 68: Nature April 25, 1953.
- In March 1917, the Royal Astronomical Society announced that on May 29, 1919, the occasion of a total eclipse of the sun would afford favorable conditions for testing Einstein's General theory of relativity. One expedition, to Sobral, Ceará, Brazil, and Eddington's expedition to the island of Principe yielded a set of photographs, which, when compared to photographs taken at Sobral and at Greenwich Observatory showed that the deviation of light was measured to be 1.69 arc-seconds, as compared to Einstein's desk prediction of 1.75 arc-seconds. – Antonina Vallentin (1954), Einstein, as quoted by Samuel Rapport and Helen Wright (1965), Physics, New York: Washington Square Press, pp. 294–295.
- Mill, John Stuart, "A System of Logic", University Press of the Pacific, Honolulu, 2002, ISBN 1-4102-0252-6.
- al-Battani, De Motu Stellarum translation from Arabic to Latin in 1116, as cited by E. S. Kennedy, A Survey of Islamic Astronomical Tables, (Transactions of the American Philosophical Society, New Series, 46, 2), Philadelphia, 1956, pp. 10–11, 32–34.
- Smith 2010, p. 220 Book Seven covers refraction.
- "The Secret of Photo 51". NOVA. PBS.
- McElheny 2004, p. 53: The weekend (January 31 – February 1) — After seeing photo 51, Watson informed Bragg of the X-ray diffraction image of DNA in B form. Bragg permitted them to restart their research on DNA (that is, model building).
- McElheny 2004, p. 54: Sunday, February 8, 1953 — Maurice Wilkes gave Watson and Crick permission to work on models, as Wilkes would not be building models until Franklin left DNA research.
- McElheny 2004, p. 56: Jerry Donohue, on sabbatical from Pauling's lab and visiting Cambridge, advises Watson that textbook form of the base pairs was incorrect for DNA base pairs; rather, the keto form of the base pairs should be used instead. This form allowed the bases' hydrogen bonds to pair 'unlike' with 'unlike', rather than to pair 'like' with 'like', as Watson was inclined to model, based on the textbook statements. On February 27, 1953, Watson was convinced enough to make cardboard models of the nucleotides in their keto form.
- Watson 1968, pp. 194–197: "Suddenly I became aware that an adenine-thymine pair held together by two hydrogen bonds was identical in shape to a guanine-cytosine pair held together by at least two hydrogen bonds. ..."
- McElheny 2004, p. 57: Saturday, February 28, 1953 — Watson tried 'like with like' and admitted these base pairs didn't have hydrogen bonds that line up. But after trying 'unlike with unlike', and getting Jerry Donohue's approval, the base pairs turned out to be identical in shape (as Watson stated above in his 1968 Double Helix memoir quoted above). Watson now felt confident enough to inform Crick. (Of course, 'unlike with unlike' increases the number of possible codons, if this scheme were a genetic code.)
- Krider, E. Philip (January 2006). "Benjamin Franklin and lightning rods". Physics Today. 59 (1): 42. Bibcode:2006PhT....59a..42K. doi:10.1063/1.2180176.
On 6 August 1753, the Swedish scientist Georg Wilhelm Richmann was electrocuted in St. Petersburg ...
- Stanovich, Keith E. (2007). How to Think Straight About Psychology. Boston: Pearson Education. p. 123
- Brody 1993, pp. 44–45.
- Goldhaber & Nieto 2010, p. 942.
- Hall, B.K.; Hallgrímsson, B., eds. (2008). Strickberger's Evolution (4th ed.). Jones & Bartlett. p. 762. ISBN 978-0-7637-0066-9.
- Cracraft, J.; Donoghue, M.J., eds. (2005). Assembling the tree of life. Oxford University Press. p. 592. ISBN 978-0-19-517234-8.
- Needham & Wang 1954, p. 166 shows how the 'flying gallop' image propagated from China to the West.
- Goldhaber & Nieto 2010, p. 940.
- Ronald R. Sims (2003). Ethics and corporate social responsibility: Why giants fall. p. 21: "'A myth is a belief given uncritical acceptance by members of a group ...' – Weiss, Business Ethics p. 15."
- Lakatos 1976, pp. 1–19.
- Aristotle (1938). "Prior Analytics". Aristotle, Volume 1. Loeb Classical Library. Translated by Hugh Tredennick. London: William Heinemann. pp. 181–531.
- Ketner, Kenneth Laine (2009). "Charles Sanders Peirce: Interdisciplinary Scientist". The Logic of Interdisciplinarity. By Peirce, Charles S. Bisanz, Elize (ed.). Berlin: Akademie Verlag.
- Peirce, Charles S. (October 1905). "Issues of Pragmaticism". The Monist. Vol. XV no. 4. pp. 481–499, see p. 484, and p. 491. Reprinted in Collected Papers v. 5, paragraphs 438–463, see 443 and 451.
- Peirce, Charles S. (1898), "Philosophy and the Conduct of Life", Lecture 1 of the Cambridge (MA) Conferences Lectures, published in Reasoning and the Logic of Things, Kenneth Laine Ketner (ed.), pp. 105–122 and in Collected Papers v. 1, paragraphs 616–648 (in part), reprinted in Essential Peirce v. 2, pp. 27–41.
- Peirce, Charles S. (1868). "Some Consequences of Four Incapacities". Journal of Speculative Philosophy. 2 (3): 140–157. Archived from the original on 2011-05-24 – via Arisbe. Reprinted Collected Papers v. 5, paragraphs 264–317, The Essential Peirce v. 1, pp. 28–55 and elsewhere.
- Peirce, Charles S. (1878). "The Doctrine of Chances". Popular Science Monthly. Vol. 12. pp. 604–615, see pp. 610–611 – via Internet Archive. Reprinted Collected Papers v. 2, paragraphs 645–68, Essential Peirce v. 1, pp. 142–154. "... death makes the number of our risks, the number of our inferences, finite, and so makes their mean result uncertain. The very idea of probability and of reasoning rests on the assumption that this number is indefinitely great. ... logicality inexorably requires that our interests shall not be limited. ... Logic is rooted in the social principle."
- Peirce, Charles S. (c. 1906), "PAP (Prolegomena for an Apology to Pragmatism)" (Manuscript 293, not the like-named article), The New Elements of Mathematics (NEM) 4:319–20, see first quote under "Abduction". Commens Dictionary of Peirce's Terms. Archived from the original on 2013-05-02.
- Peirce, Charles S. (1903). "§3. Pragmatism – The Logic of Abduction". Collected Papers. Vol. V: Pragmatism and Pramaticism. paragraphs 195–205, especially 196.
- Peirce, Charles S., "On the Logic of Drawing Ancient History from Documents", Essential Peirce v. 2, see pp. 107–109. On Twenty Questions, p. 109: "Thus, twenty skillful hypotheses will ascertain what 200,000 stupid ones might fail to do."
- Peirce, Charles S. (1878). "The Probability of Induction". Popular Science Monthly. Vol. 12. pp. 705–718, see 718 via Google Books 718 via Internet Archive. Reprinted often, including (Collected Papers v. 2, paragraphs 669–693), (The Essential Peirce v. 1, pp. 155–169).
- Peirce, Charles S. (1905 draft "G" of "A Neglected Argument"), "Crude, Quantitative, and Qualitative Induction", Collected Papers v. 2, paragraphs 755–760, see 759. Find under "Induction". Commens Dictionary of Peirce's Terms. Archived from the original on 2013-05-02.
- Deutsch, David (October 2009). A new way to explain explanation. TED talk. Also available from YouTube.
- Weinert, Friedel (2004). "Invariance and reality". The Scientist as Philosopher: Philosophical Consequences of Great Scientific Discoveries. Berlin; New York: Springer-Verlag. pp. 62–74 (72). doi:10.1007/b138529. ISBN 3540205802. OCLC 53434974.
- Brown, C. (2005) Overcoming Barriers to Use of Promising Research Among Elite Middle East Policy Groups, Journal of Social Behaviour and Personality, Select Press.
- David Mermin (September 1994). "A "Virtuosically Adaptive" System As Seen By A "Marginally Adaptive" One (Review of The Quark and the Jaguar, by Murray Gell-Mann (1994))". Physics Today. 47 (9): 89. doi:10.1063/1.2808634.
Murray Gell-Mann (11 May 2016). What the Quark and Jaguar is about – via Youtube.
- Poppele RE, Bowman RJ (January 1970). "Quantitative description of linear behavior of mammalian muscle spindles". Journal of Neurophysiology. 33 (1): 59–72. doi:10.1152/jn.19220.127.116.11. PMID 4243791.
- Blum KP, Lamotte D'Incamps B, Zytnicki D, Ting LH (September 2017). Ayers J (ed.). "Force encoding in muscle spindles during stretch of passive muscle". PLOS Computational Biology. 13 (9): e1005767. Bibcode:2017PLSCB..13E5767B. doi:10.1371/journal.pcbi.1005767. PMC 5634630. PMID 28945740.
- Anderson, Chris (2008) The End of Theory: The Data Deluge Makes the Scientiﬁc Method Obsolete. Wired Magazine 16.07
- Ludwik Fleck (1979) Genesis and Development of a Scientific Fact
- Einstein, Albert (1936, 1956) One may say "the eternal mystery of the world is its comprehensibility." From the article "Physics and Reality" (1936), reprinted in Out of My Later Years (1956). 'It is one of the great realizations of Immanuel Kant that the setting up of a real external world would be senseless without this comprehensibility.'
- Hanson, Norwood (1958), Patterns of Discovery, Cambridge University Press, ISBN 978-0-521-05197-2
- Kuhn, Thomas S. (2009). The Structure of Scientific Revolutions. Chicago, IL: University of Chicago Press. p. 113. ISBN 978-1-4432-5544-8.
- Feyerabend, Paul K (1960) "Patterns of Discovery" The Philosophical Review (1960) vol. 69 (2) pp. 247–252
- Kuhn 1961, p. 166.
- Feyerabend, Paul K., Against Method, Outline of an Anarchistic Theory of Knowledge, 1st published, 1975. Reprinted, Verso, London, 1978.
- For example:
- Higher Superstition: The Academic Left and Its Quarrels with Science, The Johns Hopkins University Press, 1997
- Fashionable Nonsense: Postmodern Intellectuals' Abuse of Science, Picador. 1999
- The Sokal Hoax: The Sham That Shook the Academy, University of Nebraska Press, 2000 ISBN 0-8032-7995-7
- A House Built on Sand: Exposing Postmodernist Myths About Science, Oxford University Press, 2000
- Intellectual Impostures, Economist Books, 2003
- Knorr-Cetina, K. (1999). Epistemic cultures: how the sciences make knowledge. Cambridge, Mass.: Harvard University Press. ISBN 978-0-674-25893-8. OCLC 39539508.
- As cited in Fleck 1979, p. 27, Fleck 1979, pp. 38–50
- Fleck 1979, p. xxviii
- Fleck 1979, p. 27
- Pólya 1957, p. 131 in the section on 'Modern heuristic': "When we are working intensively, we feel keenly the progress of our work; we are elated when our progress is rapid, we are depressed when it is slow."
- "Philosophy [i.e., physics] is written in this grand book – I mean the universe – which stands continually open to our gaze, but it cannot be understood unless one first learns to comprehend the language and interpret the characters in which it is written. It is written in the language of mathematics, and its characters are triangles, circles, and other geometrical figures, without which it is humanly impossible to understand a single word of it; without these, one is wandering around in a dark labyrinth." – Galileo Galilei, Il Saggiatore (The Assayer, 1623), as translated by Stillman Drake (1957), Discoveries and Opinions of Galileo pp. 237–238, as quoted by di Francia 1981, p. 10.
- "If you can't solve a problem, then there is an easier problem you can solve: find it." —Pólya 1957, p. 114
- George Pólya (1954), Mathematics and Plausible Reasoning Volume I: Induction and Analogy in Mathematics.
- George Pólya (1954), Mathematics and Plausible Reasoning Volume II: Patterns of Plausible Reasoning.
- Pólya 1957, p. 142.
- Pólya 1957, p. 144.
- Lakatos 1976 documents the development, by generations of mathematicians, of Euler's formula for polyhedra.
- H.S.M. Coxeter (1973) Regular Polytopes ISBN 9780486614809, Chapter IX "Poincaré's proof of Euler's formula"
- Charles A. Weibel (ca. 1995) History of Homological Algebra
- Henri Poincaré, Sur l’analysis situs, Comptes rendusde l’Academie des Sciences 115 (1892), 633–636. as cited by Lakatos 1976, p. 162
- John Stillwell, reviewer (Apr 2014). Notices of the AMS. 61 (4), pp. 378–383, on Jeremy Gray's (2013) Henri Poincaré: A Scientific Biography (PDF).
- Lakatos 1976, p. 55.
- Mackay 1991, p. 100.
- Ioannidis, John P.A. (1 August 2005). "Why Most Published Research Findings Are False". PLOS Medicine. 2 (8): e124. doi:10.1371/journal.pmed.0020124. ISSN 1549-1277. PMC 1182327. PMID 16060722.
- Dunbar, K., & Fugelsang, J. (2005). Causal thinking in science: How scientists and students interpret the unexpected. In M.E. Gorman, R.D. Tweney, D. Gooding & A. Kincannon (Eds.), Scientific and Technical Thinking (pp. 57–79). Mahwah, NJ: Lawrence Erlbaum Associates.
- Oliver, J.E. (1991). "Ch 2". The incomplete guide to the art of discovery. New York: Columbia University Press. ISBN 9780231076203.
- Born, Max (1949), Natural Philosophy of Cause and Chance, Peter Smith, also published by Dover, 1964. From the Waynflete Lectures, 1948. On the web. N.B.: the web version does not have the 3 addenda by Born, 1950, 1964, in which he notes that all knowledge is subjective. Born then proposes a solution in Appendix 3 (1964)
- Brody, Thomas A. (1993), Luis de la Peña; Peter E. Hodgson (eds.), The Philosophy Behind Physics, Berlin; New York: Springer Verlag, ISBN 978-0-387-55914-8.
- Bruno, Leonard C. (1989), The Landmarks of Science, ISBN 978-0-8160-2137-6
- Bynum, W.F.; Porter, Roy (2005), Oxford Dictionary of Scientific Quotations, Oxford, ISBN 978-0-19-858409-4.
- Cowles, Henry M. (2020), The Scientific Method: An Evolution of Thinking from Darwin to Dewey, Cambridge, MA: Harvard University Press, ISBN 978-0674976191
- Dales, Richard C. (1973), The Scientific Achievement of the Middle Ages (The Middle Ages Series), University of Pennsylvania Press, ISBN 978-0-8122-1057-6
- Dewey, John (1910), How we think, Boston: D. C. Heath and Company, OCLC 194219 Public domain in the US. 236 pages
- di Francia, G. Toraldo (1981), The Investigation of the Physical World, Cambridge University Press, ISBN 978-0-521-29925-1.
- Einstein, Albert; Infeld, Leopold (1938), The Evolution of Physics: from early concepts to relativity and quanta, New York: Simon and Schuster, ISBN 978-0-671-20156-2
- Feynman, Richard (1965), The Character of Physical Law, Cambridge: M.I.T. Press, ISBN 978-0-262-56003-0.
- Fleck, Ludwik (1979), Genesis and Development of a Scientific Fact, Univ. of Chicago, ISBN 978-0-226-25325-1. (written in German, 1935, Entstehung und Entwickelung einer wissenschaftlichen Tatsache: Einführung in die Lehre vom Denkstil und Denkkollectiv) English translation by Thaddeus J. Trenn and Fred Bradley, 1979 Edited by Thaddeus J. Trenn and Robert K. Merton. Foreword by Robert K. Merton
- Galileo Galilei (1638), Discorsi e Dimonstrazioni Matematiche, intorno a due nuoue scienze [Discourses and Mathematical Demonstrations Relating to Two New Sciences] (in Italian and Latin), Leiden: House of Elzevir.
- Englist translation: Galileo Galilei (2003) [1914 by Macmillan]. Dialogues concerning two new sciences. Translated by Henry Crew & Alfonso de Salvio (reprint ed.). New York: Dover. ISBN 978-0-486-60099-4. Additional publication information is from the collection of first editions of the Library of Congress surveyed by Bruno 1989, pp. 261–264.
- Gauch, Hugh G. Jr. (2003), Scientific Method in Practice, Cambridge University Press, ISBN 978-0-521-01708-4
- Glen, William, ed. (1994), The Mass-Extinction Debates: How Science Works in a Crisis, Stanford, CA: Stanford University Press, ISBN 978-0-8047-2285-8.
- Godfrey-Smith, Peter (2003), Theory and Reality: An introduction to the philosophy of science, University of Chicago Press, ISBN 978-0-226-30063-4.
- Goldhaber, Alfred Scharff; Nieto, Michael Martin (January–March 2010), "Photon and graviton mass limits", Rev. Mod. Phys., 82 (1): 939–979, arXiv:0809.1003, Bibcode:2010RvMP...82..939G, doi:10.1103/RevModPhys.82.939, S2CID 14395472
- Hockney, David (2006), Secret Knowledge: rediscovering the lost techniques of the old masters (expanded ed.), ISBN 0-14-200512-6
- Jevons, William Stanley (1874), The Principles of Science: A Treatise on Logic and Scientific Method, Dover Publications, ISBN 978-1-4304-8775-3. 1877, 1879. Reprinted with a foreword by Ernst Nagel, New York, 1958.
- Judson, Horace Freeland (1979), The Eighth Day of Creation, ISBN 0-671-22540-5
- Kuhn, Thomas S. (1961), "The Function of Measurement in Modern Physical Science", ISIS, 52 (2): 161–193, doi:10.1086/349468, S2CID 144294881 JSTOR
- Lakatos, Imre (1976), John Worrall; Elie Zahar (eds.), Proofs and Refutations, Cambridge: Cambridge University Press, ISBN 978-0-521-29038-8
- Lindberg, David C. (2007), The Beginnings of Western Science, University of Chicago Press 2nd edition 2007.
- Mackay, Alan L., ed. (1991), Dictionary of Scientific Quotations, London: IOP Publishing Ltd, ISBN 978-0-7503-0106-0
- McCarty, Maclyn (1985), The Transforming Principle: Discovering that genes are made of DNA, New York: W.W. Norton, ISBN 978-0-393-30450-3. Memoir of a researcher in the Avery–MacLeod–McCarty experiment.
- McElheny, Victor K. (2004), Watson & DNA: Making a scientific revolution, Basic Books, ISBN 978-0-7382-0866-4.
- Moulton, Forest Ray; Schifferes, Justus J., eds. (1960), The Autobiography of Science (2nd ed.), Doubleday.
- Needham, Joseph; Wang, Ling (王玲) (1954), Science and Civilisation in China Vol. 1: Introductory Orientations, Cambridge University Press
- Newton, Isaac (1999) [1687, 1713, 1726], Philosophiae Naturalis Principia Mathematica, University of California Press, ISBN 978-0-520-08817-7, Third edition. From I. Bernard Cohen and Anne Whitman's 1999 translation.
- Ørsted, Hans Christian (1997), Selected Scientific Works of Hans Christian Ørsted, Princeton, ISBN 978-0-691-04334-0. Translated to English by Karen Jelved, Andrew D. Jackson, and Ole Knudsen, (translators 1997).
- Peirce, C.S. – see Charles Sanders Peirce bibliography.
- Poincaré, Henri (1905), Science and Hypothesis, London: Walter Scott Publishing – via The Mead Project .
- Pólya, George (1957), How to Solve It (2nd ed.), Princeton University Press, OCLC 4140462 (Pólya, George (2009). Reprint. ISBN 978-4-87187-830-2. OCLC 706968824.}
- Popper, Karl R. (1959) , The Logic of Scientific Discovery (English ed.).
- Popper, Karl R. (1963), Conjectures and Refutations: The Growth of Scientific Knowledge, Routledge, ISBN 0-415-28594-1.
- Popper, Karl R. (2005) [1959, Enlish ed.], The Logic of Scientific Discovery (PDF), Taylor & Francis e-Library, ISBN 0-203-99462-0, archived from the original on 2013-07-22CS1 maint: unfit URL (link).
- Sambursky, Shmuel, ed. (1974), "Physical Thought from the Presocratics to the Quantum Physicists", Physics Today, Pica Press, 29 (2): 51–53, Bibcode:1976PhT....29b..51S, doi:10.1063/1.3023315, ISBN 978-0-87663-712-8.
- Sanches, Francisco; Limbrick, Elaine. Introduction, Notes, and Bibliography; Thomson, Douglas F.S. Latin text established, annotated, and translated. (1988) , That Nothing is Known (Quod nihil scitur), Cambridge, UK; New York: Cambridge University Press, ISBN 978-0-521-35077-8, OCLC 462156333 Critical edition.
- Smith, A. Mark (2001). "Alhacen's Theory of Visual Perception: A Critical Edition, with English Translation and Commentary, of the First Three Books of Alhacen's "De aspectibus", the Medieval Latin Version of Ibn al-Haytham's "Kitāb al-Manāẓir": Volume One". Transactions of the American Philosophical Society. 91 (4): 1–337. doi:10.2307/3657358. JSTOR 3657358.
- Smith, A. Mark (2001). "Alhacen's Theory of Visual Perception: A Critical Edition, with English Translation and Commentary, of the First Three Books of Alhacen's "De aspectibus", the Medieval Latin Version of Ibn al-Haytham's "Kitāb al-Manāẓir": Volume Two". Transactions of the American Philosophical Society. 91 (5): 339–819. doi:10.2307/3657357. JSTOR 3657357.
- Smith, A. Mark, ed. and trans. (2010). "Alhacen on Refraction: a critical edition, with English translation and commentary, of Book 7 of Alhacen's De aspectibus, [the Medieval Latin version of Ibn al-Haytham's Kitāb al-Manāzir], Transactions of the American Philosophical Society, 2 vols: 100#3, section 1 — Vol 1, Introduction and Latin text); 100(#3, section 2 — Vol 2 English translation). Philadelphia". American Philosophical Society. Book 7 (2010) Vol 1 Commentary and Latin text via JSTOR;Vol 2 English translation, Notes, Bibl. via JSTOR
- Taleb, Nassim Nicholas (2007), The Black Swan, Random House, ISBN 978-1-4000-6351-2
- Voelkel, James R. (2001), Johannes Kepler and the New Astronomy, Oxford University Press
- Watson, James D. (1968), The Double Helix, New York: Atheneum, Library of Congress card number 68-16217.
- Bauer, Henry H., Scientific Literacy and the Myth of the Scientific Method, University of Illinois Press, Champaign, IL, 1992
- Beveridge, William I.B., The Art of Scientific Investigation, Heinemann, Melbourne, Australia, 1950.
- Bernstein, Richard J., Beyond Objectivism and Relativism: Science, Hermeneutics, and Praxis, University of Pennsylvania Press, Philadelphia, PA, 1983.
- Brody, Baruch A. and Capaldi, Nicholas, Science: Men, Methods, Goals: A Reader: Methods of Physical Science, W.A. Benjamin, 1968
- Brody, Baruch A. and Grandy, Richard E., Readings in the Philosophy of Science, 2nd edition, Prentice-Hall, Englewood Cliffs, NJ, 1989.
- Burks, Arthur W., Chance, Cause, Reason: An Inquiry into the Nature of Scientific Evidence, University of Chicago Press, Chicago, IL, 1977.
- Chalmers, Alan, What Is This Thing Called Science?. Queensland University Press and Open University Press, 1976.
- Crick, Francis (1988), What Mad Pursuit: A Personal View of Scientific Discovery, New York: Basic Books, ISBN 978-0-465-09137-9.
- Crombie, A.C. (1953), Robert Grosseteste and the Origins of Experimental Science 1100–1700, Oxford
- Earman, John (ed.), Inference, Explanation, and Other Frustrations: Essays in the Philosophy of Science, University of California Press, Berkeley & Los Angeles, CA, 1992.
- Fraassen, Bas C. van, The Scientific Image, Oxford University Press, Oxford, 1980.
- Franklin, James (2009), What Science Knows: And How It Knows It, New York: Encounter Books, ISBN 978-1-59403-207-3.
- Gadamer, Hans-Georg, Reason in the Age of Science, Frederick G. Lawrence (trans.), MIT Press, Cambridge, MA, 1981.
- Giere, Ronald N. (ed.), Cognitive Models of Science, vol. 15 in 'Minnesota Studies in the Philosophy of Science', University of Minnesota Press, Minneapolis, MN, 1992.
- Hacking, Ian, Representing and Intervening, Introductory Topics in the Philosophy of Natural Science, Cambridge University Press, Cambridge, 1983.
- Heisenberg, Werner, Physics and Beyond, Encounters and Conversations, A.J. Pomerans (trans.), Harper and Row, New York, 1971, pp. 63–64.
- Holton, Gerald, Thematic Origins of Scientific Thought: Kepler to Einstein, 1st edition 1973, revised edition, Harvard University Press, Cambridge, MA, 1988.
- Karin Knorr Cetina, Knorr Cetina, Karin (1999). Epistemic cultures: how the sciences make knowledge. Cambridge, Massachusetts: Harvard University Press. ISBN 978-0-674-25894-5.
- Kuhn, Thomas S., The Essential Tension, Selected Studies in Scientific Tradition and Change, University of Chicago Press, Chicago, IL, 1977.
- Latour, Bruno, Science in Action, How to Follow Scientists and Engineers through Society, Harvard University Press, Cambridge, MA, 1987.
- Losee, John, A Historical Introduction to the Philosophy of Science, Oxford University Press, Oxford, 1972. 2nd edition, 1980.
- Maxwell, Nicholas, The Comprehensibility of the Universe: A New Conception of Science, Oxford University Press, Oxford, 1998. Paperback 2003.
- Maxwell, Nicholas, Understanding Scientific Progress, Paragon House, St. Paul, Minnesota, 2017.
- McComas, William F., ed. (1998). "The Principal Elements of the Nature of Science: Dispelling the Myths" (PDF). The Nature of Science in Science Education. Netherlands: Kluwer Academic Publishers. pp. 53–70. Archived from the original (PDF) on 2014-07-01.
- Misak, Cheryl J., Truth and the End of Inquiry, A Peircean Account of Truth, Oxford University Press, Oxford, 1991.
- Piattelli-Palmarini, Massimo (ed.), Language and Learning, The Debate between Jean Piaget and Noam Chomsky, Harvard University Press, Cambridge, MA, 1980.
- Popper, Karl R., Unended Quest, An Intellectual Autobiography, Open Court, La Salle, IL, 1982.
- Putnam, Hilary, Renewing Philosophy, Harvard University Press, Cambridge, MA, 1992.
- Rorty, Richard, Philosophy and the Mirror of Nature, Princeton University Press, Princeton, NJ, 1979.
- Salmon, Wesley C., Four Decades of Scientific Explanation, University of Minnesota Press, Minneapolis, MN, 1990.
- Shimony, Abner, Search for a Naturalistic World View: Vol. 1, Scientific Method and Epistemology, Vol. 2, Natural Science and Metaphysics, Cambridge University Press, Cambridge, 1993.
- Thagard, Paul, Conceptual Revolutions, Princeton University Press, Princeton, NJ, 1992.
- Ziman, John (2000). Real Science: what it is, and what it means. Cambridge: Cambridge University Press.
|Wikimedia Commons has media related to Scientific method.|
|Wikibooks has a book on the topic of: The Scientific Method|
|Wikiversity has learning resources about Thinking Scientifically|
- Andersen, Anne; Hepburn, Brian. "Scientific Method". In Zalta, Edward N. (ed.). Stanford Encyclopedia of Philosophy.
- "Confirmation and Induction". Internet Encyclopedia of Philosophy.
- Scientific method at PhilPapers
- Scientific method at the Indiana Philosophy Ontology Project
- An Introduction to Science: Scientific Thinking and a scientific method by Steven D. Schafersman.
- Introduction to the scientific method at the University of Rochester
- Theory-ladenness by Paul Newall at The Galilean Library
- Lecture on Scientific Method by Greg Anderson
- Using the scientific method for designing science fair projects
- Scientific Methods an online book by Richard D. Jarrard
- Richard Feynman on the Key to Science (one minute, three seconds), from the Cornell Lectures.
- Lectures on the Scientific Method by Nick Josh Karean, Kevin Padian, Michael Shermer and Richard Dawkins
- "How Do We Know What Is True?" (animated video; 2:52)