Tag Archives: hypothesis testing

How Can We Best Advance Ecological Research

Leave a reply

Everyone who supports scientific research wishes to see progress in understanding of the problems being studied. Ecologists face four critical difficulties in achieving these goals of progress.

  •  There are far too many ecological problems to be sorted out given the number of ecologists in the scientific world. There is a partial solution to this issue by dividing the ecological research into two broad categories: large scale critical problems and small-scale local problems. Large-scale problems are those that apply to many communities and ecosystems, from the local to the global. Large scale problems require first an agreement of what these problems are and second how they should be approached – both difficult to achieve in the current research environment. So there is too little agreement even on this simple issue. Large-scale problems require a coordinated team effort and to date in ecology large-scale problems have been poorly addressed. Small scale problems can be studied with less person power and are much more common. In an ideal world, governments would fund large-scale research programs that require effort that stretches over many years and require considerable reliable funding, and smaller grants could support the many specific postgraduate studies with a time limit of 3-4 years. It would be optimal for these two groups to meld together but this is difficult to achieve. The whole system we have currently fights against this cooperation, partly because in the world of science most of the recognition and rewards go to individual scientists and not to a research team.
  •  A second problem is that there are two paradigms of ecological science that are only partly overlapping. The first paradigm in its strong form states that ecological science will advance most rapidly by means of descriptive studies of changes in communities and ecosystems. Gaiser et al. (2020) provide good examples of this approach. Long-Term-Ecological-Research (LTER) approaches are typically large-scale and rely too much on the assumptions of correlation = causation science, but this paradigm suggests that long-term data will lead us to the long-term understanding of communities and ecosystems. The second approach can be described as the mechanistic paradigm because it attempts to explain long- and short-term population and community changes from whatever cause using experimental methods (Krebs 2002). Hone and Krebs (2023) detail the evidence levels needed for strong inference in both short-term and long-term issues. Lindenmayer (2018) provides an excellent synopsis of the difficulties of long-term research and a synopsis of how we might act to answer ecological questions about future issues (Lindenmayer et al. 2015, Lindenmayer 2018).
  • The third difficulty is that the individual scientist as the unit of research makes it unlikely in the present organization of science funding that these two paradigms can be easily brought together. Scientists by and large wish to be independent, a desirable trait, but we can and should work in a team effort, an interlocking independent research program that has specified objectives that all are organized into a partnership. If you want examples of this approach, you have only to look at the successes and failures of many long-term ecological research (LTER) programs around the world. One example of a successful LTER research program in Austria is reviewed in Gingrich et al. (2016). Additional evaluations of current LTER projects can be found in Vanderbilt and Gaiser (2017) and Rastetter et al. (2021). There has been a movement to integrate social and ecological frameworks to LTER research. A good example of this social-ecological approach is disturbance ecology described for the USA in Gaiser et al. (2020). But ecological approaches of the type described in Vanderbilt and Gaiser (2017) and Gaiser et al. (2020) appear to reduce ecological research to an endless study of descriptive changes in ecosystems with little theory. The hope is to advance ecological science by observations of changes in ecosystems as affected by human activity and climate change. The objective of these research programs is to provide solutions for future environmental problems from long term data sets. However, describing the past does not inherently predict the future, as evidenced by the issues surrounding climate change.
  • A fourth problem is that the long-term funding necessary to understand new and continuing ecological problems too often falls to a new Director or Chief who wishes to change the direction of the research or stop it altogether, so long term objectives are not supported. Another aspect of the funding problem for LTER research is the lack of substantial funding on a spatial and monetary scale that would permit comprehensive research with suitable replication. Cusser at al. (2021) have analysed LTER studies in the USA with respect to how long studies must be to achieve good results. They concluded that half of the LTER studies required 10 years or more to produce consistent results, and some required more than 20 years. Many of these LTER studies are focused on the descriptive paradigm and would not qualify as experimental ecology with specific hypotheses about community and ecosystem dynamics. LTER descriptive studies are useful for advancing knowledge of trends, but they may not be sufficient to identify and test the underlying drivers of community and ecosystem change.

Cusser, S., Helms IV, J., Bahlai, C.A., and Haddad, N.M. 2021. How long do population level field experiments need to be? Utilising data from the 40-year-old LTER network. Ecology Letters 24(5): 1103-1111. doi:10.1111/ele.13710.

Gaiser, E.E., Bell, D.M., Castorani, M.C.N., Childers, D.L., and Groffman, P.M. 2020. Long-term ecological research and evolving frameworks of disturbance ecology. Bioscience 70(2): 141-156. doi:10.1093/biosci/biz162.

Gingrich, S., Schmid, M., Dirnbock, T., Dullinger, I. et al. 2016. Long-Term Socio-Ecological Research in Practice: Lessons from Inter- and Transdisciplinary Research in the Austrian Eisenwurzen. Sustainability 8(8): 743. doi:10.3390/su8080743.

Hone, J., and Krebs, C.J. 2023. Causality and wildlife management. Journal of Wildlife Management 2023: e22412. doi:10.1002/jwmg.22412.

Krebs, C.J. 2002. Two complementary paradigms for analyzing population dynamics. Philosophical Transactions of the Royal Society of London, Series B 357: 1211-1219. doi:10.1098/rstb.2002.1122.

Lindenmayer, D.B., Burns, E.L., Tennant, P., Dickman, C.R., Green, P.T., Keith, D.A., et al. 2015. Contemplating the future: Acting now on long-term monitoring to answer 2050’s questions. Austral Ecology 40(3): 213-224. doi:10.1111/aec.12207.

Lindenmayer, D. 2018. Why is long-term ecological research and monitoring so hard to do? (And what can be done about it). Australian Zoologist 39: 576-580. doi:10.7882/az.2017.018.

Rastetter, E.B., Ohman, M.D., Elliott, K.J., Rehage, J.S., and al., e. 2021. Time lags: insights from the U.S. Long Term Ecological Research Network. Ecosphere 12(5): e03431. doi:10.1002/ecs2.3431.

Vanderbilt, K., and Gaiser, E. 2017. The International Long Term Ecological Research Network: a platform for collaboration. Ecosphere 8(2): e01697. doi:10.1002/ecs2.1697.

On Discourse and Evidence

Leave a reply

A major problem that bedevils society as well as science today is the distinction between opinion and evidence. The world is awash in opinions and short of evidence for many questions that fill the news media as well as the scientific literature. In trying to evaluate this statement we should recognize that there are many important issues for which we have no evidence but only beliefs. A current discussion in the news media is whether or not any particular country should spend 2% of its GDP on military expenses. Much hot air follows from these discussions because as an individual person you have no evidence one way or the other for different points of view, spend more, spend less. You will have an opinion that everyone should respect but for this and many issues any evidence that can be cited is vague. Discussion on many issues like this example are important and should be civilized but often are not.

But there are a range of issues for which scientific evidence is available. The first rule of discourse on these issues ought to be that you as a person are allowed to have any opinion you wish but you must be able to present evidence to support your opinions. You should be allowed as a person to proclaim that the Earth is not round but flat and provide the evidence one way or the other. More serious issues with different opinions involve issues like vaccination for a particular disease. On these issues scientists can only advise and provide evidence. But if a vaccine X for example has a complex side effect rate of 1 person in 1000, you could always argue that you are that one person and you are opposed to vaccination X.

How does all this relate to ecological science? First, we should recognize that many of the arguments in the ecological literature are about opinions rather than evidence. In many cases this should lead to more studies of particular problems to gather more evidence. But as we see with climate change research the evidence is accumulating but varies greatly in quality and time span from area to area and from taxonomic group to taxonomic group. We cannot agree whether our research should be focused on the oceans or on land, or on birds rather than mammals or insects. We cannot do everything, and the consequence is that ecological research funding is driven in many directions depending on who is on the committee dispersing funding and what their opinions are. The result is that for large scale problems like climate change we have convinced most people that it is a reality, but we cannot agree on the details of future change. So, we build models with past data and try to project them into the future with uncertain confidence.

The consequence is that the ecological world is awash in opinions in the same way as other parts of society, and in support of opinions the evidence often gets lost. The main problem here is that opinions are generated rapidly while evidence accumulates slowly. We see this more readily in medical science in which the media trumpets treatment X rather than Y with opinions and little evidence. We cannot demand answers to important questions tomorrow when the problem spans years or decades for evidence to accumulate. 

Ecology like every science becomes more complicated with age, and a fisheries biologist trained 40 years ago lives in a different world from one trained today. The accumulated evidence from research changes our list of important questions illustrated well by the reviews of progress in conservation science by Sutherland et al. (2022, 2023) and Christie et al. (2023), in predator- prey dynamics by Sheriff et al. (2020), wildlife management by Hone et al. (2023), and in insect conservation by Saunders et al. (2020). Understanding and solving ecology problems must rely more on evidence and less on opinions.

Christie, A.P., Christie, A.P., Morgan, W.H. & Sutherland, W.J. (2023) Assessing diverse evidence to improve conservation decision‐making. Conservation Science and Practice, 5, e13024.doi. 10.1111/csp2.13024

Hone, J., Drake, A. & Krebs, C.J. (2023) Evaluation Options for Wildlife Management and Strengthening of Causal Inference. BioScience, 73, 48-58.doi: 10.1093/biosci/biac105.

Saunders, M.E., Janes, J.K. & O’Hanlon, J.C. (2020) Moving On from the Insect Apocalypse Narrative: Engaging with Evidence-Based Insect Conservation. BioScience, 70, 80-89.doi: 10.1093/biosci/biz143.

Sheriff, M.J., Peacor, S.D., Hawlena, D. & Thaker, M. (2020) Non-consumptive predator effects on prey population size: A dearth of evidence. Journal of Animal Ecology, 89, 1302-1316.doi: 10.1111/1365-2656.13213.

Sutherland, W.J. & Jake M. Robinson, D.C.A., Tim Alamenciak, Matthew Armes, Nina Baranduin, Andrew J. Bladon, Martin F. Breed, Nicki Dyas, Chris S. Elphick, Richard A. Griffiths, Jonny Hughes, Beccy Middleton, Nick A. Littlewood, Roger Mitchell, William H. Morgan, Roy Mosley, Silviu O. Petrovan, Kit Prendergast, Euan G. Ritchie,Hugh Raven, Rebecca K. Smith, Sarah H. Watts, Ann Thornton (2022) Creating testable questions in practical conservation: a process and 100 questions. Conservation Evidence Journal, 19, 1-7.doi. 10.52201/CEJ19XIFF2753

Sutherland, W.J., Sutherland, W.J., Bennett, C. & Thornton, A. (2023) A global biological conservation horizon scan of issues for 2023. Trends in Ecology & Evolution, 38, 96-107.doi. 10.1016/j.tree.2022.10.005

Should Ecology Abandon Popper?

2 Replies

The first question I must ask is whether you the reader have ever heard of Karl Popper. If the answer is no, then you could profit from reading Popper (1963) before you read this. An abbreviated version of the Popperian approach to science is presented in a short paper by Platt (1963) The simplest version of Popper and Platt is that we should have a hypothesis with specific predictions and one or more alternative hypotheses with other predictions, and science advances by finding out which hypotheses could be rejected with empirical evidence. The focus of this blog is on a recent paper by Raerinne (2024) claiming that Popperian ecology is a delusion. This is a claim well worth discussing particularly since most of the sciences progress using a Popperian approach to testing hypotheses.

To begin perhaps we should recognize two kinds of papers that appear in ecological journals. A very large set of ecological papers appear to be largely or entirely descriptive natural history typically of past or present events with no hypotheses in mind. Many of these papers end with a conclusion that could be designated as a hypothesis but with little discussion of alternatives. These papers can be very valuable in giving us the state of populations, communities, or ecosystems with recommendations for changes that should be made to alleviate developing problems. A good example are papers describing forest and grassland fires of recent years which can end with some management recommendations, and perhaps with alternative recommendations. These recommendations usually arise from experience and judgements, and they may or not be valid. The Popperian approach would be to set up hypotheses and test them empirically, but if we are people of action, we press onward with a preferred management action. The non-Popperian approach would be very efficient if we were correct in our diagnosis, and in many cases this approach works well. The basis of the issue here is what is evidence in ecology and how should it be sharpened into recommendations for conservation and management.  

The Popperian approach to ecological science is to recognize problems that require a solution to increase our knowledge base, and to suggest a series of alternative set of mechanisms that could solve or alleviate the problem. Ecological papers supporting this approach can often be recognized by searching for the word “hypothesis” in the text. A simple example of this Popperian approach could be finding the causes of the continuing decline of a commercial fishery. The decline might be due to predation on the target fish or invertebrate, a disease, added pollution to the water body, climate change increasing the water temperature and thus metabolic functions, introduced species of competitors for food or space. One or more of these causal factors could be involved and the job of the ecologist is to find out which one or several are diagnostic. Given the complexity of ecological problems, it is typically not possible to test these alternative hypotheses in one grand experiment, and the typical approach will involve adaptive management or evidence-based conservation (Gillson et al. 2019, Serrouya et al., Westgate et al. 2013). Complexity however should not be used as an excuse to do poor science.

What is the alternative if we abandon Popper? We could adopt the inductive approach and gather data that we put together with our judgement to declare that we have a correct answer to our questions, “seat of the pants” ecology. But this approach is heavily dependent on the idea that “the future will be like the past”. This approach to ecological problems will be most useful for the very short term. The simplest example comes from weather forecasting in which the prognosis for today’s weather is what it was like yesterday with minor adjustments. We could observe trends with this approach but then we must have a statistical model that predicts, for example, that the trend is linear or exponential. But the history of science is that we can do much better by understanding the mechanisms underlying the changes we see. A good overview of the dilemmas of this inductive approach for conservation biology is provided by Caughley (1994). The operative question here is whether the inductive approach achieves problem resolutions more efficiently than the Popperian approach through conjecture and refutation.

Raerinne (2023, 2024) does biology in general and ecology in particular a disservice in criticizing Popper’s approach to ecology by arguing that ecology should not be criticized nor evaluated from the Popperian perspective. I think this judgement is wrong, and Raerinne’s conclusion arises from a philosophical viewpoint which could well have little applicability to how ecologists solve empirical problems in the real world. But you can judge.  

Carducci, A., Federigi, I. & Verani, M. (2020) Airborne transmission and its prevention: Waiting for evidence or applying the Precautionary Principle? Atmosphere, 11 (7), 710.doi: 10.3390/atmos11070710.

Caughley, G. (1994) Directions in conservation biology. Journal of Animal Ecology, 63, 215-244. doi: 10.2307/5542.

Gillson, L., Biggs, H. & Rogers, K. (2019) Finding common ground between adaptive management and evidence-based approaches to biodiversity conservation. Trends in Ecology & Evolution, 34, 31-44.doi: 10.1016/j.tree.2018.10.003.

Platt, J.R. (1964) Strong inference. Science, 146, 347-353.doi: 10.1126/science.146.3642.347.

Popper, K.R. (1963) Conjectures and Refutations: The Growth of Scientific Knowledge. Routledge and Kegan Paul, London.

Raerinne, J. (2023) Myths of past biases and progress in biology. Theory in Biosciences, 142, 383-399.doi: 10.1007/s12064-023-00403-2.

Raerinne, J. (2024) Popperian ecology is a delusion. Ecology and Evolution, 14, e11106.doi: 10.1002/ece3.11106.

Serrouya, R., Seip, D.R., Hervieux, D., McLellan, B.N., McNay, R.S., Steenweg, R., Heard, D.C., Hebblewhite, M., Gillingham, M. & Boutin, S. (2019) Saving endangered species using adaptive management. Proceedings of the National Academy of Sciences, 116, 6181-6186.doi: 10.1073/pnas.1816923116 .

Westgate, M.J., Likens, G.E. & Lindenmayer, D.B. (2013) Adaptive management of biological systems: A review. Biological Conservation, 158, 128-139.doi: 10.1016/j.biocon.2012.08.016 .

Do We Need to Replicate Ecological Experiments?

Leave a reply

If you read papers on the philosophy of science you will very quickly come across the concept of replication, the requirement to test the same hypothesis twice or more before you become too attached to your conclusions. As a new student or a research scientist you face this problem when you wish to replicate some previous study. If you do replicate, you risk being classed as an inferior scientist with no ideas of your own. If you refuse to replicate and try something new, you will be criticized as reckless and not building a solid foundation in your science.  

There is an excellent literature discussing the problem of replication in ecology in particular and science in general. Nichols et al. (2019) argue persuasively that a single experiment is not enough. Amrheim et al. (2019) approach the problem from a statistical point of view and caution that single statistical tests are a shaky platform for drawing solid conclusions. They point out that statistical tests not only test hypotheses, but also countless assumptions and particularly for ecological studies the exact plant and animal community in which the study takes place. In contrast to ecological science, medicine probably has more replication problems at the other extreme – too many replications – leading to a waste of research money and talent. (Siontis and Ioannidis 2018).

A graduate seminar could profitably focus on a list of the most critical experiments or generalizations of our time in any subdiscipline of ecology. Given such a list we could ask if the conclusions still stand as time has passed, or perhaps if climate change has upset the older predictions, or whether the observations or experiments have been replicated to test the strength of conclusions. We can develop a stronger science of ecology only if we recognize both the strengths and the limitations of our current ideas.

Baker (2016) approached this issue by asking the simple question “Is there a reproducibility crisis?” Her results are well worth visiting. She had to cast a wide net in the sciences so unfortunately there are no details specific to ecological science in this paper. A similar question in ecology would have to distinguish observational studies and experimental manipulations to narrow down a current view of this issue. An interesting example is explored in Parker (2013) who analyzed a particular hypothesis in evolutionary biology about plumage colour in a single bird species, and the array of problems of an extensive literature on sexual selection in this field is astonishing.

A critic might argue that ecology is largely a descriptive science that should not expect to develop observational or experimental conclusions that will extend very much beyond the present. If that is the case, one might argue that replication over time is important for deciding when an established principle is no longer valid. Ecological predictions based on current knowledge may have much less reliability than we would hope, but the only way to find out is to replicate. Scientific progress depends on identifying goals and determining how far we have progressed to achieving these goals (Currie 2019). To advance we need to discuss replication in ecology.

Amrhein, V., Trafinnow, D. & Greenland, S. (2019) Inferential statistics as descriptive statistics: There is no replication crisis if we don’t expect replication. American Statistician, 73, 262-270. doi: 10.1080/00031305.2018.1543137.

Baker, M. (2016) Is there a reproducibility crisis in science? Nature, 533, 452-454.

Currie, D.J. (2019) Where Newton might have taken ecology. Global Ecology and Biogeography, 28, 18-27. doi: 10.1111/geb.12842.

Nichols, J.D., Kendall, W.L. & Boomer, G.S. (2019) Accumulating evidence in ecology: Once is not enough. Ecology and Evolution, 9, 13991-14004. doi: 10.1002/ece3.5836.

Parker, T.H. (2013) What do we really know about the signalling role of plumage colour in blue tits? A case study of impediments to progress in evolutionary biology. Biological Reviews, 88, 511-536. doi: 10.1111/brv.12013.

Siontis, K.C. & Ioannidis, J.P.A. (2018) Replication, duplication, and waste in a quarter million systematic reviews and meta-analyses. Circulation: Cardiovascular quality and outcomes, 11, e005212. doi: 10.1161/CIRCOUTCOMES.118.005212.

On Ecology and Medicine

Leave a reply

As I grow older and interact more with doctors, it occurred to me that the two sciences of medicine and ecology have very much in common. That is probably not a very new idea, but it may be worth spending time on looking at the similarities and differences of these two areas of science that impinge on our lives. The key question for both is how do we sort out problems? Ecologists worry about population, community and ecosystem problems that have two distinguishing features. First, the problems are complex and the major finding of this generation of ecologists is to begin to understand and appreciate how complex they are. Second, the major problems that need solving to improve conservation and wildlife management are difficult to study with the classical tools of experimental, manipulative scientific methods. We do what we can to achieve scientific paradigms but there are many loose ends we can only wave our hands about. As an example, take any community or ecosystem under threat of global warming. If we heat up the oceans, many corals will die along with the many animals that depend on them. But not all corals will die, nor will all the fish and invertebrate species, and the ecologists is asked to predict what will happen to this ecosystem under global warming. We may well understand from rigorous laboratory research about temperature tolerances of corals, but to apply this to the real world of corals in oceans undergoing many chemical and physical changes we can only make some approximate guesses. We can argue adaptation, but we do not know the limits or the many possible directions of what we predict will happen.

Now consider the poor physician who must deal with only one species, Homo sapiens, and the many interacting organs in the body, the large number of possible diseases that can affect our well-being, the stresses and strains that we ourselves cause, and the physician must make a judgement of what to do to solve your particular problem. If you have a broken arm, it is simple thankfully. If you have severe headaches or dizziness, many different causes come into play. There is no need to go into details that we all appreciate, but the key point is that physicians must solve problems of health with judgements but typically with no ability to do the kinds of experimental work we can do with mice or rabbits in the laboratory. And the result is that the physician’s judgements may be wrong in some cases, leading possibly to lawyers arguing for damages, and one appreciates that once we leave the world of medical science and enter the world of lawyers, all hope for solutions is near impossible.

There is now some hope that artificial intelligence will solve many of these problems both in ecological science and in medicine, but this belief is based on the premise that we know everything, and the only problem is to find the solutions in some forgotten textbook or scientific paper that has escaped our memory as humans. To ask that artificial intelligence will solve these basic problems is problematic because AI depends on past knowledge and science solves problems by future research.

Everyone is in favour of personal good health, but alas not everyone favours good environmental science because money is involved. We live in a world where major problems with climate change have had solutions presented for more than 50 years, but little more than words are presented as the solutions rather than action. This highlights one of the main differences between medicine and ecology. Medical issues are immediate since we have active lives and a limited time span of life. Ecological issues are long-term and rarely present an immediate short-term solution. Setting aside protected areas is in the best cases a long-term solution to conservation issues, but money for field research is never long term and ecologists do not live forever. Success stories for endangered species often require 10-20 years or more before success can be achieved; research grants are typically presented as 3- or 5-year proposals. The time scale we face as ecologists is like that of climate scientists. In a world of immediate daily concerns in medicine as in ecology, long-term problems are easily lost to view.

There has been an explosion of papers in the last few years on artificial intelligence as a potentially key process to use for answering both ecological and medical questions (e.g. Buchelt et al. 2024, Christin, Hervet, and Lecomte, 2019, Desjardins-Proulx, Poisot, & Gravel, 2019). It remains to be seen exactly how AI will help us to answer complex questions in ecology and medicine. AI is very good in looking back, but will it be useful to solve our current and future problems? Perhaps we still need to continue training good experimental scientists in ecology and in medicine.  

Buchelt, A., Buchelt, A., Adrowitzer, A. & Holzinger, A. (2024) Exploring artificial intelligence for applications of drones in forest ecology and management. Forest Ecology and Management, 551, 121530. doi: 10.1016/j.foreco.2023.121530.

Christin, S., Hervet, É. & Lecomte, N. (2019) Applications for deep learning in ecology. Methods in Ecology and Evolution, 10, 1632-1644. doi: 10.1111/2041-210X.13256.

Desjardins-Proulx, P., Poisot, T. & Gravel, D. (2019) Artificial Intelligence for ecological and evolutionary synthesis. Frontiers in Ecology and Evolution, 7. doi: 10.3389/fevo.2019.00402.

On Critical Evaluation in Ecology

Leave a reply

Science proceeds by “conjecture-and-refutation” if we agree with Karl Popper (1963). There is a rich literature on science in general and ecological science in particular that is well worth a series of graduate discussions even if it is pre-2000 ancient history (Peters 1991, Weiner 1995, Woodward and Goodstein 1996). But I wish to focus on a current problem that I think is hindering ecological progress. I propose that ecological journals at this time are focusing their publications on papers that present apparent progress and are shedding papers that are critical of apparent progress. Or in Popper’s words, they focus on publishing ‘conjecture’ and avoid ‘refutation’. The most important aspect of this issue involves wildlife management and conservation issues. The human side of this issue may involve personal criticism and on occasion the loss of a job or promotion. The issue arises in part because of a confusion between the critique of ideas or data and the interpretation that all critiques are personal. So, the first principle of this discussion is that I discuss here only critiques of ideas or data.

There are many simple reasons for critiques of experimental design and data gathering. Are the treatments replicated, are the estimates of data variables reliable and sufficient, are proxy variables good or poor? Have the studies been carried out long enough? All these critiques can be summarized under the umbrella of measurement reliability. There are many examples we can use to illustrate these ideas. Are bird populations declining across the globe or locally? Are fisheries overharvesting particular species? Can we use climate change as a universal explanation of all changes in wildlife populations? Are survey methods for population changes across very large areas reliable? The problem is tied into the need for good or bad news that must be filtered to the news media or social media with high impact but little reliability. 

The problem at the level of science is the temptation to extrapolate beyond the limits of the available data. Now we come to the critical issue – how do our scientific journals respond to critical reviews of papers already published? My concern is that in the present time journals do not wish to receive or accept manuscripts that are critical of previously published papers. These decisions are no doubt confidential for journal publishers. There is perhaps some justification for this rejection policy, given that in the few cases where critiques are published on existing papers, the citation score of the original paper may greatly exceed that of the critique. So, conjecture pays, refutation does not.

Journals are flooded with papers and for the better journals I would expect at least a 60-80% rejection rate. For Science the rejection rate is 94%, for Nature 92%, and for the Journal of Animal Ecology 85% of submitted manuscripts are rejected. Consequently, the suggestion that they reserve space for ‘refutation’ is too negative to their publication model. There is little I can suggest if one in caught in this dilemma except to try another less premium journal, and remember that web searches find papers easily no matter where published. If you need inspiration, you can follow Peters (1991) and write a book critique and suffer the brickbats from the establishment (e.g. Nature 354: 444, 12 December 1991).

But if you are upset about a particular paper or series of papers, remember critiques are valuable but follow these rules for a critique:

  1. Keep it short, 5 typed pages should be near maximal length.
  2. Raise a set of major points. Do not try to cover everything.
  3. Summarize briefly the key points you are in agreement with, so they are not confounded in the discussion.
  4. Discuss what studies might distinguish hypothesis A vs B, or A+B vs C.
  5. Discuss what better methods of measurement might be used if funding is available.
  6. Never attack individuals or research groups. The discussion is about ideas, results, and inferences.

Decisions to accept some management actions may have to be taken immediately and journal editors must take that into consideration. Prognostication over accepting critiques may be damaging. But all actions must be continually evaluated and changed once the understanding of the problem changes.

There are too many examples to recommend reading about past and present controversies in ecology, so here are only two examples. Dowding et al. (2009) report a comment on suggested methods of controlling introduced pests on Macquarie Island in the Southern Ocean. I was involved in that discussion. A much bigger controversy in Canada involves Southern Mountain caribou populations which are in rapid decline. The proximate explanation for the decline is postulated to be predation by wolves and thus the suggested management action is shooting the wolves. Johnson et al. (2022), Lamb et al. (2022) and Superbie et al. (2022) provide an entre into this literature and the decisions of what to do now and in the future to prevent extinction of these ungulates. The caribou problem is complicated by the interaction of human alteration of landscapes and the natural processes of predation and food availability. Alas nothing is simple.

All these ecological dilemmas are controversial and the important role of criticism involving evaluations of alternative hypotheses are the only way forward for ecologists involved in controversies. In my opinion most ecological journals are not doing their part is publishing critiques of the conventional wisdom.

Dowding, J.E., Murphy, E.C., Springer, K., Peacock, A.J. & Krebs, C.J. (2009) Cats, rabbits, Myxoma virus, and vegetation on Macquarie Island: a comment on Bergstrom et al. (2009). Journal of Applied Ecology, 46, 1129-1132. doi: 10.1111/j.1365-2664.2009.01690.x.

Johnson, C.J., Ray, J.C. & St-Laurent, M.-H. (2022) Efficacy and ethics of intensive predator management to save endangered caribou. Conservation Science and Practice, 4: e12729. doi: 10.1111/csp2.12729.

Lamb, C.T., Willson, R., Richter, C., Owens-Beek, N., Napoleon, J., Muir, B., McNay, R.S., Lavis, E., Hebblewhite, M., Giguere, L., Dokkie, T., Boutin, S. & Ford, A.T. (2022) Indigenous-led conservation: Pathways to recovery for the nearly extirpated Klinse-Za mountain caribou. Ecological Applications 32 (5): e2581. doi: 10.1002/eap.2581.

Peters, R.H. (1991) A Critique for Ecology. Cambridge University Press, Cambridge, England. 366 pp. ISBN:0521400171.

Popper, K.R. (1963) Conjectures and Refutations: The Growth of Scientific Knowledge. Routledge and Kegan Paul, London. 412 pp. ISBN-13: 978-0415285940.

Superbie, C., Stewart, K.M., Regan, C.E., Johnstone, J.F. & McLoughlin, P.D. (2022) Northern boreal caribou conservation should focus on anthropogenic disturbance, not disturbance-mediated apparent competition. Biological Conservation, 265, 109426. doi: 10.1016/j.biocon.2021.109426.

Weiner, J. (1995) On the practice of ecology. Journal of Ecology, 83, 153-158.

Woodward, J. & Goodstein, D. (1996) Conduct, misconduct and the structure of science. American Scientist, 84, 479-490.

Back to Nature vs. Nurture

2 Replies

The ancient argument of ‘nature’ versus ‘nurture’ continues to arise in biology. The question has arisen very forcefully in a new book by James Tabery (Tabery 2023). The broad question he examines in this book is the conflict between ‘nature’ and ‘nurture’ in western medicine. In a broad sense ‘nature’ is discussed as the modern push in medicine to find the genetic basis of some of the common human degenerative diseases – Parkinson’s, dementia, asthma, diabetes, cancer, hypertension – to mention only a few medical problems of our day. The ‘nature’ approach to medicine in this book is represented by molecular genetics and the Human Genome Project. The ‘nurture’ approach to treating these medical conditions is via studying health outcomes in people subject to environmental contamination, atmospheric pollution, water quality, chemicals in food preparations, asbestos in buildings, and other environmental issues including how children are raised and educated. The competition over these two approaches was won very early by the Human Genome Project, and many of the resources for medicine over the last 30 years were put into molecular biology which made spectacular progress in diving into the genome of affected people and then making great promises of personalized medicine. The environmental approach to these medical conditions received much less money and was not viewed as sufficiently scientific. The irony of all this in retrospect is that the ‘nature’ or DNA school had no hypotheses about the problems being investigated but relied on the assumption that if we got enough molecular genetic data on thousands of people that something would jump out at us, and we would locate for example the gene(s) causing Parkinson’s, and then we could alter these genes with gene therapy or specific pharmaceuticals. By contrast the ‘nurture’ school had many specific hypotheses to test about air pollution and children’s health, about lead in municipal water supply and brain damage, and a host of very specific insights about how some of these health problems could be alleviated by legislation and changes in diet for example.

So, the question then becomes where are we today? The answer Tabery (2023) gives is that the ‘nature’ or molecular genetic “personalized medicine” approach has largely failed in achieving its goals despite the large amount of money invested because there is no single or small set of genes that cause specific diseases, but many genes that have complex interactions. In contrast, the ‘nurture’ school has made progress in identifying conditions that help decrease the occurrence of some of our common diseases, realizing that the problems are often difficult because they require changes in human behaviour like stopping smoking or improving diets.

All this discussion would possibly produce the simple conclusion that both “nature” and “nurture” are both involved in these complex human conditions. So, what could this medical discussion tell us about the condition of modern ecological science? I think two things perhaps. First, it is a general error to use science without hypotheses. Yet this is too often what ecologists do – gather a large amount of data that can be measured without too much prolonged effort and then try to make sense of it by applying hypotheses after the fact. And second, technology in ecology can be a benefit or a curse. Take, for example, the advances in vertebrate ecology that have come from the ability to describe the movements of individual animals in space. To have a map of hundreds of locations of an individual animal provides good natural history but does not address any specific hypothesis. Contrast this approach with that of Studd et al. (2021) and Shiratsuru et al. (2023) who use movement data to test important questions about kill rates of predators on different species of prey.

Many large-scale ecological approaches suffer from the same problem as the ‘nature’ paradigm – use ‘big science’ to measure many variables and then try to answer some important question for example about how climate change is affecting communities of plants and animals. Nagy et al. (2021) and Li et al. (2022) provide excellent examples of this approach. Schimel and Keller (2015) discuss what is needed to bring hypothesis testing to ‘big science’. Lindenmayer et al. (2018) discuss how conventional, question-driven long-term monitoring and hypothesis testing need to be combined with ‘big science’ to better ecological understanding. Pau et al. (2022) give a warning of how ‘big science’ data from airborne imaging can fail to agree with ground-based field studies in one core NEON grassland site in central USA.

The conclusion to date is that there is little integration in ecology of the equivalent of “nature” and “nurture” in medicine if in ecology we match ‘big science’ with ‘nature’ and field studies on the ground with ‘nurture’. Without that integration we risk in future another negative review in ecology like that provided now by Tabery (2023) for medical approaches to human diseases.

Lindenmayer, D.B., Likens, G.E. & Franklin, J.F. (2018) Earth Observation Networks (EONs): Finding the Right Balance. Trends in Ecology & Evolution, 33, 1-3.doi: 10.1016/j.tree.2017.10.008.

Li, D., et al. (2022) Standardized NEON organismal data for biodiversity research. Ecosphere, 13, e4141.doi:10.1002/ecs2.4141.

Nagy, R.C., et al. (2021) Harnessing the NEON data revolution to advance open environmental science with a diverse and data-capable community. Ecosphere, 12, e03833.doi: 10.1002/ecs2.3833.

Pau, S., et al. (2022) Poor relationships between NEON Airborne Observation Platform data and field-based vegetation traits at a mesic grassland. Ecology, 103, e03590.doi: 10.1002/ecy.3590.

Schimel, D. & Keller, M. (2015) Big questions, big science: Meeting the challenges of global ecology. Oecologia, 177, 925-934.doi: 10.1007/s00442-015-3236-3.

Shiratsuru, S., Studd, E.K., Majchrzak, Y.N., Peers, M.J.L., Menzies, A.K., Derbyshire, R., Jung, T.S., Krebs, C.J., Murray, D.L., Boonstra, R. & Boutin, S. (2023) When death comes: Prey activity is not always predictive of diel mortality patterns and the risk of predation. Proceedings of the Royal Society B, 290, 20230661.doi.

Studd, E.K., Derbyshire, R.E., Menzies, A.K., Simms, J.F., Humphries, M.M., Murray, D.L. & Boutin, S. (2021) The Purr-fect Catch: Using accelerometers and audio recorders to document kill rates and hunting behaviour of a small prey specialist. Methods in Ecology and Evolution, 12, 1277-1287.doi. 10.1111/2041-210X.13605

Tabery, J. (2023) Tyranny of the Gene: Personalized Medicine and the Threat to Public Health. Knopf Doubleday Publishing Group, New York. 336 pp. ISBN: 9780525658207.

The Meaningless of Random Sampling

Leave a reply

Statisticians tell us that random sampling is necessary for making general inferences from the particular to the general. If field ecologists accept this dictum, we can only conclude that it is very difficult to nearly impossible to reach generality. We can reach conclusions about specific local areas, and that is valuable, but much of our current ecological wisdom on populations and communities relies on the faulty model of non-random sampling. We rarely try to define the statistical ‘population’ which we are studying and attempting to make inferences about with our data. Some examples might be useful to illustrate this problem.

Marine ecologists ae mostly agreed that sea surface temperature rise is destroying coral reef ecosystems. This is certainly true, but it camouflages the fact that very few square kilometres of coral reefs like the Great Barrier Reef have been comprehensively studied with a proper sampling design (e.g. Green 1979, Lewis 2004). When we analyse the details of coral reef declines, we find that many species are affected by rising sea temperatures, but some are not, and it is possible that some species will adapt by natural selection to the higher temperatures. So we quite rightly raise the alarm about the future of coral reefs. But in doing so we neglect in many cases to specify the statistical ‘population’ to which our conclusions apply.

Most people would agree that such an approach to generalizing ecological findings is tantamount to saying the problem is “how many angels can dance on the head of a pin”, and in practice we can ignore the problem and generalize from the studied reefs to all reefs. And scientists would point out that physics and chemistry seek generality and ignore this problem because one can do chemistry in Zurich or in Toronto and use the same laws that do not change with time or place. But the ecosystems of today are not going to be the ecosystems of tomorrow, so generality in time cannot be guaranteed, as paleoecologists have long ago pointed out.

It is the spatial problem of field studies that collides most strongly with the statistical rule to random sample. Consider a hypothetical example of a large national park that has recently been burned by this year’s fires in the Northern Hemisphere. If we wish to measure the recovery process of the vegetation, we need to set out plots to resample. We have two choices: (1) lay out as many plots as possible, and sample these for several years to plot recovery. Or (2) lay out plots at random each year, never repeating the same exact areas to satisfy the specifications of statisticians to “random sample” the recovery in the park. We typically would do (1) for two reasons. Setting up new plots each year as per (2) would greatly increase the initial field work of defining the random plots and would probably mean that travel time between the plots would be greatly increased. Using approach (1) we would probably set out plots with relatively easy access from roads or trails to minimize costs of sampling. We ignore the advice of statisticians because of our real-world constraints of time and money. And we hope to answer the initial questions about recovery with this simpler design.

I could find few papers in the ecological literature that discuss this general problem of inference from the particular to the general (Ives 2018, Hauss 2018) and only one that deals with a real-world situation (Ducatez 2019). I would be glad to be sent more references on this problem by readers.

The bottom line is that if your supervisor or research coordinator criticizes your field work because your study areas are not randomly placed or your replicate sites were not chosen at random, tell him or her politely that virtually no ecological research in the field is done by truly random sampling. Does this make our research less useful for achieving ecological understanding – probably not. And we might note that medical science works in exactly the same way field ecologists work, do what you can with the money and time you have. The law that scientific knowledge requires random sampling is often a pseudo-problem in my opinion.  

Ducatez, S. (2019) Which sharks attract research? Analyses of the distribution of research effort in sharks reveal significant non-random knowledge biases. Reviews in Fish Biology and Fisheries, 29, 355-367. doi. 10.1007/s11160-019-09556-0

Green, R.H. (1979) Sampling Design and Statistical Methods for Environmental Biologists. Wiley, New York. 257 pp.

Hauss, K. (2018) Statistical Inference from Non-Random Samples. Problems in Application and Possible Solutions in Evaluation Research. Zeitschrift fur Evaluation, 17, 219-240. doi.

Ives, A.R. (2018) Informative Irreproducibility and the Use of Experiments in Ecology. BioScience, 68, 746-747. doi. 10.1093/biosci/biy090

Lewis, J. (2004) Has random sampling been neglected in coral reef faunal surveys? Coral Reefs, 23, 192-194. doi: 10.1007/s00338-004-0377-y.

The Time Frame of Ecological Science

Leave a reply

Ecological research differs from many branches of science in having a more convoluted time frame. Most of the sciences proceed along paths that are more often than not linear – results A → results B → results C and so on. Of course, these are never straight linear sequences and were described eloquently by Platt (1964) as strong inference:

“Strong inference consists of applying the following steps to every problem in science, formally and explicitly and regularly: 1) Devising alternative hypotheses; 2) Devising a crucial experiment (or several of them), with alternative possible outcomes, each of which will, as nearly as possible, exclude one or more of the hypotheses; 3) Carrying out the experiment so as to get a clean result; “Recycling the procedure, making sequential hypotheses to refine the possibilities that remain; and so on. It is like climbing a tree.” (page 347 in Platt).

If there is one paper that I would recommend all ecologists read it is this paper which is old but really is timeless and critical in our scientific research. It should be a required discussion topic for every graduate student in ecology.

Some ecological science progresses as Platt (1964) suggests and makes good progress, but much of ecology is lost in a failure to specify alternative hypotheses, in changing questions, in abandoning topics because they are too difficult, and in a shortage of time. It is the time component of ecological research that I wish to discuss in this blog.

The idea of long-term studies has always been present in ecology but was perhaps brought to our focus by the compilation by Gene Likens in 1989 in a book of 14 chapters that are as vital now as they were 34 years ago. Many discussions of long-term studies are now available to examine this issue. Buma et al. (2019) for example discuss plant primary succession at Glacier Bay, Alaska which has 100 years of data, and which illustrates in a very slow ecosystem a test of conventional rules of community development. Cusser et al. (2021) follow this by asking a critical question of how long field experiments need to be. They restrict long-term to be > 10 years of study and used data from the USA LTER sites. This question depends very much on the community or ecosystem of study. Studies in areas with a stable climate produced results more quickly than those in highly seasonal environments, and plant studies needed to be longer term than animal studies to reach stable conclusions. Ten years may not be enough.

Reinke et al. (2019) reviewed 3 long term field studies and suggest that long-term studies can be useful to allow us to predict how ecosystems will change with time. All these studies lead to three unanswered questions that are critical for progress in ecology. The first question is how we decide as a community exactly which ecological system we should be studying long-term. No one knows how to answer this question, and a useful graduate seminar could debate the utility of what are now considered model long-term studies, such as the three highlighted in Reinke et al. (2019) or the Park Grass Experiment (Addy et al. 2022). At the moment these decisions are opportunistic, and we should debate how best to proceed. Clearly, we cannot do everything for every population and community of interest, so how do we choose? We need model systems that can be applied to a wide variety of environments across the globe and that ask questions of global significance. Many groups of ecologists are trying to do this, but a host of decisions about who to fund and support in what institution are vital to avoid long-term studies driven more by convenience than by ecological importance.

A second question involves the implied disagreement whether many important questions in ecology today could be answered by short-term studies, so we reach a position where there is competition between short- and long-term funding. These decisions about where to do what for how long are largely uncontrolled. One would prefer to see an articulated set of hypotheses and predictions to proceed with decision making, whether for short-term studies suitable for graduate students or particularly for long-term studies that exceed the life of individual researchers.

A third question is the most difficult one of the objectives of long-term research. Given climate change as it is moving today, the hope that long-term studies will give us reliable predictions of changes in communities and ecosystems is at risk, the same problem of extrapolating a regression line beyond the range of the data. Depending on the answer to this climate dilemma, we could drop back to the suggestion that because we have only a poor ability to predict ecological change, we should concentrate more on widespread monitoring programs and less on highly localized studies of a few sites that are of unknown generality. Testing models with long-term data is enriching the ecological literature (e.g. Addy et al 2022). But the challenge is whether our current understanding is sufficient to make predictions for future populations or communities. Should ecology adopt the paradigm of global weather stations?

Addy, J.W.G., Ellis, R.H., MacLaren, C., Macdonald, A.J., Semenov, M.A. & Mead, A. (2022) A heteroskedastic model of Park Grass spring hay yields in response to weather suggests continuing yield decline with climate change in future decades. Journal of the Royal Society Interface, 19, 20220361. doi: 10.1098/rsif.2022.0361.

Buma, B., Bisbing, S.M., Wiles, G. & Bidlack, A.L. (2019) 100 yr of primary succession highlights stochasticity and competition driving community establishment and stability. Ecology, 100, e02885. doi: 10.1002/ecy.2885.

Cusser, S., Helms IV, J., Bahlai, C.A. & Haddad, N.M. (2021) How long do population level field experiments need to be? Utilising data from the 40-year-old LTER network. Ecology Letters, 24, 1103-1111. doi: 10.1111/ele.13710.

Hughes, B.B., Beas-Luna, R., Barner, A., et al. (2017) Long-term studies contribute disproportionately to ecology and policy. BioScience, 67, 271-281. doi: 10.1093/biosci/biw185.

Likens, G.E. (Editor, 1989) Long-term Studies in Ecology: Approaches and Alternatives. Springer Verlag, New York. 214 pp. ISBN: 0387967435.

Platt, J.R. (1964) Strong inference. Science, 146, 347-353. doi: 10.1126/science.146.3642.347.

Reinke, B.A., Miller, D.A.W. & Janzen, F.J. (2019) What have long-term field studies taught as about population dynamics? Annual Review of Ecology, Evolution, and Systematics, 50, 261-278. doi: 10.1146/annurev-ecolsys-110218-024717.

The Two Questions: So what? What next?

Leave a reply

Assuming that these two questions are not copyright, I wanted to explore them as a convenient part of writing a scientific or popular paper in ecology, conservation, and wildlife and fisheries management. To protect the innocent, I will not identify which of many ecological colleagues has stimulated this blog.

The first question should be addressed in every scientific paper but clearly is not if you read a random sample of the articles in many ecological journals. So what? is the critical question of exactly what current problem this paper or book will contribute to. It is the microscopic and macroscopic focus of why we do science, and it does not matter at all if it addresses a minor problem or a major catastrophe like species loss in conservation. In writing one should assume that time is the critical limiting factor in our lives, and while it is fine to be entertained by watching a movie, scientists do not read scientific papers to be entertained. Some journals demand that the abstract of every paper ends with a statement of the importance of the research findings, captured by So what? Too often these statements are weak and editors as well as granting agencies should demand more incisive statements. Asking yourself So what? can be a useful guide as you progress in your research and evaluate others.

While most scientists should agree on the findings presented in a paper or lecture, not all of them will agree about the importance of the answer to So what? What is a major and important scientific finding for some may be of minor significance to others, but the key is to remember here that science is a broad church that should be progressing on a broad front, so that differences of opinion are to be expected, and we rely on evidence to evaluate these differences of opinion. Tests of ideas that turn out to be incorrect or only partly correct must not be considered as failures. If you doubt that, interview any senior scientist in your area and ask about progress and regress during their scientific career. If you find a scientist who insists that they were correct in all their ideas, you should probably request them to go into politics to improve decision making in the real world.

The second question is probably the most critical for all scientific research. Once research is completed, there are two paths. If the original question or problem is solved or answered, the question becomes what does this work suggest needs to be done to advance the general area of research. Most typically however a research project will end up with more questions than it solves. The growing end of science is the critical one, and by asking What next? we delve deeper into the area of research to fill in details that were not evident when it was started. Read Sutherland et al. (2013, 2022) for an excellent example of this approach in conservation science. A simple example of this approach comes from many conservation problems. A particular species of bird may be thought to be declining in numbers, so the first issue is whether this is correct, and so an investigation into the changes in abundance of the species becomes the first step. This could lead to an analysis of the demography of the species population, birth, death and movement rates could be determined to isolate more precisely why abundance is changing. Given these data, the next step might be (for example) why the death rate is increasing if indeed this is the case. The next step is what management methods can be applied to reduce the death rate, and does this situation apply to other closely related species. It is important that asking What next? does not imply a linear sequence in time, and a study could be designed to address more than one question at the same time. We finish the What next? approach with a web of information and conclusions that address a broader question than the original simple question. And What next? should not be answered with a broad set of statements like “climate change is the cause” but by suggestions of very specific experiments and studies to carry investigations forward.

The result in ecology is an increasing precision of thought into ecological interactions and the processes that link species, communities, and ecosystems to very large questions such as the environmental response to climate change. Not all questions need to be large-scale because there are important local questions about the adequacy of designated parks and protected areas to protect species, communities, and ecosystems. The key message is that ecological understanding is not static but grows incrementally by well-designed research programs that by themselves seem to address only small-scale issues.

Seemingly failed research programs are not to be scorned but rather to indicate what avenues of research have not led to good insights. In a sense ecological science is like an evolutionary tree in which some branches fade away with time and others blossom into a variety of forms that surprise us all. So, my advice is to carry on asking these two simple questions in science to help sharpen your research program.

Sutherland, W.J., Freckleton, R.P., Godfray, H.C.J., Beissinger, S.R., Benton, T., Cameron, D.D., Carmel, Y., Coomes, D.A., Coulson, T., Emmerson, M.C., Hails, R.S., Hays, G.C., Hodgson, D.J., Hutchings, M.J., Johnson, D., Jones, J.P.G., Keeling, M.J., Kokko, H., Kunin, W.E. & Lambin, X. (2013) Identification of 100 fundamental ecological questions. Journal of Ecology, 101, 58-67.doi: 10.1111/1365-2745.12025.

Sutherland, W.J. & Jake M. Robinson, D.C.A., Tim Alamenciak, Matthew Armes, Nina Baranduin, Andrew J. Bladon, Martin F. Breed, Nicki Dyas, Chris S. Elphick, Richard A. Griffiths, Jonny Hughes, Beccy Middleton, Nick A. Littlewood, Roger Mitchell, William H. Morgan, Roy Mosley, Silviu O. Petrovan, Kit Prendergast, Euan G. Ritchie,Hugh Raven, Rebecca K. Smith, Sarah H. Watts, Ann Thornton (2022) Creating testable questions in practical conservation: a process and 100 questions. Conservation Evidence Journal, 19, 1-7.doi: 10.52201/CEJ19XIFF2753.