An official website of the United States government.

This is not the current EPA website. To navigate to the current EPA website, please go to www.epa.gov. This website is historical material reflecting the EPA website as it existed on January 19, 2021. This website is no longer updated and links to external websites and some internal pages may not work. More information »

CADDIS Volume 1

Explanation of Evidence

Concept

Explanation of Evidence: Confidence in the argument for a candidate cause is increased when a post hoc mechanistic, conceptual, or mathematical model reasonably explains any inconsistent evidence.

Figure 5-1. Illustration showing an example of inconsistent evidence with 2 scenarios where a contaminant today has no fish kills then one month later fish are fine and then another one where there are fish kills today and one month later. Figure 5-1. Explanation of Inconsistent Evidence. 

Click to view more information


Examples

Consider point source discharge of metals as a candidate cause of reduced abundance of fish and macroinvertebrates. What findings support or weaken the case for increased metal concentrations as the cause, in terms of explanation of the evidence?

  • Supporting evidence: Manipulation of exposure at the site (via removal of the point source discharge) did not result in increased fish or invertebrate abundance, weakening the case for increased metals as a candidate cause. However, immediate recovery may not have occurred due to insufficient recovery time (i.e., time lags), insufficient recruitment sources, or persistence of metals in sediments. If one of these explanations is applicable to the case, it may be strong enough to reverse the negative score for manipulation of exposure at the site.
  • Weakening evidence: The case for increased metals was supported only by spatial/temporal co-occurrence data, but it is discovered these data were collected using suspect methods.

Top of Page


How Do I Analyze Explanations?

Generally the explanations depend on the expertise and judgment of the scientists who are conducting the assessment.It is a relatively weak type of evidence, because assessors often can suggest explanations after the fact. However, thinking about possible explanations can lead to the collection of new information that could increase confidence in iterative assessments of the impairment.

Example analysis worksheets for explanation of evidence (for the Little Scioto River, Ohio, USA):

Top of Page


What Evidence Would Support or Weaken the Case for a Candidate Cause, in Terms of Explanations of Evidence?

Supports

  • A credible explanation of why a type of evidence weakening the case may be incorrect, when all other types of evidence support the case.
  • A credible explanation of why the case provides an unambiguous and convincing causal explanation, even when not all types of evidence for a case are consistent.

Weakens

  • A credible explanation of why a type of evidence supporting the case may be incorrect, when all other types of evidence weaken the case.
  • A credible explanation of why the score for a type of evidence should be reversed, thus changing a fully consistent body of evidence to one with inconsistencies.

Top of Page


How Do I Score the Explanations?

Finding Interpretation Score
There is a credible explanation for any negative inconsistencies or ambiguities in an otherwise positive body of evidence that could make the body of evidence consistently supportisng. This finding can save the case for a candidate cause that is weakened by inconsistent evidence; however, without evidence to support the explanation, the cause is barely strengthened. + +
There is no explanation for the inconsistencies or ambiguities in the evidence. This finding neither strengthens nor weakens the case for a candidate cause. 0
There is a credible explanation for any positive inconsistencies or ambiguities in an otherwise negative body of evidence that could make the body of evidence consistently weakening. This finding further weakens an inconsistent case. However, without evidence to support the explanation, the cause is barely weakened. -

Top of Page


Helpful Tips

  • Note that this type of evidence need not be scored: the important thing is to document the explanation.
  • You don't have to have the data in hand, just a credible explanation for why an inconsistent type of evidence may be misleading.
  • If you do collect new data relevant to explanation of inconsistencies, you may then have a stronger type of evidence—verified prediction—in the next iteration of the assessment.

Top of Page