An official website of the United States government.

This is not the current EPA website. To navigate to the current EPA website, please go to www.epa.gov. This website is historical material reflecting the EPA website as it existed on January 19, 2021. This website is no longer updated and links to external websites and some internal pages may not work. More information »

Benchmark Dose Tools

Nested Dichotomous Data (Use with Benchmark Dose Software (BMDS) Version 2.7)

BMDS 2.7 is no longer under active development. With a few exceptions, most models are now maintained in BMDS 3.x.

In a nested study, a group of animals are treated with a particular dose of chemical, and the end point examination is conducted in a subset of subjects from each treated individual – the pups of the treated mother, for example. Because each mother may produce 15-20 pups, if you have 20 treated mothers, you would have 20 observations from each mother. So the observation sample size is larger than that of the original treated animals.

Developmental effects could range from skeletal structure change, delayed ossification in the bone, or organ structural change to malformation. Since all those observations are made in pups, but not in the mothers, these data should be considered nested data.

The following screenshot shows how a nested dataset should be formatted for use in BMDS.

How nested data should be formatted in BMDS

You can find more detailed information on nested dichotomous data in the online training.


Before You Start

Download nested_exercise.zip (ZIP)(1 pg, 926 B) and extract the Rogers.dax dataset to the BMDS\Data subdirectory. You will use this dataset for Exercise 2.

Exercise 1

This exercise will introduce the concept of nested data and show you how to use the nested models in BMDS. The exercise uses the Nested.dax dataset included with the standard BMDS installation.

  1. From within BMDS, select File>Open>Dataset (.dax). Select and open the Nested.dax file. BMDS opens the file in a new data grid window.
  2. In the Data Grid window, from the Model Type picklist, select Nested_Dichotomous. From the Model Name picklist, you can select one of three models:
  3. Select the NLogistic model.
  4. Click the Proceed button to display the Model Options screen for the selected model. Specify the column assignments and accept the defaults.
  5. Click the Run button. BMDS displays the graph and text results. You can minimize the Results window for now.
  6. Go back to the Data Grid and run each of the remaining models (NCTR and Rai and Van Ryzin), again accepting the defaults.
  7. Redisplay the three Results windows. Look at the differences in the graphs, the parameter estimates, etc.

You should see results similar to those in the table below. How do the AICs differ? The BMD and BMDL values? 

  NLogistic NCTR Rai and
Van Ryzin
AICHelpAICA statistical procedure that provides a measure of the goodness-of-fit of a dose-response model to a set of data. AIC = -2 x (LL - p), where LL is the log-likelihood at the maximum likelihood fit, and p is the degrees of freedom of the model (usually, the number of parameters estimated). 545.957 549.469 546.976
BMDHelpBMDAn exposure due to a dose of a substance associated with a specified low incidence of risk, generally in the range of 1% to 10%, of a health effect; or the dose associated with a specified measure or change of a biological effect. 12.9517 16.1699 12.8063
BMDLHelpBMDLA lower one-sided confidence limit on the BMD. 9.64348 8.08493 11.4357
Goodness-of-FitHelpGoodness-of-FitA statistic that measures the dispersion of data about a dose-response curve in 44 order to provide a test for rejection of a model due to lack of an adequate fit, e.g., a P-value < 0.1.
p-valueHelpp-valueIn testing a hypothesis, the probability of a type I error (false positive). The probability that the sample (experimental) results are compatible with a specific hypothesis.
0.9845 0.9707 0.9846

Top of Page

Question

Which model type (NLogistic, NCTR, Rai and Van Ryzin) would you choose and why?

You would generally choose the NLogistic because it has the lowest AIC and a low BMDL.

Top of Page

Exercise 2

In a 1993 paper, Rogers, et al., describe a Log-Logistic BMD analysis of the developmental effects of methanol on CD-1 mice.

  1. Start BMDS and select File>Open>Dataset (.dax). Open the Rogers.dax file you previously downloaded. The dataset opens in a Data Grid window.
  2. For Model Type, select Nested_Dichotomous. For Model Name, select NLogistic.
  3. For this exercise, we want to delete the four high-dose items. To do this, scroll to the end of the dataset, highlight the cells for the last four rows, and press the Delete key. The cell values should be cleared.
  4. Click the Proceed button to display the Model Options screen for the selected model.
  5. Specify the column assignments for Dose, Litter Size, Incidence, and Litter Specific Covariate.
  6. For this run, we will accept the defaults in the Other Assignments section.
  7. Click the Run button. In a few seconds, BMDS displays graphical and text results. You should see a window similar to the following screenshot:BMDS results for the nested dichotomous Exercise 1

Question

What is the AIC value associated with this model run?

1049.33

  1. Close the Model Options and Results windows so that the Rogers.dax dataset is the only window open. Click the Proceed button. A new Model Options window displays.
  2. Specify the column assignments for Dose, Litter Size, Incidence, and Litter Specific Covariate.
  3. For this run, we want to specify 5% additional riskHelpadditional riskThe additional proportion of total animals that respond in the presence of the dose, or the probability of response at dose d, P(d), minus the probability of response in the absence of exposure, P(0). and we do not want to use the Litter Specific Covariate. In the Other Assignments section:
    • Select a Risk Type of "Added" and specify a BMR of 0.05.
    • Change Litter Specific Covariate to "Do Not Use."

Your Model Options dialog should resemble the following screenshot:Nested Model Options dialog values for Exercise 2

  1. Click the Run button. In a few seconds, BMDS displays graphical and text results. You should see a window similar to the following screenshot:BMDS results for the nested exercise 2, with 5% added risk

Question

What is the AIC value associated with the second model run?

1053.46

Top of Page

Previous: ten Berge Concentration x Time Model (Use with BMDS)