An official website of the United States government.

This is not the current EPA website. To navigate to the current EPA website, please go to www.epa.gov. This website is historical material reflecting the EPA website as it existed on January 19, 2021. This website is no longer updated and links to external websites and some internal pages may not work. More information »

Environmental Modeling Community of Practice

Model Performance Evaluation and Scenario Analysis (MPESA)

Introduction

The Model Performance Evaluation and Scenario Analysis (MPESA) Tool was developed to provide users with the ability to assess the performance with which models predict time series data (e.g., streamflow). The tool was developed specifically for the Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM) models.


Top of page

Audience

The MPSA was developed primarily for hydrological and water quality modelers.


Top of page

Abstract

As the name implies, the tool consists of Model Performance Evaluation and Baseline and Scenario Analysis (MPESA) components. The Model Performance Evaluation and Diagnostics component calculates model performance evaluation measures such as descriptive statistics, error analysis, weighted ranks, serial and cross-correlation analysis, and Nash-Sutcliffe model efficiency. The model performance evaluation is based on the time series separation and reconstruction (TSSR) paradigm whereby a time series data is separated into magnitude or duration curve and sequence components. It demonstrates if model performance is impacted by magnitude or sequence related errors and provides limited diagnostic feedback to modelers on model calibration. The program has zooming and visualization capabilities. The Baseline and Scenario Comparison component of the tool provide the user with quantitative evaluation of baseline and scenario comparisons. This component uses metrics such as low flow analyses, metrics of flashiness, flow magnitudes, as well as flow threshold analyses. The scenario analysis tool is useful for land use and climate change baseline and scenario comparisons.


Top of page

Applications and Possible Uses

The most common use of the web-based MPESA Tool is evaluating model performance through comparisons of observed and predicted time series data. The tool receives observed and predicted or baseline and scenario data and calculates model performance metric, baseline and scenario indices, and visualization and zooming capabilities.


Top of page

Software History

Based on future test results and user requests, MPESA may undergo additional enhancements.


Top of page

Technical Support and Training

Questions regarding MPESA can be directed to CEAM Help Desk at the EPA’s Research Laboratory in Athens, GA.  A tutorial is now available for download at MPESA Download.


Top of page

Notice

This tutorial has been reviewed by the National Exposure Research Laboratory (NERL), U.S. Environmental Protection Agency (USEPA), Athens, Georgia and approved for publication. The author and the U.S. Environmental Protection Agency are not responsible and assume no liability whatsoever for any results or any use made of the results obtained from this program, nor for any damages or litigation that result from the use of this tool for any purpose.


Top of page