An official website of the United States government.

This is not the current EPA website. To navigate to the current EPA website, please go to www.epa.gov. This website is historical material reflecting the EPA website as it existed on January 19, 2021. This website is no longer updated and links to external websites and some internal pages may not work. More information »

Frequent Questions Water Quality Exchange (WQX)

General WQX Questions

Downloading WQX Data

Submitting data to WQX Web

Submitting data to WQX using a Node or Node Client


General STORET/ WQX Questions

What is STORET and how does it relate to WQX?

STORET refers overall to "STORage and RETrieval", an electronic data system for water quality monitoring data developed by EPA. STORET has taken various forms since the 1960's (see next FAQ). Since about 2000, STORET has referred to a local data management system ("Modernized STORET") as well as data repository ("STORET Data Warehouse") developed for purposes of assisting data owners manage data locally and share data nationally. Up until September 2009, the distributed STORET database has been used to compile data at the national level in the STORET Data Warehouse. As of September 2009, the Water Quality Exchange, or WQX framework, provides the main mechanism for submitting data to the STORET Data Warehouse.  Up until September 2009, both the distributed STORET database and STORET Warehouse has been used to submit and compile data at a national level.  As of September 2009, the Water Quality Exchange, or WQX framework, provides the main mechanism for submitting data to EPA.  The STORET Data Warehouse has now been replaced with the Water Quality Portal (WQP), which compiles data at a national level with multiple partners.

Top of Page

Can you explain the terms "Legacy STORET", "Legacy Data Center", "Modernized STORET", "Distributed STORET Database", "Water Quality Exchange" and "STORET Data Warehouse"?

"Legacy STORET" is the term we use when we mean the original (mainframe) STORET Water Quality File. From 1965 until 1998, this system was known simply as "STORET", and was the only STORET database. Storing data in it and retrieving data from it could only be accomplished by someone with a mainframe User ID and with specialized training. Since the middle of 1999, it has not been possible to use this system for data entry and in the year 2000 it became unusable for retrieval as well.

In order to preserve the data content of Legacy STORET, EPA created the "Legacy Data Center". It uses modern relational database technology and is housed on a UNIX/Oracle database server. The general public may browse or download its data, using a standard web browser such as Microsoft IE. All the data content from the Legacy STORET database was copied to this new database server during 1999 and the mainframe Legacy STORET was shut down. Data is no longer being placed in the Legacy Data Center, but the public can still access data from the STORET ftp site.  ALL Legacy Data has been archived and can be downloaded by STATE.  ALL STORET Legacy Data for each state is accesible via compressed self-extracting flat files delimited by <tabs>.

"Modernized STORET" refers to the system created to replace Legacy STORET for the storage and retrieval of water quality and biological data. Unlike its predecessor, Modernized STORET is a distributed database system, installed on personal computers all over the country for use by data owners. Often times, we refer to Modernized STORET as the "distributed STORET database". Up until September 2009, local STORET owners could upload mirror images of their STORET data for inclusion in the STORET Data Warehouse. This upload of the distributed STORET databases to the STORET Data Warehouse is no longer supported by EPA, rather users must submit data via the Water Quality Exchange, or WQX.

The "Water Quality Exchange", or WQX, is the primary framework for submitting data to the Water Quality Portal.  WQX uses the technology, standards and protocols of the National Environmental Information Exchange Network, or Exchange Network, to provide a means for data partners to share water quality monitoring data to the Water Quality Portal.  WQX is not a distributed database, but rather a standard set of data elements that all data partners map to in order to share data.

The "Water Quality Portal"  has replaced STORET Data Warehouse as EPA's main repository of water quality monitoring data, including data that has been submitted via Modernized STORET as well as data that is now submitted via WQX. The Water Quality Portal houses millions of water quality records. This data continues to be provided by other federal agencies, region, states and tribal partners as well as voluntary organizations.

Top of Page

What is WQX? Is WQX a database?

The Water Quality Exchange (WQX) is a framework that allows states, tribes and other data partners to submit and share water quality monitoring data via the web to the Water Quality Portal. WQX uses the technology, standards and protocols of the National Environmental Information Exchange Network, or Exchange Network, to provide a means for data partners to share water quality monitoring data to the Water Quality Portal. WQX is not a distributed database, but rather a standard set of data elements that all data partners map to in order to share data. States, tribes and others who store water quality data in a personal database and have the ability to generate XML files, can now submit data directly to the publicly accessible Water Quality Portal using the WQX framework.

Top of Page

What is WQX Web and how is it different from WQX?

WQX Web is a web-based application designed to assist smaller organizations with submitting data via WQX.  With WQX, users submit WQX XML that they have already created via Exchange Network nodes or node clients.  With WQX Web, users log into a web site where they have access to WQX Web for data submission. WQX Web converts spreadsheets and text files (such as comma or tab-delimited files) into a valid WQX XML submission file (based on the WQX schema). While WQX defines the framework for which data is submitted to the Water Quality Portal, WQX Web is a web-based tool with a user interface that provides for data submission using the WQX schema.

Top of Page

What is the Exchange Network and how does it relate to WQX?

The National Environmental Information Exchange Network, or Exchange Network, is an EPA and state partnership that provides a secure framework for sharing environmental information over the internet. Many different types of environmental data are shared over the Exchange Network, including air quality data, hazardous waste handling information, or even standardized chemical names used across EPA. WQX is the water quality monitoring data flow on the Exchange Network.

Top of Page

What's the relationship between EPA monitoring data in WQX and USGS monitoring data in NWIS?

In the past, the USGS and STORET/WQX have agreed to utilize common definitions and formats, to promote a common view of data between their two systems. The full text of this agreement, made in 2000, is available online. NWIS and STORET/WQX have met this agreement by creating common web services. These web services provide data out in a WQX schema format. The Water Quality Portal is a collaborative publishing tool to front-end these common web services and schema format.

Top of Page

Is there a document that describes the parameter codes in Legacy STORET?

Legacy STORET parameter codes can be found by clicking on the following URL ftp://newftp.epa.gov/storet/ and selecting the zip file labeled ALL_STORET_parameters_codes.zip. The zip files contain two text files, one text file containing the list of parameter codes and the other text file containing associated information on the parameter codes, including the definitions of the data columns.  The Water Quality Portal has a separate and independent parameter code list maintained by United States Geological Survey (USGS).  To retrieve definitions of USGS National Water Information System (NWIS) parameter codes and parameter groupings, reference their website.

Top of Page


Downloading STORET/WQX Data

How can I obtain water quality data maintained in the WATER QUALITY PORTAL or in the Legacy Data Center?

Anyone with a web browser and internet access can browse and download monitoring data from the Water Quality Portal or Legacy Data Center. On the left hand side bar of this webpage, simply go to the link called Data download. Access to the Water Quality Portal allows you to click the link to download data or choose to look at any of the tutorials first.  You can no longer obtain data directly from the Legacy Data Center (LDC); however, all data previously available at the LDC is now available through the Water Quality Portal.  The LDC (Legacy Data Center) contains historical water quality data dating back to the early part of the 20th century and collected up to the end of 1998.  The public can also access data from the ftp site.

How do I reference or cite data from the Water Quality Portal? 

Anyone with a web browser and internet access can browse and download monitoring data from the Water Quality Portal.  The recommended basic format to reference published data from the Water Quality Portal is as follows:

The basics of a reference is:

  • National Water Quality Monitoring Council, YYYY, Water Quality Portal, accessed month DD, YYYY, at https://www.waterqualitydata.us

Reference Example:

National Water Quality Monitoring Council, 2020, Water Quality Portal, accessed June 09, 2020, at https://www.waterqualitydata.us (2013). Sampling Parameter, Date Range-from 2006 to 2009.

Top of Page

 


Submitting data to WQX Web

Are there example data submission text files available?

Yes. Example WQX Web data text files and XML files are provided below.

Note: WQX XML files should follow the business rules for the current WQX 3.0 Schema.  All previous examples are also available for reference with the link above.

There are also examples of how to build configurations using your own text/excel/CSV files utilizing the WQX Web User Guide.  Found under the Help Tab once you log into WQX Web.

Top of Page

I made a mistake in submitting my files is there any way to correct the error?

Yes. Previously submitted WQX Web data can be changed by performing an update operation or a delete operation. WQX Web update operations will delete existing data associated with an Activity, Monitoring location, or a Project and replace it with the resubmitted data. Data will only be updated to the level specified, i.e. if a Monitoring Location name is updated only, associated activities and results data will not be changed.
Alternatively, performing a delete operation will remove all levels of data associated with a specific component, deleting a Monitoring Location will also delete all activities and results from the system that are associated with the Monitoring Location.

Top of Page

My WQX Web submissions have had the status pending for a long time, should I be worried?

When submitting through WQX Web, if your submitted file is ending for over 30 minutes, cancel the submission, delete the dataset, then resubmit your file a few moments later. If you are not able to delete your submitted file, proceed to reimport the file, when prompted by WQX Web if you would like to delete the previous dataset, select OK.

I received an error stating "connection was forcibly closed by host" or "Out of Memory", what do I do?

In WQX Web, if you receive the error message "EJB Exception:; nested exception is :java.rmi.RemoteException: ; nested exception is: java.lang.OutOfMemoryError: unable to create new native thread" or the error message "connection forcibly closed by the remote host" please wait a few moments, then resubmit your dataset. This error often is caused by high amounts of traffic.

Top of Page


Submitting data to WQX using a Node or Node Client

Are there example data submission XML files available?

Yes. Example WQX XML files are provided below.

Note: WQX XML files should follow the business rules for the current WQX 3.0 Schema.  All previous examples are also available for reference with the link above.

  • WQX Web supports direct XML file submission to CDX: “Import and Submit” menu
  • NGN endpoints are the following:
  • Production Node:
    • Node 1.1 - https://cdxnodengn.epa.gov/cdx-enws10/services/NetworkNodePortType_V10
    • Node 2.0 - https://cdxnodengn.epa.gov/ngn-enws20/services/NetworkNode2Service
    • Node 2.1 - https://cdxnodengn.epa.gov/ngn-enws20/services/NetworkNode2ServiceConditionalMTOM
  • Test Node:
    • Node 1.1 Test - https://testngn.epacdxnode.net/cdx-enws10/services/NetworkNodePortType_V10
    • Node 2.0 Test - https://testngn.epacdxnode.net/ngn-enws20/services/NetworkNode2Service
    • Node 2.1 Test –https://testngn.epacdxnode.net/ngn-enws20/services/NetworkNode2ServiceConditionalMTOM

Top of Page

I made a mistake in submitting my files is there any way to correct the error?

Yes. Previously submitted WQX data can be changed by performing an update operation or a delete operation. WQX update operations will delete existing data associated with an Activity, Monitoring location, or a Project and replace it with resubmitted data. Data will only be updated to the level specified, i.e. if a Monitoring Location name is updated only, associated activities and results data will not be changed.
Alternatively, performing a delete operation will remove all levels of data associated with a specific component, deleting a Monitoring Location will also delete all activities and results from the system that are associated with the Monitoring Location. 

Note: WQX XML files should follow the business rules for the current WQX 3.0 Schema.  All previous examples are also available for reference with the link above.

Top of Page

My WQX Web submissions have had the status pending for a long time, should I be worried?

We know this is an issue for WQX, please contact the WQX Helpdesk at WQX@epa.gov for further assistance.  Or contact STORET/WQX Support for assistance via toll free phone number 1-800-424-9067.

Top of Page

I received an unauthorized access error, what do I do?

Contact the WQX HELPDESK at WQX@epa.gov if you receive an error stating "User "youremailadress@franklin.gov" has not been granted access to the "yourorganization" organization. Please Contact STORET/WQX Support for assistance.

Top of Page

What is the difference between the WQX Test and Production environments?

The WQX Test environment is primarily for new WQX users. Every new user must make one successful submission to a Test environment endpoint prior to being permitted to submit through the Production environment. For more information on submitting through the WQX Test and Production environments please click on the following link. 

Note: WQX XML files should follow the business rules for the current WQX 3.0 Schema.  All previous examples are also available for reference with the link above.

Top of Page