NEWS

---

dataRetrieval 2.7.18

• Added a way to include a custom user-agent suffix via an enviornmental variable "CUSTOM_DR_UA"

dataRetrieval 2.7.17 (2024-10-31)

• Fixed bug with server problems causing errors.
• Removed the function "readNWISqw" since the underlying data was removed.
• Added message of service URL.
• Removed the forced "empty returns" for WQP, since the WQP now has properly formatted empty returns.
• Moved the column parsing to a dedicated function for WQP.
• Took out zip option for WQP calls, they are not allowed on WQP anymore.
• Added deprecated message getQuerySummary. Users should use readWQPsummary instead.
• Added WQX 3.0 profiles.
• siteInfo attribute for WQP queries converted to a full station return.
• Cleaned up date conversion in WQP
• Updated source for groundwater level data from waterservices to waterdata. Note that waterdata services will ALSO need updating within the next year, but this change will allow for some time to make changes.

dataRetrieval 2.7.16 (2024-07-30)

• Changed the base URL for groundwater level services since GW Levels RDB formats will be discontinued after August 5, 2024.
• Groundwater queries can no longer support siteStatus and siteType. Updates to the services are expected in the next year and those queries will return.
• Updated parameterCdFile.

dataRetrieval 2.7.15 (2024-02-21)

• Update warning about upcoming changes to USGS water quality data.
• Added date sorting to all WQP functions.

dataRetrieval 2.7.14 (2023-10-05)

• Package documentation updated due to roxygen changes
• Update in NLDI function to allow for sites with spaces in the site abbrievations.
• Added an automatic endDate to whatNWISdata if a startDate is given, to make sure it behaves as expected.

dataRetrieval 2.7.13 (2023-07-20)

• Added pcode_to_name function to get WQP characteristics from USGS parameter codes.
• Required readr version 1.4 or greater.

dataRetrieval 2.7.12 (2022-11-23)

• Updated documentation in readWQPdata
• Updates to how NLDI functions handle no data

dataRetrieval 2.7.11 (2022-02-18)

• Updated some documentation to improve examples.
• Changed the check for internet to better account for proxies.
• Fixed bug due to new behavior in NWIS parameter code service.
• Updated documentation for readWQPdata and readWQPsummary

dataRetrieval 2.7.10 (2021-09-14)

• Functions that come back from a server that had and error now return with a message and NULL rather than error.

dataRetrieval 2.7.9 (2021-07-30)

• Fix bug caused by changes in NLDI services
• Adding warnings to NWIS qw functions
• Added new vignette on changes

dataRetrieval 2.7.8 (2021-06-26)

• Fixed missing comments in readNWISqw
• Added Stable Isotopes, Habitat, and Other water quality groupings
• Adding options for updated readr

dataRetrieval 2.7.7 (2021-03-06)

• The NLDI service is now available through the 'findNLDI' function.
• Adjusted Water Quality Portal (WPQ) URLs to follow new structure
• Fixed bug where some WQP results were being duplicated
• Added an argument to readWQPdata to ignore fetching site and parameter attributes.
• Fixed timezone bug in RDB requests that had mixed timezones.
• Updated internal data for parameter codes
• Added parameterCd argument to readNWISgwl as the services had changed
• Allow a "service" argument in readWQPdata, whatWQPsites

dataRetrieval 2.7.5 (2019-06-05)

• Fixed some time zone joining bugs that were happening if the timezone column had no information in the first ~100 returned rows.
• Changed WQP default behavior to a zip return
• Remove reshape2 and dplyr dependencies
• Added ability to customize user agent using options UA.dataRetrieval

dataRetrieval 2.7.3 (2017-09-28)

• Reworked whatNWISdata to allow the full flexibility of '...'
• Check for dates in instantaneous data, allowing requests for recent data to be routed directly to waterservices.gov.

dataRetrieval 2.7.1 (2017-05-19)

• Converted vignette to html

dataRetrieval 2.7.0 (2017-05-15)

• Added National Groundwater Monitoring Network services
• Converted WaterML2 code from XML to XML2 dependency. NOTE: The output of this the parseWaterML2 function has changed. This is a first step to a more robust WaterML2 parser
• Added new Water Quality Portal features: whatWQPmetrics, whatWQPdata, whatWQPsamples
• Bug fix on converting GET -> POST
• Bug fix on state abbrieviations
• Minor updates to internal code to improve efficiencies.

dataRetrieval 2.6.3 (2016-12-08)

• All USGS web services are being flipped from http to https. This version of dataRetrieval will attempt to access https, if that fails, will attempt http.

dataRetrieval 2.5.12

• Response to readr 1.0.0 updates
• Added NWIS Water Use data
• Added NWIS Statistical Service data
• Added message on updates to NWIS data on startup message
• Automatically retries web service calls when status code is greater than 400
• More integrated use of pkg.env to set base URLs

dataRetrieval 2.5.7

• HEAD requests can be returned in readWQP* functions. This can give some indication on amount of data available.

dataRetrieval 2.5.0

• Package httr is now used for web service retrievals

dataRetrieval 2.4.0

• Package readr now used for tab delimited parsing
• readr functions used to determine column types. Mostly, this produces the same results.
• In the case where there is text in a numeric column (specified by the RDB header), these now remain characters (previously was converted to numeric)
• Columns that come back from web services as integers remain integers (previously was converted to numeric)
• Added reported time zone code information. dateTime columns by default get converted to UTC, but the original time zone code (tz_cd for instance) is appended to the data frame.

dataRetrieval 2.3.0 (2015-07-07)

• Converted all Water Quality Portal queries to sorted=no to greatly improve retrieval times
• Converted gwlevels in readNWISdata to rdb

dataRetrieval 2.2.0 (2015-04-10)

• Changed the output of tz_cd (in all *NWIS functions) to the timezone that is reported in the data frame. Before this version, it was the time zone reported by NWIS. This was confusing however since the dateTime columns default to UTC.
• Minor bug fixes
• Help file updates
• Improved query options in readNWISdata and readWQPdata functions.

dataRetrieval 2.1.4

• Expanded readNWISdata to qw data
• Improved citation file

dataRetrieval 2.1.1 (2015-01-30)

• Removed tests that call external web services, server upgrades have been causing false negative results
• Added functionality to readWQPdata to allow R objects as arguments rather than just character strings
• Added parameterCd='all' option for qw calls.
• Exposed sysdata constants

dataRetrieval 2.0.2

• Moved data files (parameterCdFile and pCodeToName) to hidden sysdata.rda
• Improved error handling.
• Fixed WaterML2 bug.
• Switched readNWISgwl to read the RDB output.

dataRetrieval 2.0.1 (2014-12-03)

• Removed deprecated functions.
• Added siteInfo and variableInfo dataframe attributes to all data retrival functions
• Improved help files
• Added data file (pCodeToName) that shows the association of USGS parameter code to characteristicName

dataRetrieval 2.0.0 (2014-11-14)

• Overhaul of function names based on initial user feedback
• Metadata attributes added to returned dataframes
• EGRET specific functions moved to EGRET

dataRetrieval 1.4.0 (2014-10-13)

• Changed naming convention:
• Changed WaterML2 rbind fill from plyr function to dplyr. Removed plyr import, added dplyr.

dataRetrieval 1.3.3

• Updated getNWISSiteInfo to retrieve multiple site file datasets at once using a vector of siteNumbers as input argument.
• Updated error-handling for Web service calls. More information is returned when errors happen
• Added some basic processing to Water Quality Portal raw data retrievals. Date columns are returned as Date objects, value columns are numeric, and a column is created from the date/time/timezone columns that is POSIXct.
• Added very generalized NWIS and WQP retrieval functions (getNWISData, getNWISSites, getGeneralWQPData, and whatWQPsites) which allow the user to use any argument available on the Web service platform.

dataRetrieval 1.3.2

• Deprecated getQWData, updated readWQPdata to take either parameter code or characteristic name.
• Changed the name of raw data retrievals to: readNWISqw, getNWISunitData, getNWISdvData, and getWQPqwData (from: readNWISqw, retrieveUnitNWISData, retrieveNWISData, getRawQWData)
• Added NA warning to getDVData function
• Updated mergeReport to allow for Sample data with different measurements taken on the same day

dataRetrieval 1.2.2

• Added getNWISDataAvailability function to find measured parameters and period of record information for a requested station.
• Added constructNWISURL function to get the URL that is used to retrieve the data.
• Added getSampleSTORET function to get STORET data directly in Sample dataframe form.
• Fixed a small leap year bug by changing day of year by making Feb. 29 always 59, and March 1st always 60 (even in non-leap years).

dataRetrieval 1.2.1

• Improved documentation, especially example functions.
• Improved vignette for a more complete walk-through.
• Expanded the capabilities to retrieve raw data from the web services.
• Added Storet data retrievals in readWQPdata function