Earthsoft s EQuIS Database Lower Duwamish Waterway Source Data Management

Transcription

1 Earthsoft s EQuIS Database Lower Duwamish Waterway Source Data Management Jennifer Arthur Beth Schmoyer Brian Robinson February 11, 2106

2 Background Started in 2003 using Excel spreadsheets Separate file for each type of sample (onsite catch basin, right-of-way catch basin, inline grab, sediment trap) Gave up when reached 500 samples Migrated to EQuIS in 2010 Consultant customized database schema for SPU use Imported Excel spreadsheets to EQuIS Began uploading lab EDDs directly to EQuIS Took about 1 year to QA imported data and work through quirks to improve querying 2

3 What is EQuIS? Relational database for managing environmental data Data stored locally or hosted Works with Oracle or SQL Server Used internationally by government agencies, consultants, laboratories 3

4 SPU Data Management Overview Data Validation (Jennifer) (Brian) 4 Note: SPU has Earthsoft-hosted option

5 SPU EQuIS System Users SPU Programs LDW source tracing Street sweeping NPDES stormwater sampling Vactor decant facilities Combined sewer overflow post-construction monitoring Miscellaneous monitoring studies Seattle urban fish use 1 Urban creek bacteria investigations Data Type Storm drain solids Solids Water Water, sediment Water, sediment Water, sediment Fish counts, condition, behavior Water 1. Uses Earthsoft Alive module 5

6 SPU system EarthSoft Enterprise-hosted database SPU data stored on dedicated server 6 professional licenses + 8 active client access licenses Item Cost 2 Initial purchase $50,500 Customization $30,000 Total purchase $80,500 Annual fees Dedicated server and licenses Professional software maintenance 1 $11,000/yr $13,000/yr Total annual fees $24, Premier data and graphics professional license with GIS functionality = $2,000/yr 2. Costs vary depending on individual set up. See 6

7 Sampler field notes EDD from lab Sampling location info entered to EQuIS format Modified EDD from validator Data Entry Data imported to EQuIS via EDP module Data validator EDP: EQuIS data processor Checks EDD formatting and for valid values before accepting Allows custom EDD formats Notes Only validated LDW data entered to EQuIS Other SPU programs store QA data and use DQM module to perform basic validation 7

8 DQM Module User interface to perform data quality checks Input parameters, qualifiers, checks, and rules from project QAPP Holding times Duplicate results RPD Surrogate recoveries Blank contamination DQM lists the results that failed the checks/rules and assigns appropriate data qualifiers based on rules 8

9 Data Export: Query Tools Multiple standard REPORTs within EQuIS. A few of the commonly used ones listed below: Action level exceedance (by pick report, early warning, by EDD, percent variance) Analytical results (extra fields, hits, QC, statistics, by EDD, locations, crosstab, trend plot) Limited customization ability Create customized query (VIEW) 1 SQL Server Management Studio (free) Totally customizable queries, similar to Access 1. Professional only. Requires SQL (direct database login) 9

10 Data Export: Grouping Data Define groups with common features Locations can belong to more than one group at the same time Example groups Drainage basins (all samples within a particular drainage basin) Parameter groups (metals, PAHs, PCBs, phthalates) Watershed 10

11 Data Export: ArcGIS Interface EQuIs for ArcGIS (Profession Premier Data/Graphics license and above) Standard reports available directly via ArcMap (ArcGIS) for geographical analysis SPU automates process using Python scripts Define stored query (View) Python script accesses the View in EQuIS Python script updates ArcGIS feature class (manually or automatically run) User always sees most current data 11

12 Data Export to EIM EQuIS tool to export data from EQuIS to EIM format Location table Results table SPU commissioned tool development for nominal fee Streamlined data export process Tool now available to all EQuIS users 12

13 Source Data Integration Via ArcMap EQuIS Analytical data Inspection Dbase Business inspections Drainage facility inspections Spill response Water quality complaints 13 SPU ArcMap Parcel info Drainage system System layout As-built records Maintenance records CCTV records Drainage system tracking tool Land use

14 PCBs (ug/kg dw) < ,000 1,001 2,000 2,001 10,000 >10,000 14

15 Used data to document that PCBs in City storm drain coming from masonry repair site Required property owner to jet and clean private and public storm drains 15

16 High priority business Medium priority business Low priority business Not ranked 16