Skip to content

jalalawan/performanceeval

Repository files navigation

Evaluating performance of socio-technical systems for improved reliability: Evidence from sensor-human networks.

**EPA vs. LCS (Low Cost Sensor) Data Performance Evaluation ** The repository contains analysis for Santa Monica sensors (n=16) for Quarter 0 (Oct - Dec 2018). Steps presented here were repeated for Santa Monica from Jan 2019 - Dec 2019, and for Pittsburgh from July 2019 - July 2020. Detailed analysis and datasets may be shared on request.

Note: Conda environment suggested for EPA's sensortoolkit package. Please follow instructions in .yml file. Replace all filepaths with your local directory location(s).

image

Background:

  • Guidance on low-cost sensor siting, deployment, and performance evaluation is recent and evolving (latest information in Enhanced Air Sensors Guidebook, 2022) which is used as the basis for this work.

From review of LCS Literature:

  • Lack of long-term performance evaluations against reference monitors (typically > 1-year deployment)
  • “Multiple Deployments” refer to at least 3 sensors deployed in at least 2 cities and/or 2 EPA Regions
  • Collocation refers to sensors located within ~6 miles and at a ± 1m height with an FRM / FEM
    • Average distance in SM is ~15 miles from FRM/FEM monitors recording (and sharing) PM, R.H, and Temp at hourly resolution
    • Less distance (~5 miles) between FRM / LCS sensors in PGH.
  • Fundamental safeguards for the use of sensors (even for NSIM* applications) should include protocols that address data handling and initial processing, outlier detection and removal, data QA/QC for both FRM/LCS, and data completeness checks. 

image

**Data Preprocessing (Step 0): **image

**Data Preprocessing (Step 1): **image

**Data Preprocessing (Step 2-4): **image image

**Performance Assessment Using EPA's "sensortoolkit" package (minor changes made to accommodate specific requirements, including calibration eqs. and visual analysis of results) / Data Preprocessing partly done using RStudio Desktop 2021.09: **image

image

About

EPA vs. LCS Sensor Data Performance Evaluation

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages