This is a sample text. You can click on it to edit it inline or open the element options to access additional options for this element.

FILTER: A Tool for Making Citizen Air Quality Data More Reliable and Usable

Over the past decade, low-cost sensor (LCS) networks for air quality monitoring have surged across Europe. LCSs have changed air quality monitoring by allowing citizen-led, hyperlocal data collection. Driven largely by citizen science initiatives, platforms like sensor.community and PurpleAir now provide vast datasets at fine spatial and temporal resolutions. However, despite their growing popularity, LCS data often suffer from inconsistency, poor quality, and lack of standardization. This makes it difficult to integrate them into official environmental assessments or use them confidently in policymaking and scientific research.

In response, we introduce FILTER — the Framework for Improving Low-cost Technology Effectiveness and Reliability — a multi-step data pipeline designed to evaluate, flag, and correct crowdsourced outdoor PM25 (particulate matter with a diameter ≤2.5 μm) data from various LCS networks. Developed in the context of CitiObs (a Horizon Europe project that aims to enhance citizen-generated environmental observations), FILTER is grounded in a simple philosophy: make the best use of the data we have, without compromising on scientific integrity.

FILTER provides both quality flagging and value correction. It systematically screens LCS data through five stages: range check, constant value detection, outlier detection, spatial correlation testing, and spatial similarity assessment. It also corrects measurements where appropriate, using only spatial patterns — no direct co-location or information about the LCS type is required. The final output is a harmonized, corrected dataset with clear quality labels and associated uncertainty bounds, allowing users to prioritize accuracy based on their application.

FILTER directly supports the CitiObs mission to enhance Citizen Observatories and integrate them into multi-level governance. Through improving the trustworthiness of LCS data, FILTER makes it easier for citizens, researchers, and policymakers to rely on community-driven air quality data for real decisions, supporting the new European Ambient Air Quality Directive (2024)[1]. It bridges the gap between grassroots monitoring efforts and institutional data requirements, a key CitiObs goal.

For validation, we applied FILTER to more than 400 LCSs located near official monitoring stations from diverse environments across Europe. The result is a corrected, quality-labeled dataset that improves LCS readings, achieving reductions of over 50% in median Root Median Square Error (RMSE).

We applied FILTER to over 500 million hourly measurements from two of Europe’s largest community-based networks, i.e.,  sensor.community and PurpleAir,  covering 2018 to 2023. The output dataset and the complete MATLAB code for applying FILTER are openly accessible via Figshare (https://doi.org/10.6084/m9.figshare.27195720.v1). Whether you are working on urban air quality forecasting, health exposure mapping, or environmental justice, this is a resource built to empower the community.

Geographic distribution of PM2.5 monitoring sites across Europe (Hassani et al., 2025[2]). a, Locations of low-cost sensors from sensor.community and PurpleAir deployed between 2018 and 2023, prior to the application of the FILTER framework (Framework for Improving Low-Cost Technology Effectiveness and Reliability). b, Locations of reference-grade PM2.5 monitoring stations operating between 2005 and 2023 across the EU-27, UK, Norway, and Switzerland. Side and bottom panels show the number of monitoring sites by latitude and longitude. Due to substantial overplotting, the maps may not fully reflect the actual density of monitoring locations.

Further development includes integrating FILTER into CitiObs tools and the CitiObs Knowledge Platform to enhance accessibility and usability. FILTER is not suitable for mobile LCS devices, and the plan is to tune it for mobile LCS applications. FILTER is currently being implemented and tested in MATLAB, and an R package is also being developed to make the framework more accessible to a wider range of users. Additionally, co-developing local use cases in collaboration with Frontrunner and Alliance Citizen Observatories will help tailor the framework to community-specific needs and promote its practical application across diverse environments.

·       Read the full paper here: https://www.sciencedirect.com/science/article/pii/S030147972501076X
Visit the FILTER repository: The quality-controlled and corrected sensor.community and PurpleAir data described are available at https://doi.org/10.6084/m9.figshare.27195720.v1. For further details, please refer to the “Read Me (Data Descriptor)” section at the end of the Supplementary Information Appendix. The codes (in MATLAB) used for applying the proposed framework, Quality Control, and correction of LCS data are available at https://doi.org/10.6084/m9.figshare.27195720.v1

·       Explore more on citizen air quality tools at CitiObs.eu

 


[1] Directive of the European Parliament and of the Council on ambient air quality and cleaner air for Europe (recast). (198305/EU XXVII.GP). COUNCIL: PE-CONS 88/24 PUBLIC https://data.consilium.europa.eu/doc/document/PE-88-2024-INIT/en/pdf (2024)

[2] https://www.sciencedirect.com/science/article/pii/S030147972501076X

Date

May 7th 2025

Author

Amirhossein Hassani

Organization

NILU

TOP
Shares