Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/rewards/reward-boosts.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ Any currently open cell bounties may be viewed in [WeatherXM Explorer](https://e
:::

Stations which are deployed at bounty cells within the announced participation period will be eligible to receive extra rewards. Each bounty defines a maximum number of stations
which may share the rewards. Should the number of eligible bounty stations exceed the bounty capacity, a ranking based on [QoD scores](/weather-and-science/quality-mechanisms/general-qod-description.mdx) and seniority is used
which may share the rewards. Should the number of eligible bounty stations exceed the bounty capacity, a ranking based on [QoD scores](/weather-and-science/quality-mechanisms/general-qod-description) and seniority is used
to distribute rewards fairly. **Stations must meet a minimum of 0.8 QoD score to receive rewards**.

## Examples of reward programs that may be implemented using **Rewards Boost**, in the near future are:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: general-qod-description
title: General QoD Description (OBC-SQC, ISD, SPV)
sidebar_label: General QoD Description (OBC-SQC, ISD, SPV)
slug: /weather-and-science/quality-mechanisms/general-qod-description.mdx
slug: /weather-and-science/quality-mechanisms/general-qod-description
---

# General QoD Description (OBC-SQC, ISD, SPV)
Expand Down Expand Up @@ -37,7 +37,7 @@ The checks performed are:
- **Check for suspicious spikes** over short time intervals, which may occur either due to poor station placement or because of a faulty sensor. For example, a temperature change >3°C within 1 minute is considered unrealistic. If the station’s sampling interval is greater than 1 minute, the respective threshold is increased linearly, provided that the sampling rate remains below 10 minutes.
- **Check for gaps in the data**. Each station model, according to its specifications, is capable of sending data packets at a specific time interval. If the number of packets received on an hourly basis is lower than the threshold set by the specifications, this indicates a problem in data transmission (e.g., poor 4G/Wi-Fi/Helium signal).

Similar checks (for stagnation and spikes), but with different time windows (based on WMO –[Guide to the Global Observing System (WMO-No. 488), pg.200](https://library.wmo.int/viewer/35699/?offset=#page=214&viewer=picture&o=search&n=0&q=suspicious)– guidelines as well as our [own data analysis](/weather-and-science/r&d/sqc-constancy-analysis-report.mdx)), are carried out for all parameters (see [full documentation](/weather-and-science/quality-mechanisms/obc-sqc-documentation.mdx)).
Similar checks (for stagnation and spikes), but with different time windows (based on WMO –[Guide to the Global Observing System (WMO-No. 488), pg.200](https://library.wmo.int/viewer/35699/?offset=#page=214&viewer=picture&o=search&n=0&q=suspicious)– guidelines as well as our [own data analysis](/weather-and-science/r&d/sqc-constancy-analysis-report.mdx)), are carried out for all parameters (see [full documentation](/weather-and-science/quality-mechanisms/obc-sqc-documentation)).

Finally, the ratio of invalid to expected valid data is calculated on an hourly basis in order to determine the final score of successful meteorological observations.

Expand All @@ -46,7 +46,7 @@ Finally, the ratio of invalid to expected valid data is calculated on an hourly

The ISD is a mechanism primarily aimed at identifying stations that are active but have not been placed outdoors. However, there is a range of other classifications that can be assigned to a station’s deployment status. The ISD mechanism runs once per day and evaluates the data from the entire previous day, but for the final evaluation result it also takes into account the outcomes from the last seven days in order to provide a fairer classification of the station’s deployment. The key difference compared to OBC-SQC is that ISD evaluates the entire day as a whole, assigning a single annotation related to the station’s deployment status.

For deployment assessment, the ISD uses solar radiation analysis techniques, comparing actual measurements with theoretical radiation values for each location on the planet and for each day of the year. In parallel, various combined thresholds are applied to temperature, wind direction/speed, and relative humidity (thresholds derived from exploratory data analysis) in order to identify certain significantly problematic deployment cases. It should be noted, however, that ISD is able to detect only a small subset of problematic deployments, as its main focus is on identifying stations that are located indoors. The classifications resulting from the ISD mechanism are shown in Table 1. See full [ISD documentation here](/weather-and-science/quality-mechanisms/isd-full-documentation.mdx).
For deployment assessment, the ISD uses solar radiation analysis techniques, comparing actual measurements with theoretical radiation values for each location on the planet and for each day of the year. In parallel, various combined thresholds are applied to temperature, wind direction/speed, and relative humidity (thresholds derived from exploratory data analysis) in order to identify certain significantly problematic deployment cases. It should be noted, however, that ISD is able to detect only a small subset of problematic deployments, as its main focus is on identifying stations that are located indoors. The classifications resulting from the ISD mechanism are shown in Table 1. See full [ISD documentation here](/weather-and-science/quality-mechanisms/isd-full-documentation).

Table 1. ISD annotations, their short description, and their impact on the quality score.
Note that the short description is statistically derived, and the actual status of the station may differ.
Expand Down Expand Up @@ -74,7 +74,7 @@ Note that the short description is statistically derived, and the actual status

## Station Photo Verification (SPV)

At WeatherXM, we aim to ensure that all station installations in our network follow, as closely as possible, the guidelines set by the <a href="https://www.eoas.ubc.ca/courses/atsc303/Instruments/wmo_guides/CIMO_Guide_2014-Met_Site_Classification.pdf" target="_blank">World Meteorological Organization (WMO)</a> (see also [our obstacle experiment](/weather-and-science/r&d/obstacle-impact-on-temp-and-wind.mdx)). The SPV mechanism evaluates the deployment of each station as depicted in the photos submitted by the user through the mobile app. Through SPV, seven key aspects of the photos are examined in order to assess both the overall deployment and the extent to which each parameter can be measured accurately. This mechanism assigns a score to the station each time the user submits a set of photos, which is then evaluated internally by company staff. The 7 aspects and how they affect the SPV score are described in Table 2. Each aspect is assessed separately based on the condition shown in the photo under evaluation, unless an issue is identified that affects the station’s measurements regardless of orientation. Each photo receives a score for each of the 5 aspects that can be scored, and then the average score per photo is calculated. Finally, the average score of the 4 photos (one for each cardinal direction) is computed, which determines the final SPV score. It should be noted that if there is no photo for a specific cardinal direction, the score for that direction is considered to be zero. The SPV scoring rules and guidelines are comprehensively described in [this document](/weather-and-science/quality-mechanisms/spv-full-documentation.mdx).
At WeatherXM, we aim to ensure that all station installations in our network follow, as closely as possible, the guidelines set by the <a href="https://www.eoas.ubc.ca/courses/atsc303/Instruments/wmo_guides/CIMO_Guide_2014-Met_Site_Classification.pdf" target="_blank">World Meteorological Organization (WMO)</a> (see also [our obstacle experiment](/weather-and-science/r&d/obstacle-impact-on-temp-and-wind.mdx)). The SPV mechanism evaluates the deployment of each station as depicted in the photos submitted by the user through the mobile app. Through SPV, seven key aspects of the photos are examined in order to assess both the overall deployment and the extent to which each parameter can be measured accurately. This mechanism assigns a score to the station each time the user submits a set of photos, which is then evaluated internally by company staff. The 7 aspects and how they affect the SPV score are described in Table 2. Each aspect is assessed separately based on the condition shown in the photo under evaluation, unless an issue is identified that affects the station’s measurements regardless of orientation. Each photo receives a score for each of the 5 aspects that can be scored, and then the average score per photo is calculated. Finally, the average score of the 4 photos (one for each cardinal direction) is computed, which determines the final SPV score. It should be noted that if there is no photo for a specific cardinal direction, the score for that direction is considered to be zero. The SPV scoring rules and guidelines are comprehensively described in [this document](/weather-and-science/quality-mechanisms/spv-full-documentation).


Table 2. The SPV aspects, their short description and the available score options.
Expand Down
12 changes: 6 additions & 6 deletions docs/weather-and-science/quality-mechanisms/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -10,9 +10,9 @@ In this section, all the available quality mechanisms are fully described.

## Contents

- [**General QoD Description (OBC-SQC, ISD, SPV)**](/weather-and-science/quality-mechanisms/general-qod-description.mdx): General and brief description of all the available quality mechanisms.
- [**Indoors Station Detector (ISD)**](/weather-and-science/quality-mechanisms/isd-full-documentation.mdx): Full documentation of the Indoors Station Detector (ISD), which is the mechanism that detects stations placed indoors, but also some other problematic situations.
- [**OBC and SQC Annotations**](/weather-and-science/quality-mechanisms/obc-sqc-annotations.mdx): Description of the annotations produced by the OBC-SQC quality mechanism.
- [**Out-of-Bounds (OBC) and Self Quality Checks (SQC)**](/weather-and-science/quality-mechanisms/obc-sqc-documentation.mdx): Full documentation of the Out-of-Bounds Check (OBC) and Self-Quality-Check (SQC) mechanism, which focuses on the detection of suspicious data in the transmitted raw data.
- [**OBC and SQC Score Calculation**](/weather-and-science/quality-mechanisms/obc-sqc-score-calculation.mdx): The method of the final daily OBC-SQC score calculation.
- [**Station Photo Verification (SPV)**](/weather-and-science/quality-mechanisms/spv-full-documentation.mdx): Full documentation of the Station Photo Verification (SPV) mechanism, which aims to evaluate the station deployments via photos.
- [**General QoD Description (OBC-SQC, ISD, SPV)**](/weather-and-science/quality-mechanisms/general-qod-description): General and brief description of all the available quality mechanisms.
- [**Indoors Station Detector (ISD)**](/weather-and-science/quality-mechanisms/isd-full-documentation): Full documentation of the Indoors Station Detector (ISD), which is the mechanism that detects stations placed indoors, but also some other problematic situations.
- [**OBC and SQC Annotations**](/weather-and-science/quality-mechanisms/obc-sqc-annotations): Description of the annotations produced by the OBC-SQC quality mechanism.
- [**Out-of-Bounds (OBC) and Self Quality Checks (SQC)**](/weather-and-science/quality-mechanisms/obc-sqc-documentation): Full documentation of the Out-of-Bounds Check (OBC) and Self-Quality-Check (SQC) mechanism, which focuses on the detection of suspicious data in the transmitted raw data.
- [**OBC and SQC Score Calculation**](/weather-and-science/quality-mechanisms/obc-sqc-score-calculation): The method of the final daily OBC-SQC score calculation.
- [**Station Photo Verification (SPV)**](/weather-and-science/quality-mechanisms/spv-full-documentation): Full documentation of the Station Photo Verification (SPV) mechanism, which aims to evaluate the station deployments via photos.
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: isd-full-documentation
title: Indoors Station Detector (ISD)
sidebar_label: Indoors Station Detector (ISD)
slug: /weather-and-science/quality-mechanisms/isd-full-documentation.mdx
slug: /weather-and-science/quality-mechanisms/isd-full-documentation
---

# Indoor Station Detector (ISD)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: obc-sqc-annotations
title: OBC and SQC Annotations
sidebar_label: OBC and SQC Annotations
slug: /weather-and-science/quality-mechanisms/obc-sqc-annotations.mdx
slug: /weather-and-science/quality-mechanisms/obc-sqc-annotations
---

# Out-of-Bounds (OBC) and Self Quality Checks (SQC) Annotations
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: obc-sqc-documentation
title: Out-of-Bounds (OBC) and Self Quality Checks (SQC)
sidebar_label: Out-of-Bounds (OBC) and Self Quality Checks (SQC)
slug: /weather-and-science/quality-mechanisms/obc-sqc-documentation.mdx
slug: /weather-and-science/quality-mechanisms/obc-sqc-documentation
---

# Obstacle Impact on Temperature and Wind
Expand All @@ -18,7 +18,7 @@ Data Quality v1 is able to process:
- Time series with an interval &lt;30 seconds (High Temporal Resolution Time series - **HTRT**)
- Time series with a time interval ≥1 minute (Low Temporal Resolution Time series - **LTRT**). We consider that the value provided on this time interval (e.g., 3 minutes) time interval is the outcome derived from the averaging of a sequence of internally recorded measurements.

The **final output of the Data Quality mechanism** is an hourly **percentage** of valid/available data and the corresponding **text annotations per meteorological variable** (temperature, relative humidity, wind speed, wind direction, atmospheric pressure, illuminance and precipitation). However, there is a [post Data Quality score process](/weather-and-science/quality-mechanisms/obc-sqc-score-calculation.mdx) that aggregates all the annotations and scores into a daily output per station.
The **final output of the Data Quality mechanism** is an hourly **percentage** of valid/available data and the corresponding **text annotations per meteorological variable** (temperature, relative humidity, wind speed, wind direction, atmospheric pressure, illuminance and precipitation). However, there is a [post Data Quality score process](/weather-and-science/quality-mechanisms/obc-sqc-score-calculation) that aggregates all the annotations and scores into a daily output per station.

Before moving forward to the description of the Data Quality mechanism, we should note that the input data has been standardised over time (resampling). Weather stations may transmit data at varying non-fixed time intervals. This implies that even if a station's specification indicates a recording frequency of 16 seconds, the actual interval can fluctuate, ranging from a few seconds to several minutes. To ensure that the quality control operates on a time-normalised dataset, a new timeframe is established with a fixed interval (determined by the theoretical recording frequency (fr) of the station model, such as 16’’ for the WG1000 - M5 model).

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: obc-sqc-score-calculation
title: OBC and SQC Score Calculation
sidebar_label: OBC and SQC Score Calculation
slug: /weather-and-science/quality-mechanisms/obc-sqc-score-calculation.mdx
slug: /weather-and-science/quality-mechanisms/obc-sqc-score-calculation
---

# Out-of-Bounds (OBC) and Self Quality Checks (SQC) Score Calculation
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: spv-full-documentation
title: Station Photo Verification (SPV)
sidebar_label: Station Photo Verification (SPV)
slug: /weather-and-science/quality-mechanisms/spv-full-documentation.mdx
slug: /weather-and-science/quality-mechanisms/spv-full-documentation
---

#Station Photo Verification (SPV) Full Documentation
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
id: constancy-analysis-report
title: SQC - Constancy Analysis Report
sidebar_label: SQC - Constancy Analysis Report
slug: /weather-and-science/quality-mechanisms/constancy-analysis-report.mdx
slug: /weather-and-science/quality-mechanisms/constancy-analysis-report
---

# Constancy Analysis Report
Expand All @@ -27,7 +27,7 @@ To ensure that we tailor these criteria to match the specifications of WeatherXM
</figure>


The datasets were averaged over 1 minute intervals, which corresponds to the "ignoring period" (during which we populate empty rows with data to facilitate Quality of Data processes - see [QoD documentation section 1](/weather-and-science/quality-mechanisms/obc-sqc-documentation.mdx#1-filling-ignoring-period---filling-no-data-slots)) chosen in the Quality of Data (QoD) mechanism. Then, we determined the duration of time during which consecutive observations remained at a certain value.
The datasets were averaged over 1 minute intervals, which corresponds to the "ignoring period" (during which we populate empty rows with data to facilitate Quality of Data processes - see [QoD documentation section 1](/weather-and-science/quality-mechanisms/obc-sqc-documentation#1-filling-ignoring-period---filling-no-data-slots)) chosen in the Quality of Data (QoD) mechanism. Then, we determined the duration of time during which consecutive observations remained at a certain value.

## 2. results

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ slug: /weather-and-science/weatherxm-vs-wmo-compliant
Dr. Stavros Keppas, 30/10/23 - WeatherXM AG

## 1. Introduction
In the pursuit of high-quality meteorological data, we aim to identify potential systematic errors and failures that the various WeatherXM station models may exhibit. For this reason, in the present study we compare impeccably installed WeatherXM weather stations, as assessed by the [SPV](https://docs.weatherxm.com/weather-and-science/quality-mechanisms/spv-full-documentation.mdx) mechanism (and the installation photos), with nearby meteorological stations that provide data via SYNOP.
In the pursuit of high-quality meteorological data, we aim to identify potential systematic errors and failures that the various WeatherXM station models may exhibit. For this reason, in the present study we compare impeccably installed WeatherXM weather stations, as assessed by the [SPV](https://docs.weatherxm.com/weather-and-science/quality-mechanisms/spv-full-documentation) mechanism (and the installation photos), with nearby meteorological stations that provide data via SYNOP.

## 2. Data and Methods
In general, there is an inconsistency between airport data and that from WeatherXM stations, mainly in terms of the temporal sampling interval, but also in the set of available parameters.
Expand Down
Loading
Loading