Metering data processing
Updated
by Nicolas Vodoz
1. Raw Meter Readings
Meters are read automatically via the Climkit Gateway (or a third-party service via API or FTP).
The meter index (the cumulative value measured by the meter since commissioning) is read. This is referred to as raw data.
A reading consists of one or more meter indices and the reading date.
Electricity meters transmit two indices:
en_im(kWh): Imported energy, i.e., consumed or drawn energyen_ex(kWh): Exported energy, i.e., energy produced by a photovoltaic installation or fed back
Thermal energy meters (heat or cooling) transmit:
heat_energy_kwh(kWh): Thermal energy consumed
Water meters (hot or cold) transmit:
vol_m3(m3): Water volume consumed
2. Configuration of corrective rules
If meters are not installed according to the diagram and mounting instructions, rules can be configured to correct the readings.
Electricity meter wired in reverse
When an electricity meter is wired in reverse, its en_im and en_ex indices can be swapped.
Edit meter > Additional settings:
Key | Possible value | Description |
en_im | en_ex | Swap one register for the other |
en_ex | en_im | Swap one register for the other |
Configure an addition or subtraction
When one meter is connected downstream of another, it is necessary to subtract the downstream meter from the upstream meter to avoid double counting.
Rules are set up using the IDs (long hexadecimal number) of each meter and the + or - signs.
The result of the rule will be applied to the validated data (see below).
Key | Possible value | Description |
rule | meter_id_1 {+ or - } meter_id_2 {+ or - } ... | Swap one register for the other |
Additions and subtractions can be applied to the electricity, thermal, and water meter registers defined above.
An isolated meter cannot be used in a rule.
Photovoltaic (PV) meter on a consumption meter
When the PV is connected to a consumption meter (e.g., for common areas) of type Consumption meter, a second Common meter is created with the same primary address of type Production meter.
The gateway will read the same meter twice. This meter is named "Common Surplus".
Then, the rules below are applied using the hexadecimal IDs of the meters, represented here by C, P, and S.
Common Meter
ID: C
Rule: C + P - S
Common “Surplus” Meter
ID: S
Rule: S - S
PV Meter
ID: P
Rule: None
Note: This must be done from the beginning of the meter readings. If done later, the readings from the Common meter must be manually copied to the new Common Surplus meter.
3. Abnormal data filters
The received data may contain anomalies (wrong registers, reset to 0, external data sources, etc.). It is possible to replace this consumption data with 0 via the "trigger" parameter:
Key | Description |
trigger | Replaces consumption data (15 min) greater than "trigger" with 0 |
Example for a 32A max electricity meter - over 15 minutes at maximum, the meter can increment by:
1/4 * (3 * 230 * 32)/1000 kWh = 5.52 kWh
-> a "trigger" of 15 is therefore a good value for filtering abnormal data.
4. Data validation
The system automatically processes the collected raw data several times a day, validates it, and saves it (validated data).
This allows defining 15-minute consumption for each meter, splitting the self-consumed solar energy from the grid drawn energy, and aggregating the values from all meters to indicate the site's overall consumption and production.
For the data to be validated correctly, the collected raw data must be accurate and complete. If necessary, correct it using the rules explained above.
The system validates the site's global data up to the date when readings are available for all site meters (excluding isolated meters).
The validated data is used to generate consumption statements and billing.
Meter installation date
The meter installation date allows estimating the 15-minute consumption of the meter before the first reading on the portal.
The system validates data starting from the defined installation date for each meter.
For example, if an index is read for the first time at 3000 kWh on October 15, 2022, and an installation date is set to June 15, 2022, the system distributes the 3000 kWh over the previous 3 months in 15-minute intervals.
Isolated meter
When a read meter should not be included in the overall validation, the Isolated meter mode is activated to exclude it from the site's global consumption.
The consumption of this meter can then simply be viewed, but it is neither integrated into the global consumption nor into the site's solar/grid energy split. However, it can be used for statements and billing.
An isolated meter cannot be used in an addition/subtraction rule (see above), nor as a consumption meter for charging station zones.
This mode applies to electricity, thermal, and water meters.
Impact on visualization
Isolated meters are not visible in the site's overall charts (15 minutes, monthly, and annual)
Virtual meter
It is possible to create a single virtual electricity meter per site. This meter deducts and accounts for all energy not measured by the other meters.
A virtual meter is created when it is not physically possible to install a meter on a consumer.
This is the case, for example, with the Single wiring diagram.
Manually read meter
When using manually read meters, a reading must be entered regularly to avoid blocking the site's global validation.
Reconstruction of validated data (resampling)
When the defined parameters are changed and raw data has already been collected, it is necessary to reconstruct the validated data (resampling) from the beginning or a defined date.
Go to Configuration > Admin > Resampling (admin user only)
Site data processing
Meter to infer by calculation:- Auto: The virtual meter if one exists, otherwise the photovoltaic production.
- Meter selected in the dropdown list: The system ignores the raw data of this meter and reconstructs it from others. This mode is impossible if there is a virtual meter. Note that a "disabled" meter should not be selected.
Data cleaning: Removes negative or inconsistent data in the validated data.
Site data reconstruction (Resample all site)
Select a period (start and end). If no start date is specified, the site creation date is used.
When reconstruction starts, all existing validated data in the selected period is deleted then reconstructed.
Possible errors:
- There is no data between the start and end date for at least one meter (excluding isolated meters). At least two readings are required within the selected period.
- At least one of the registers mentioned above is missing for at least one of the meters.
