Metering data processing
Updated
by Nicolas Vodoz
1. Raw Meter Readings
Meters are read automatically via the Climkit Gateway (or a third-party API or FTP service).
The meter index (the cumulative measurement recorded by the meter since its connection) is read. This is referred to as raw data.
A reading consists of one or more meter indexes and the reading date.
Electricity meters transmit two indexes:
en_im(kWh): imported energy, i.e., consumed or drawn energyen_ex(kWh): exported energy, i.e., energy produced by a photovoltaic installation or fed back into the grid
Thermal energy meters (heat or cooling) transmit:
heat_energy_kwh(kWh): consumed thermal energy
Hot or cold water meters transmit:
vol_m3(m3): consumed water volume
2. Configuration of Correction Rules
When meters are not installed according to the schema and mounting instructions, rules can be configured to correct the readings.
Reversed Electricity Meter Wiring
When an electricity meter is wired in reverse, its en_im and en_ex indexes can be swapped.
Edit meter > Additional settings:
Key | Possible value | Description |
en_im | en_ex | Swap one register for the other |
en_ex | en_im | Swap one register for the other |
Configure an Addition or Subtraction
When one meter is connected downstream of another, it is necessary to subtract the downstream meter from the upstream meter to avoid double counting.
Rules are configured using the IDs (long hexadecimal number) of each meter and the signs + or -.
The result of the rule will be applied to the validated data (see below).
Key | Possible value | Description |
rule | meter_id_1 {+ or - } meter_id_2 {+ or - } ... | Swap one register for the other |
Additions and subtractions can apply to the registers of the electricity, thermal, and water meters defined above.
Isolated meters cannot be used in a rule.
Photovoltaic (PV) Meter on a Consumption Meter
When the PV system is connected to a consumption meter (e.g., for common areas) of type Consumption meter, a second Common meter is created with the same primary address, of type Production meter.
The gateway will read the same meter twice. This meter is named "Common Surplus".
Then, the rules below are applied using the hexadecimal IDs of the meters represented here by C, P, and S.
Common Meter
ID: C
Rule: C + P - S
"Surplus" Common Meter
ID: S
Rule: S - S
PV Meter
ID: P
Rule: None
Attention: This must be done from the beginning of meter reading. If done later, the readings from the Common meter must be manually copied to the new Common Surplus meter.
3. Abnormal Data Filters
The received data may contain abnormal data (incorrect registers, reset to 0, external data sources, etc.). It is possible to replace this consumption data with 0 via the "trigger" parameter:
Key | Description |
trigger | Replaces consumption data (15 min) exceeding "trigger" with 0 |
Example for a 32A max electricity meter - over 15 minutes, the meter can increment by:
1/4 * (3 * 230 * 32)/1000 kWh = 5.52 kWh
-> a "trigger" of 15 is therefore a good value to filter out abnormal data.
4. Data Validation
The system automatically processes the collected raw data several times a day, validates it, and saves it (validated data).
This allows defining 15-minute consumption for each meter, splitting self-consumed energy from grid-drawn energy, and aggregating the values of all meters to indicate the site's overall consumption and production.
For data to be validated correctly, the collected raw data must be correct and complete. If necessary, correct it using the rules explained above.
The system validates the site's global data up to the date for which readings are available for all site meters (excluding isolated meters).
Validated data is used to generate consumption statements and billing.
Meter Installation Date
The meter installation date allows for estimating the 15-minute consumption of the meter before the first reading on the platform.
The system validates data starting from the defined installation date for each meter.
For example, if an index is read for the first time at 3000 kWh on October 15, 2022, and an installation date is set to June 15, 2022, the system distributes the 3000 kWh over the preceding 3 months in 15-minute intervals.
Isolated Meter
When a read meter should not be considered in the overall validation, the Isolated meter mode is activated to ignore it for the site's overall consumption.
The consumption of this meter can then simply be viewed, but it is neither integrated into the overall consumption nor the solar/grid energy distribution of the site. However, it can be used for statements and billing.
An isolated meter cannot be used in an addition/subtraction rule (see above), nor as a consumption meter for charging station zones.
This mode applies to electricity, thermal, and water meters.
Impact on Visualization
Isolated meters are not visible in the site's overall graphs (15-minute, monthly, and annual).
Virtual Meter
It is possible to create a single electric virtual meter per site. This meter deducts and accounts for all energy not measured by other meters.
A virtual meter is created when it is not physically possible to install a meter on a consumer.
This is the case, for example, with the Single wiring diagram.
Manually Read Meter
If manually read meters are used, a reading must be inserted regularly to avoid blocking the site's overall validation.
Resampling Validated Data (Resampling)
When the parameters defined above are modified and raw data has already been collected, it is necessary to resample the validated data (resampling) from the beginning or a defined date.
Go to Configuration > Admin > Resampling (admin user only)
Site Data Processing
Meter to infer by calculation:- Auto: The virtual meter if one exists, otherwise the photovoltaic production.
- Meter selected in the dropdown list: the system ignores the raw data of this meter and reconstructs it from the others. This mode is impossible if there is a virtual meter. Note that a "disabled" meter must not be selected.
Data Cleaning: removes negative or inconsistent data in the validated data.
Site Data Resampling (Resample all site)
Select a period (start and end). If no start date is specified, the site's creation date is used.
When resampling starts, all existing validated data in the selected period is deleted and then rebuilt.
Possible errors:
- There is no data between the start and end dates for at least one meter (excluding isolated meters). At least two readings are required in the selected period.
- At least one of the registers mentioned above is missing for at least one of the meters.
