Counting Data Processing
Updated
by Nicolas Vodoz
1. Raw Meter Readings
Meters are automatically read via the Climkit Gateway (or a third-party API or FTP service).
It is the meter's index (the sum measured by the meter since its connection) that is read. We refer to this as raw data.
A reading consists of one or more meter indices and the reading date.
The electricity meters transmit two indices:
en_im(kWh): imported energy, which is the energy consumed or drawnen_ex(kWh): exported energy, which is the energy produced by a photovoltaic installation or fed back
The thermal energy meters (heating or cooling) transmit:
heat_energy_kwh(kWh): the thermal energy consumed
The hot or cold water meters transmit:
vol_m3(m3): volume of water consumed
2. Configuration of Corrective Rules
When the meters are not installed according to the schematic and assembly instructions, it is possible to configure rules to correct the readings.
Electric Meter Connected Backwards
When an electric meter is connected backwards, we can invert its indices en_im and en_ex.
Edit the meter > Additional Settings:
Key | Possible Value | Description |
en_im | en_ex | Invert one register to the other |
en_ex | en_im | Invert one register to the other |
Configure Addition or Subtraction
When a meter is connected downstream of another, it is necessary to subtract the downstream one from the upstream one to avoid double counting.
The rules are parameterized with the IDs (long hexadecimal number) of each meter and the signs + or -.
The result of the rule will be applied in the validated data (see below).
Key | Possible Value | Description |
rule | meter_id_1 {+ or - } meter_id_2 {+ or - } ... | Invert one register to the other |
Additions and subtractions can apply to the registers of the defined electricity, thermal, and water meters above.
An isolated meter cannot be used in a rule.
Photovoltaic Meter (PV) on a Consumer Meter
When the PV is connected to a consumer meter (for instance in shared areas) of type Consumption Meter, we create a second meter, Shared, with the same primary address of type Production Meter.
The gateway will read the same meter twice. This meter is called "Shared Surplus."
Then, we apply the rules below with the hexadecimal IDs of the meters represented here as C, P, and S.
Shared Meter
ID: C
Rule: C + P - S
Shared Meter "Surplus"
ID: S
Rule: S - S
PV Meter
ID: P
Rule: None
Note: this must be done from the start of the meter readings. If done later, the values recorded from the Shared meter must be manually copied to the new Shared Surplus meter.
3. Filters for Abnormal Data
Received data may contain abnormal data (incorrect registers, resets, external data sources, etc.). It is possible to replace this consumption data with 0 via the "trigger" parameter:
Key | Description |
trigger | Replaces consumption data (15 min) greater than "trigger" with 0 |
Example for a maximum 32A electric meter - at maximum over 15 min, the meter can increment by:
1/4 * (3 * 230 * 32)/1000 kWh = 5.52 kWh
-> a "trigger" of 15 is therefore a good value for filtering abnormal data.
4. Data Validation
The system automatically processes and validates the collected raw data multiple times a day and saves it (validated data).
This allows defining 15-minute consumptions for each meter, allocating the share of self-consumed energy from the energy drawn from the grid, and aggregating the values of all meters to indicate the overall site consumption and production.
For the data to be validated correctly, it is necessary that the collected raw data is correct and complete. If not, correct them using the rules explained above.
The system validates the overall site data up to the date when we have the reading of all meters at the site (excluding isolated ones).
It is the validated data that is used to generate consumption reports and billing.
Installation Date of the Meters
The installation date of the meters allows estimating the 15-minute consumption of the meter before the first reading on the portal.
The system validates the data from the defined installation date for each meter.
For example, if an index is recorded for the first time at 3000 kWh on October 15, 2022, and an installation date is set to June 15, 2022, the system distributes the 3000 kWh over the previous 3 months in 15-minute periods.
Isolated Meter
When a measured meter should not be included in the overall validation, the Isolated Meter mode is activated to ignore it from the overall site consumption.
We can then simply visualize the consumption of this meter, but it is neither integrated into the overall consumption nor into the allocation of solar/grid energy for the site. However, it can be used for reports and billing.
An isolated meter cannot be used in an addition/subtraction rule (see above), nor as a consumption meter for charging station areas.
This mode applies to electricity, thermal, and water meters.
Impact on Visualization
Isolated meters are not visible in the site's overall graphs (15 minutes, monthly, and annual)
Virtual Meter
It is possible to create one and only one virtual electric meter per site. This meter deducts and accounts for all energy not measured by the other meters.
A virtual meter is created when it is not possible to physically install a meter on a consumer.
This is the case, for example, with the Single wiring scheme.
Manually Read Meter
In the case of using manually read meters, regular readings must therefore be entered, or the overall validation of the site may be blocked.
Reconstruction of Validated Data (Resampling)
When the parameters defined above are modified, and raw data has already been recorded, it is necessary to reconstruct the validated data (resampling) from the beginning or a defined date.
Go to Configuration > Admin > Resampling (admin user only)
Site Data Processing
Meter to infer by calculation:- Auto: The virtual meter if there is one; otherwise, the photovoltaic production.
- Meter selected from the dropdown list: the system ignores the raw data of this meter and reconstructs it from the others. This mode is impossible if there is a virtual meter. Note that a "deactivated" meter should not be selected.
Data Cleaning: removes negative or inconsistent data from the validated data.
Reconstruction of Site Data (Resample all site)
Select a period (start and end). If no start date is specified, the site's creation date is used.
When the reconstruction is launched, all existing validated data in the selected period are deleted and then reconstructed.
Possible errors:
- There is no data between the start date and end date for at least one meter (excluding isolated meters). There must be at least two readings in the selected period.
- At least one of the registers mentioned above is missing for at least one of the meters.
