Processing of Count Data
Updated by Nicolas
1. Raw meter readings
The meters are read automatically via the Gateway Climkit (or a third-party API or FTP service).
It is the meter index (sum measured by the meter since it was connected) which is read. We are talking about raw data.
A reading consists of one or more meter indexes and the reading date.
Electricity meters transmit two indices:
en_im
(kWh): imported energy, i.e. the energy consumed or withdrawnen_ex
(kWh): exported energy, i.e. the energy produced by a photovoltaic installation or delivered
Thermal energy meters (hot or cold) transmit:
heat_energy_kwh
(kWh): thermal energy consumed
Hot or cold water meters transmit:
vol_m3
(m3): volume of water consumed
2. Configuring corrective rules
When meters are not installed according to the drawing and assembly instructions, it is possible to configure rules to correct the readings.
Electric meter plugged in backwards
When an electric meter is connected backwards, its en_im
and en_ex
indexes can be reversed.
Edit counter > Additional parameters:
Key | Possible value | Description |
en_im | en_ex | Reverse one register to another |
en_ex | en_im | Reverse one register to another |
Set up an addition or subtraction
When one meter is connected downstream of another, it is necessary to subtract the one downstream from the one upstream to avoid double counting.
The rules are configured with the ID (long hexadecimal number) of each counter and the + or - signs.
The result of the rule will be applied in the validated data (see below).
Key | Possible value | Description |
rule | meter_id_1 {+ or - } meter_id_2 {+ or - } ... | Reverse one register to another |
Additions and subtractions can be applied to the electrical, thermal and water meter registers defined above.
You cannot use an isolated counter in a rule.
Photovoltaic (PV) meter on a consumer meter
When the PV is connected to a consumer meter (for example on the commons) of the Consumption meter type, a second Commons meter is created with the same primary address of the Production meter type.
The gateway will read the same counter twice. This meter is called “Commons Surplus”.
Then, we apply the rules below with the hexadecimal IDs of the counters represented here by C, P and S.
Common Meter
ID: C
Rule: C + P - S
Common “Surplus” Meter
ID: S
Rule: S - S
HP counter
ID:P
Rule: None
Please note: this must be done from the start of the meter reading. If you do it later, you must manually copy the values read from the Commons counter into the new Commons Surplus counter.
3. Abnormal Data Filters
The received data may contain abnormal data (bad registers, reset to 0, external data sources, etc.). It is possible to replace this consumption data with 0 via the "trigger" parameter:
Key | Description |
trigger | Replaces consumption data (15 min) greater than “trigger” with 0 |
Example for an electric meter of 32A max: maximum over 15 min, the meter can increment by:
1/4 * (3 * 230 * 32)/1000 kWh = 5.52 kWh
-> a "trigger" of 15 is therefore a good value for filtering abnormal data.
4. Data validation
The system automatically processes the collected raw data several times a day, validates it and saves it (validated data).
This makes it possible to define consumption at 15 minutes for each meter, to distribute the share of self-consumed energy from the share withdrawn from the network and to aggregate the values of all the meters to indicate the overall consumption and production of the site.
For data to be validated correctly, it is necessary that the raw data collected is correct and complete. If necessary, correct them using the rules explained above.
The system validates the overall site data until the date when we have the reading of all the meters on the site (excluding isolated ones).
These are the validated data which are used to generate consumption statements and invoicing.
Date of installation of meters
The date the meters were installed makes it possible to estimate consumption 15 minutes from the meter before the first reading on the portal.
The system validates the data since the installation date defined for each meter.
For example, if an index is recorded for the first time at 3000 kWh on October 15, 2022 and an installation date is set to June 15, 2022, the system distributes the 3000 kWh over the previous 3 months in periods of 15 minutes.
Insulated meter
When a meter reading should not be taken into account in the overall validation, we activate the Compteur isolé
mode to ignore it from the overall consumption of the site.
We can then simply visualize the consumption of this meter but it is neither integrated into the overall consumption nor into the distribution of the site's solar/network energy. However, it can be used for settlements and invoicing.
An isolated meter cannot be used in an addition/subtraction rule (see above), nor as a consumption meter for charging station areas.
This mode applies to electric, thermal and water meters.
Impact on visualization
Isolated counters are not visible in the overall site graphs (15 minutes, monthly and annual)
Virtual counter
It is possible to create a single virtual electricity meter per site. This meter deducts and accounts for all energy that is not measured by other meters.
A virtual meter is created when it is not possible to physically install a meter on a consumer.
This is the case, for example, with the Single wiring diagram .
Meter read manually
In the case of using meters read manually, it is therefore necessary to regularly insert a reading at the risk of blocking the overall validation of the site.
Reconstruction of validated data (resampling)
When the parameters defined above are modified and raw data has already been collected, it is necessary to reconstruct the validated data (resampling) from the beginning or a defined date.
Go to Configuration > Admin > Resampling (admin user only)
Processing of site data
Compteur à inférer par calcul
:- Auto : The virtual meter if there is one or otherwise the photovoltaic production.
- Counter selected from drop-down list : The system ignores the raw data for this counter and reconstructs it from the others. This mode is impossible if there is a virtual counter. Note that a “disabled” counter should not be selected.
Nettoyage des données
: Removes negative or inconsistent data from validated data.
Reconstruction of site data (Resample all site)
Select a period (start and end). If no start date is specified, the site creation date is used.
When the reconstruction is started, all validated data existing in the selected period is deleted and then reconstructed.
Possible errors:
- There is no data between the start date and the end date for at least one counter (excluding isolated counters). At least two readings are required in the selected period.
- At least one of the counters is missing at least one of the registers mentioned above.