Modify the data validation schema for counting

Adding Meters

Sub-Meters:

There are two types of meters. Physical (real) meters connected to a gateway and rule-based meters.

The rules for the meters are then defined under Configuration > Meter Data.

Always define the meter mode:

Mode:

• Consumption
• Introduction
• Production
• Battery

Meters must be activated to be considered in the validation scheme below.

Installation Date of Meters

Defining an installation date allows to insert a zero index at the desired date. This allows us to calculate the meter's consumption between the moment it was installed and its first reading.

Meter Readings

Meters are automatically read via the Climkit Gateway (or a third-party API or FTP service).

In most cases, the readings are the meter's index, but there can also be consumption data sent, as with the GRD meters for example.

All this data is then processed on our servers.

Meter Data Validation Schemes

The processing of readings is configured through what are called schemes. These schemes are specific to each type of meter. There will be different schemes for water, heating, and electricity.

Available Meter Types:

• Electricity
• Heating
• Cold Water
• Hot Water
• Cooling
• Reactive

To configure how consumptions are calculated, rules are established in each scheme → Configuration > Meter Data

Scheme Configuration

Each scheme has parameters allowing configuration by meter type.

• Locking: date at which the site's data is locked to prevent modification in the past. Useful for freezing self-consumption rates after invoicing for example.
• Display only validated data: hides the display of site data (investor view) that could not be validated, for example due to a missing meter.
• Validate upon visualization: forces the validation of data when accessing the visualization page. Disabling this option is useful in cases where validating data would slow down page loading too much.

Rules

There are 3 types of rules: meter validation rules, site validation rules, and allocation rules.

Meter rules are used to calculate the consumption of one or more meters. By default, consumption is the difference between the meter indexes. However, in some cases, the calculation is more complicated, and specific rules must be applied.

These rules can have a start and end date to limit their effect over time.

Parameters

Rules can be applied by period. In the case of two periods, the end date/time of the first period must be the same as the start date/time of the following period.

• Start Date: start of rule application
• End Date: end of rule application
• Priority: order of rule execution. Leave default priorities.

a. Meter Validation Rules

The meter rules apply individually to one or more meters.

1. Operations on Energy Registers (imported and exported)

For electricity meters only

2. Exclusion of Anomalous Data

Ignores consumption lower than min and higher than max during a certain interval. This interval is 15 minutes for electricity and one day for sanitary meters.

Useful for meter changes or ignoring a large difference in consumption or negative consumption.

3. Addition and Subtraction

Addition and subtraction on the registers of the meters or flows.

Syntax: Hex ID of the meter and register in brackets followed by operator.

HEX-ID[register] operator HEX-ID[register]

Possible values for the register: im or ex

Example of addition and subtraction on the meter registers:

CKT-067586[im] - CKT-067587[ex] + CKT-06758F[im]

4. Scaling

Multiplication of counting data (indexes) by a scalar value.

b. Site Rules

1. Ignore Meter(s)

Optional rule

Ignores data from a meter from the site validation and from the rest of the rules such as self-consumption rate calculation.

2. Total Calculations for Each Flow

Mandatory rule

Sums up the site consumptions from the imported register of meters in "consumption" mode, the sum of introductions (sum of imported and exported registers) and the sum of productions of the site.

3. Deduction of a Flow

Mandatory rule

Deduction of a flow (production, introduction, or unmeasured) or deduction of a physical meter.

4. Calculation of Self-consumption Rate

Mandatory rule if there is solar energy in the period

Calculates the self-consumption rate and network rate from the previously calculated consumption, introduction, and production flows.

5. Data Cleaning

Optional rule

Ignores any negative value.

c. Allocation Rules

Allocation rules allow to assign a flow or the consumption/production of a meter to a rule meter.

Options:

• Production: assigns the total site production to the selected meter
• Introduction: assigns the total site introduction to the selected meter. The imported will be assigned to the imported register of the rule meter and the exported from the site to the exported register. Useful for visualizing a deduced introduction.
• Unmeasured: assigns the unmeasured from the site to the selected meter
• Custom: allows entry of a custom formula to assign to the selected rule meter. It is possible to use the register of a meter and/or a flow. For example, production - CKT-213456[ex] to calculate the residual production by subtracting the total site production from the exported of a production meter.

d. Other Parameters of the Validation Scheme

Locking: (optional) Prevents data validation before this date.

Display only validated data: (checked by default) Only validated data will be displayed in Visualization. Uncheck to also display provisional data. Only affects the display in investor account view (entire site). Data is automatically validated every 3 hours.

Validate upon visualization: (checked by default) Data will be validated upon visualization. Uncheck to speed up the loading of graphs. Data is automatically validated every 3 hours.

Process

1. Define rules
2. Validate data:
   1. start date
   2. end date
   3. meter type

Practical Migration Cases

1. Configuration > Admin: change data processing version from V1 to V1_V2
2. Import V1 data to V2
3. Add a scheme for electricity and add a locking date at the beginning of the next billing period.
   <aside> 💡
   For example: if the site was billed until 30.06, set to 01.07 midnight.
   </aside>
4. Modify the validation scheme by adding/modifying rules on the meters and site rules
5. Validate site data

Typical Schemes

Deduction of Production (default)

Even with the presence of a physical production PV meter, the default scheme deducts the production flow from the consumption and introduction data.

Site Rules

1. Total calculations for each flow
2. Deduction of the production flow
3. Calculation of the self-consumption rate

Deduction of Introduction

In the case where no introduction meter is present, the introduction flow must be deducted from consumption meters and/or production meter(s).

Site Rules

1. Total calculations for each flow
2. Deduction of the introduction flow
3. Calculation of the self-consumption rate