Modify the data validation schema for counting

Addition of Meters

Submeters:

There are two types of meters. Physical (real) meters connected to a gateway and rule meters.

The rules for the meters are then defined under Configuration > Meter Data.

Always define the meter mode:

Mode:

• Consumption
• Introduction
• Production
• Battery

Meters must be enabled to be considered in the validation scheme below.

Date of Meter Installation

Defining an installation date allows for inserting a zero index at the desired date. This enables us to calculate the meter's consumption between the moment it was installed and its first reading.

Meter Readings

Meters are automatically read via the Climkit Gateway (or a third-party API or FTP service).

Readings are primarily the index of the meter, but there may also be consumption data sent as with the GRD meters, for example.

All this data is then processed on our servers.

Validation Schemes for Meter Data

The processing of readings is configured through what is called schemes. These schemes are specific to each type of meter. We will have different schemes for water, heating, and electricity.

Available Meter Types:

• Electricity
• Heating
• Cold Water
• Hot Water
• Cooling
• Reactive

To configure how consumptions are calculated, rules are implemented in each scheme → Configuration > Meter Data

Scheme Configuration

Each scheme has parameters allowing configuration by meter type.

• Locking: date on which the site data is locked to prevent modification in the past. Useful to freeze self-consumption rates after billing, for example.
• Show only validated data: hides the display of site data (investor view) that could not be validated, for example due to a missing meter.
• Validate on visualization: forces validation of the data when accessing the visualization page. Disabling this option is useful in cases where data validation would slow down page loading too much.

Rules

There are 3 types of rules: meter validation rules, site validation rules, and allocation rules.

Meter rules are used to calculate the consumption of one or more meters. By default, the consumption is the difference between the meter indexes. However, in some cases, the calculation is more complex, and specific rules must be applied.

These rules can have a start and end date to limit their effect over time.

Parameters

Rules can be applied by period. In the case of two periods, the end date/time of the first period must be the same as the start date/time of the next period.

• Start date: start of rule application
• End date: end of rule application
• Priority: order of rule execution. Leave priorities at default.

a. Meter Validation Rules

The meter rules apply individually to one or more meters.

1. Operations on Energy Registers (Imported and Exported)

For electricity meters only

2. Exclusion of Anomalous Data

Ignores consumptions below min and above max during a certain interval. This interval is 15 minutes for electricity and one day for sanitary meters.

Useful for meter changes or ignoring a large difference in consumption or negative consumption.

3. Addition and Subtraction

Addition and subtraction on the registers of meters or flows.

Syntax: Hex ID of the meter and register in brackets followed by operator.

HEX-ID[register] operator HEX-ID[register]

Possible values for the register: im or ex

Example of addition and subtraction on meter registers:

CKT-067586[im] - CKT-067587[ex] + CKT-06758F[im]

4. Scaling

Multiplication of meter data (index) by a scalar value.

b. Site Rules

1. Ignore Meter(s)

Optional rule

Ignores data from a meter in site validation and the rest of the rules like the calculation of self-consumption rates.

2. Total Calculations for Each Flow

Mandatory rule

Sums the site consumptions from the imported register of meters in "consumption" mode, the sum of introductions (sum of imported and exported registers) and the sum of the site's productions.

3. Deduction of a Flow

Mandatory rule

Deduction of a flow (production, introduction, or unmeasured) or deduction of a physical meter.

4. Calculation of Self-Consumption Rate

Mandatory rule if there is solar in the period

Calculates self-consumption and grid rates from the previously calculated consumption, introduction, and production flows.

5. Data Cleaning

Optional rule

Ignores any negative value.

c. Allocation Rules

Allocation rules allow assigning a flow or the consumption/production of a meter to a rule meter.

Options:

• Production: assigns the total site production to the selected meter
• Introduction: assigns the total site introduction to the selected meter. The imported will be assigned to the imported register of the rule meter and the exported from the site to the exported register. Useful for visualizing a deducted introduction.
• Unmeasured: assigns the unmeasured from the site to the selected meter
• Custom: allows entering a custom formula to assign to the selected rule meter. It is possible to use a meter register and/or a flow. For example, production - CKT-213456[ex] to calculate the residual production by subtracting the total site production from the exported of a production meter.

d. Other Parameters of the Validation Scheme

Locking: (optional) Prevents the validation of data before this date.

Show only validated data: (checked by default) Only validated data will be displayed in Visualization. Uncheck to also display provisional data. Affects only the display in investor view (entire site). Data is automatically validated every 3 hours.

Validate on visualization: (checked by default) Data will be validated upon visualization. Uncheck to speed up the loading of graphs. Data is automatically validated every 3 hours.

Process

1. Define the rules
2. Validate the data:
   1. start date
   2. end date
   3. meter type

Practical Migration Cases

1. Configuration > Admin: change the data processing version from V1 to V1_V2
2. Import V1 data into V2
3. Add a scheme for electricity and add a locking date at the beginning of the next billing period.
   <aside> 💡
   For example: if the site has been billed until 30.06, set 01.07 midnight.
   </aside>
4. Edit the validation scheme by adding/modifying rules on the meters and site rules
5. Validate the site data

Template Schemes

Deduction of Production (default)

Even with a physical PV production meter present, the default scheme deducts the production flow from consumption and introduction data.

Site Rules

1. Total calculations for each flow
2. Deduction of production flow
3. Calculation of self-consumption rate

Deduction of Introduction

In the case where no introduction meter is present, the introduction flow must be deducted from the consumption meters and/or from the production meter(s).

Site Rules

1. Total calculations for each flow
2. Deduction of introduction flow
3. Calculation of self-consumption rate