Data Import (DI) Edit


First Example of CSV Import (Number of items)
Second Example of "CSV Import" (Energy Data)




With the function Data Import - Edit you can integrate power values, performance or values form other media manually or with a CSV import file with an individually configured CSV structure into your GridVis software.

  • After the DI device has been configured ( Data Import - Configuration ), open the Overview Window (click on the DI device).

  • Click on the button Edit.

  • The window Edit Values will open.


images/download/attachments/251036622/DI_Editieren_01_EN-version-1-modificationdate-1519630177000-api-v2.png





images/download/attachments/251036622/DI_Editieren_02_EN-version-1-modificationdate-1519630219000-api-v2.png


Pos.

Description

1

Opens the Direct Help Guide.

2

The Name of Variable configured in Settings (Pos. 3) determines the name of value list (of the register).

3

Opens the window Select or define a measurement value.

In the window Select or define a measurement value you can configure the entry or import settings for your measurement values (see below for a more detailed description).

4

Entry field and buttons for selecting the date.

5

Deletes the list Tab of your measurement values.

6

Creates a new Value List (N/A).

7

Starting Time of the time period for which the measurement value is valid.

8

Stopping Time of the time period for which it is valid.

9

Entry field Valuen formanual entry. The editing of your entered values can be defined in the window Select or Design a Measurement Value fenstereinstellungenDI(see below for a more detailed description).

Press the return key to confirm the values you enter!

10

Entry field for Comments

Press the return key to confirm what you enter!


Note

The other screen grabs show examples of data imports. The screen grabs may vary depending on the value type.

The window Select or define a measurement value


In the window Select or define a measurement value, you can configure the processing of the values you have entered manually or via a CSV file .

  • In the Value List in the window Edit Values, click on the button Settings (images/download/thumbnails/251036622/einstellungssymbol-version-1-modificationdate-1517402925000-api-v2.png ).

  • In the window Select or Define a Measurement Value, the first register Value Selection will appear.




images/download/attachments/251036622/DI_Editieren_03_EN-version-1-modificationdate-1519630254000-api-v2.png

Pos.

Description

1

Click on the register to activate it.

The symbol images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png in the register fades out if the data entry is valid.

2

Click on the register to activate it.

3

Click on the register to activate it.

The symbol images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png in the register fades out if the data entry is valid.

4

Variables supplied by the system (measurement values).

If the button is activated (blue), entry parameters will appear for defining the measurement values / measurements for the system variables.

5

User-defined variable.

If the button is activated (blue), entry parameters will appear for defining user-defined measurement values / measurements variables.

6

Search and sort filter for the system variables (measurement values / measurements).

images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png ... fades out once the measurement value / measurement has been selected.

7

Name of your measurement value / your measurement.

images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png ... fades out when the name of your measurement value / your measurement is entered.

8

Unit of your measurement value / your measurement.

images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png ... fades out when the unit of your measurement value / your measurement is entered.

9

In the option list Definition, select the calculation mode for your measurement value / how GridVis processes the measurement value.

The selection has an effect on the calculation, recording and graphical representation of the measurement value.

10

Single-clicking will take you back to the values list in the Edit Values window.

Deletes entries already made in the Select or Define a Measurement Value window.

11

Single-clicking takes you to the next register.

12

Single-clicking on the active button saves your entries.




images/download/attachments/251036622/DI_Editieren_04_EN-version-1-modificationdate-1519630302000-api-v2.png

Pos.

Description

1

Click on the register to activate it.

2

Cycle in which the measurement values are saved (e.g. Daily ... The system saves one value every day). Settings:

  • 10-minute interval

  • 15-minute interval

  • Hourly

  • Daily

  • Weekly

  • Monthly

  • Annually

Note

  • The Time Period of a configured data import cannot be changed later on! For subsequent changes to the Time Period you must create a new data import. Delete your old data import if it is no longer needed.

  • For the settings 10-Minute Interval, 15-Minute Interval and Hourly, the Time in the third register Data Import must be set (cf. Pos. 15, third register Data Import).
    All other settings do not require any Time setting.

3

How the system handles measurement value gaps (missing data). Settings:

  • "ill Gaps with Interpolated Values - The system creates a constant function from the available measurement values. The function calculates the missing measurement values.

  • Fill Gaps with Zeros (0) - Measurement gaps are given the value 0.

  • Undefined Gaps - Measurement gaps remain blank or NaN (not a number).

Note

  • For values (entries) that increase linearly over a period of time and which you have recorded as increasing linearly (value recording produces a function), use the setting Fill Gaps with Interpolated Values.

  • For values (entries, e.g. daily number of items) that you have recorded without a function for a time period, use the setting Fill Gaps with Zeros (0).

Interpolation > See glossary below.


4

The option list Interpolation Mode appears when in Gap Management the item Fill Gaps with Interpolated Values has been selected. Settings:

  • Arithmetic Mean - The system fills the gaps according to the function of the mean values.

  • Previous Value - The system fills the gaps with the previously entered value.

5

An active slider hidesmissing measurement values (gaps) in the Value List .

6

If the slider is active, the calendar weeks appear in the Value List.

7

If the slider is active, the days of the week appear in the Value List.

8

Single-clicking will take you back to the values list in the Edit Values.

Deletes entries already made in the Select or Define a Measurement Value.

9

Single-clicking takes you to the next register.

10

Single-clicking on the active button saves your entries.




images/download/attachments/251036622/DI_Editieren_05_EN-version-1-modificationdate-1519630365000-api-v2.png

Pos.

Description

1

Click on the register to activate it.

The attention symbol "images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png " behind the entry fades out when the Import File (Pos. 3) is selected.

2

the slider activates the function Data Import (Standard setting = off), and with it all of the parameters in the register.

Available in the GridVis Standard edition and higher.

The attention symbol "images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png " before the entry Activated fades out when the Import File (Pos. 3) is selected.

Deleted Data Imports remain in the database until they have been permanently deleted (see Data Import - Delete Device ).

3

Click on the button images/download/thumbnails/251036622/Icon_oeffnen_neueDatei-version-1-modificationdate-1517402925000-api-v2.png to open the dialog box Open.

In the dialog box Open edit and select the name and path of the Import File (CSV file).

The last loaded Import File appears in the selection field.

In the register Data Import, the attention symbol images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png fades out if the reference (path) to the import file is valid. Please note: Do not move the Import File!

Values in the Import File overwrite the values in your Value List if they are in the same time pattern! Confirm with the buttons Transfer or Transfer to in the configuration window of the device (see Data Import - Configuration ) to have the system transfer the new data to the GridVis database.

Note

Ensure that the GridVis software can access the import file (CSV file)! Assign the user of the service the respective rights!
The "File Import" serves both manual entry as well as automated data import.

The attention symbol appears if the file formats are defective or have a different structure, and if there are invalid value formats in the Import File.

4

In the option list Format you can configure your file format. Supported file format: CSV (with freely configured CSV structure).

The File Import conforms to CSV RFC-4180 .

The File Import supports CLRF, CL and RF line breaks.

If the import format is valid, the attention symbol images/download/attachments/251036622/RotesDreick-version-1-modificationdate-1517402925000-api-v2.png in the register Data Import will fade out.

5

In the option list Schedule, assign the File Import a schedule. Supported schedules:

  • File Monitoring (standard setting) - The Import File is monitored cyclically for changes in size.

  • None - The function is not assigned to any schedule.

Timepoints

  • can be configured in the function Scheduling .

  • that were marked in the scheduling with a DI Tag appear as options in the Schedule of the data import .

6

Summer/Winter time change for the time values of the Import File.

7

Time Zone. (Standard setting:Europe/Berlin UTC+1 for Germany).

8

Select the character coding for your Import File. Supported character codings:

  • UTF-8 (8 -bit UCS transformation format , commonly used coding for Unicode symbols).

  • Windows-1252 ( 8-bit character coding used by the operating system Microsoft Windows).

Note

Malfunction will result from incorrect character coding!

Depending on the character coding, umlauts (ä, ü, ö) in your import file may lead to the malfunction of your data import.

Do not use any umlauts (ä, ü, ö) in your import file!

Pay attention to the correct character coding!

9

Selection of delimiters for the entered values in the Import File Supported delimiters:

  • ".

  • |.

  • ,.

10

If the slider is activated, the system will ignore entries with errors in your import file.

11

The slider activates the Header Entry (if applicable) in your import file.

Enter the number of lines to by ignored into the entry field of the Import File. Standard setting = 0.

12

The slider activates the column entry Designation (name of the measurement value, if applicable) of your Import File (Standard setting inactive).

Enter into the data field the column number that corresponds to the column Designation (name of the measurement value) of your import file.

By using entries in the entry field Filter the system sorts/filters according to Designations (names)of measurement values (useful, e.g. for import files with multiple measurement values).

Supports the Wildcard Function (Entry of placeholders for other characters , e.g. *).

Supports the entry of multiple names separated by the ; character.

13

Enter into the data field the column number that corresponds to the column Measurement Value (numerical value) of your import file (standard setting = 2).

Selection Format - Options: 123.45, 123,456.78, 123.45, 123,456.78.

14

Enter into the data field the column number that corresponds to the column Date of your import file.

Selection Format - Options: 31.12.16, 31.12.2016, 31/12/16, 31/12/2016, 12/31/16, 12/31/2016.

15

The slider activates the column entry Time (if applicable) of your Import File (Standard setting inactive).

A row marked with images/download/thumbnails/251036622/rotesDreieck-version-1-modificationdate-1517402925000-api-v2.png Time requires an entry!
(The settings 10-Minute Interval, 15-Minute Interval or Hourly in the second register in Time Period require an entry).

Enter into the data field the column number that corresponds to the column Time of your import file.

Selection Format - Options: 23:59, 23:59:59, 11:59 PM.

Note

If in your import file Date and Time are in the same column, assign the same column numbers!

16

If the same column number was assigned for Date and Time, then the entry Order will appear.

In the options field, select the entry order (Date_Time or Time_Date).

Selection Delimiters between Date and Time,- Options: Space," ";,""|," ",."

17

The slider activates the column entry Comment (if applicable) in your import file (standard setting inactive).

Enter into the data field the column number that corresponds to the column Comment of your import file.

18

The display field Example shows you the previously selected format settings in real time.

19

Single-clicking will take you back to the values list in the Edit Values.

Deletes entries already made in the Select or Define a Measurement Value.

20

Single-clicking on the active button saves your entries.

To complete the configuration, click on the button Apply.

The GridVis software value list takes your data from the CSV file after a Closing and Opening of the register Edit Values.
Please note: the time required to transfer the data may last up to 1 minute.