Raw Data Configuration

If you have Once you install NetVizura, the default database for Raw Data is Elasticsearch. However, the main database can be switched to PostgreSQL by using the dropdown menu at the top of the page.

Depending on the database you have selected, the available Database Settings options to configure are listed below.

Elasticsearch Database Settings

If you have selected Elasticsearch as your main database, the following parameters are available:

• Maximum used disk size - Define the maximum disk space allocation for NetFlow data. When this limit is reached, the oldest data will be deleted.
• Maximum database size - Determine maximum size of NetFlow data stored in Elasticsearch database. If exceeded, the oldest data will be removed from the database.
• Maximum database size in days - NetFlow data will be stored in the PostgreSQL database for a specified number of days and will be deleted afterward.
• Max Time Window - summary view - Limit the time window during which raw data can be retrieved.
• Max Time Window - aggregated view - Specify the time window constraints for querying aggregated raw data.

Configuring Elastic Server

By default, raw data is stored and accessed locally (more precisely at http://localhost:9200).

To change the address of the Elastic server, enter the Remote IP address and Port in the respective fields, along with the necessary authentication parameters. 

In our example, this setup will write and read messages from http://172.16.4.71:9200 with authentication.

PostgreSQL Database Settings (Raw Data Archive) 

If you pick the PostgreSQL database, you are configuring the way data are to be archived: 

• Temp folder - The folder where NetFlow Analyzer temporarily unpacks raw data files.

• Archived files folder - The folder where NetFlow Aggregator stores processed raw data files.

• Legacy raw files folder - The folder where NetFlow stores raw data files from previous versions.
• Minimum free disc space - This value, defined in megabytes (MB), specifies the minimum amount of free disk space required on the NetFlow server. If saving a new raw data file would reduce available disk space below this threshold, NetFlow will automatically delete the oldest raw data files to free up space. The default value is 2048 MB.
• Minimum archive size in days - The system will warn you up to 7 days before archive space runs out. This property is not used for the archive files cleaning, but solely to notify the user of the low disk space.
  

Additionally, NetFlow Analyzer warns you if the archive space is full and advises further actions. Warnings are sent by email to NetVizura administrators and displayed when you log-in. A warning message is triggered when Minimum free disc space is to be reached, before the defined minimum amount of raw data files in days is stored (defined in Minimum archive size in days field).

Example of archive warning message for Minimum number of days set to 30 and Minimum free disk space set to 2 GB:

Data for 10 more days (30 GB) still need to be stored, although there is only space for 7 more days (21 GB) in the archive storage.

More space needs to be provided for archive files. Possible solutions would be to move existing files to another location or to lower the minimum number of days (currently set to 30) for which you would like to keep the archive files. 30 days of archive files take approximately 90 GB of space.

When the NetFlow archive is full, the oldest raw data files will be deleted first, even though these files should be saved by the value defined in the field Minimum number of days.