Comping Data Lake is a centralized Big Data repository designed for collecting and consolidating data from heterogeneous source systems. The solution has already been proven in practice through a successful implementation at one of the European transmission system operators (TSO). The implementation includes the collection of data from 10 different source systems, resulting in the storage of more than 50 TB of data per year. Among other things, sensor data with a resolution of 20 ms is collected, arriving from several dozen devices, resulting in more than 6 billion measurements per day.

The system enables the transmission system operator to collect ALL relevant data (including “extremely fast” data), store them in a cost-effective way, and analyze them later in order to gain deep insights into the condition of its most critical equipment. The system also brings other immediate benefits such as process optimization, improved regulatory reporting, and better insight into grid stability with the goal of making higher-quality decisions. The system further enables the application of machine learning techniques for forecasting key factors in power system management, such as transmission network loss forecasting, solar and wind power production forecasts, electricity market price forecasting, and more.

The Comping Data Lake service is targeted at transmission system operators (TSOs) and distribution system operators (DSOs), as well as many other companies that need to collect, process, and store large volumes of high-frequency sensor data.

The service can be adapted to local regulatory requirements and technological frameworks. Compared to the competition, Comping Data Lake stands out through implementation speed, deeper integration with existing IT systems, and proven results in large operational environments.