Data lake industrial

Abstract

With the massive increase in data generation and the need for competitive advantages in the industrial sector, the use of Big Data tools for data analysis and support in the decision-making process is essential for the growth of companies. In this context, this work presents the process of creating a Data Lake for a pulp and paper industry. The cloud architecture developed promoted the solution of problems such as: Low performance, security in the automation network, requiring the release of users to access the industrial network, difficulty in creating new management reports, due to several databases spread across the world. automation environment, solving problems of high consumption of Hardware on the servers, due to the multiple accesses that were performed simultaneously. The results obtained with the proposed solution include: The creation of a Data Lake with a corporate architecture of the Company, making it possible to cross data from different systems and bases for reporting, aiming at the improvement and greater reliability of the manufacturing plant, making the environment and the scalable and more secure infrastructure, enabling greater performance in the preparation of factory reports for decision making. The results were observed instantly, with high performance in the creation and more simplified access to reports, giving greater visibility and security in the information acquired through the extraction of data from alarms and forces of the equipment. Taking internal customer satisfaction and confidence in the development of new projects using Big Data technologies and concepts, enabling new discoveries, research and intelligence due to the high computational power that is the use and treatment of data in a scalable environment as it is the cloud.