Project News

With increasing automation in the manufacturing domain, more and more data is becoming available that needs to be properly managed and thoroughly analysed to be able to gain valuable insight into manufacturing activities. The Manufacturing Big Data, Knowledge and Analytics component (BDA) in the CREMA project has been designed to exactly address this issue.

The BDA will provide business analytic functionalities to derive meaningful information and events from process and sensor data within the manufacturing domain. Data from multiple data sources in a factory (including process and sensor data) will be fed into the BDA component to derive business intelligence and hidden values. The data processing and analytics functionality of BDA component will be realised using an industry tested open source solution called Talend Open Studio for Big Data.

Talend Open Studio simplifies big data integration, management and analytic operations with graphical tools and wizards so you can start instantly working with Big Data technologies. In this respect, Talend offers a handful of options to integrated and work with state of the art technologies such as Apache Hadoop, Apache Spark, Spark Streaming and NoSQL databases.

In the CREMA BDA component, the use of Talend Open Studio for Big Data will enable us to design complex data analytic jobs e.g. creation and querying of OLAP cubes, using a graphical interface. Once a job has been designed with ETL and analytic functionality (example shown in the above figure), it will be executed and validated within the Talend Studio in order to verify the integrity of the output. Once validated, the job will be exported as Java code so it can be integrated with the rest of the BDA component.

In this respect, the use of Talend Open Studio for Big Data will ease (to some extent) the complexity of transforming complex manufacturing data into meaning full information that not only helps manufacturers in better understanding their processes but also enable them to take a competitive advantage in the increasingly competitive manufacturing sector.