HighByte Blog
Read company updates and our technology viewpoints here.
|
Read company updates and our technology viewpoints here.
|
Elevate your industrial interoperability: A primer on data Pipelines in the Intelligence Hub3/8/2024
Time to read: 15 minutes In HighByte Intelligence Hub, the Pipelines feature was created to make modeled data consumable by a diverse range of applications and services. With the last few releases of the Intelligence Hub, Pipelines has undergone big changes to further that goal and more. From adding new functionality to refining the UX, Pipelines has swiftly evolved beyond its initial focus on “post-processing” payloads for advanced use cases. It has become a core data engineering capability to solve industrial interoperability problems within the Intelligence Hub. Time to read: 9 minutes I consistently hear that many manufacturers are drowning in data and struggling to make it useful. Why is that? A modern industrial facility can easily produce more than a terabyte of data each day. With a wave of new technologies for artificial intelligence and machine learning coupled with real-time dashboards and prescriptive insights, industrial companies should be seeing huge gains in productivity. Unplanned asset and production line maintenance should be a thing of the past. But we know that is not the case. Access to data does not make it useful. Industrial data is raw and must be made fit for purpose to extract its true value. Furthermore, the tools used to make the data fit for purpose must operate at the scale of an industrial enterprise. For many industrial companies, this is a daunting task requiring alignment of people, process, and technology across a global footprint and supply chain. At HighByte, we’re putting our best foot forward to solve this data architecture and contextualization problem from a technology perspective. But what about people and process? To pull it all together, we recently published a new guide, “Think Big, Start Small, Scale Fast: The Data Engineering Workbook.” The guide provides 10 steps to achieving a scalable data architecture based on the best practices we’ve learned from our customers over the last several years. Time to read: 6 minutes Ever since the first release of HighByte Intelligence Hub in 2020, HighByte has developed the solution to meet the industrial data integration needs of today’s industrial customers and tomorrow’s market requirements. The first version of the Intelligence Hub was a client-based application that collected and published contextualized data to any consuming system. As Industry 4.0 leaders began to integrate more systems and assets into their ecosystems, data consumers needed better data visibility and access. The consumers wanted to be able to see all available information, so they could access exactly what they needed. To deliver this visibility and access, we embedded an MQTT broker into the Intelligence Hub, giving administrators the necessary tools to build a Unified Namespace (UNS) that would allow consumers to easily subscribe to the information they desired. With changing needs in mind, in May 2023, we took the next step in the evolution of the Intelligence Hub, adding the ability to request data on-demand through the Intelligence Hub with a built-in REST Data Server. This addition allows users to request time series, transactional, or master data from systems through a single, simple API. Time to read: 7 minutes You don’t have to agree with environmental policies to know that sustainability is a part of business and life today. Supply chain partners, regulators, customers, and investors are demanding more environmental accountability from manufacturers—and with good cause. According to the International Energy Agency, the manufacturing and power sectors account for 63% of energy-related CO2 emissions worldwide. Progress depends largely upon their success. Thankfully, manufacturing has come a long way since the third industrial revolution that saw a rise in automation and productivity without much consideration for environmental impact. The fourth industrial revolution, or Industry 4.0, has given manufacturers more insight into their operational efficiencies. Network-connected assets provide a real-time lens into performance metrics that go hand-in-hand with more sustainable production. Still, this level of connectedness presents a new challenge: How to manage data more efficiently. Time to read: 7 minutes For the past several months, 55 beta testers in 13 countries have been kicking the tires on HighByte Intelligence Hub version 3.0 and generously providing their feedback. Today, I’m excited to announce this major release is now available. Version 3.0 is a step change for the Intelligence Hub and for the Industrial DataOps market. It raises the bar for what a DataOps solution can be at Enterprise scale. It introduces a powerful new Pipelines builder to curate complex data pipelines. It makes the often-vague concept of the Unified Namespace (UNS) tangible and achievable with an embedded MQTT broker—reducing additional software, cost, and administration overhead for our customers. I sat down with HighByte Chief Product Officer John Harrington to talk about some of these advancements available in Version 3.0, including Pipelines. His thoughts are below. I also provide insights from our partner Goodtech, a deep dive on the embedded broker, a review of new project management capabilities, and more. |
|