Oct 29, 2018

Big data will present significant challenges with regard to securing sensitive information and protecting individual privacy, and the only answer will be open technologies, standardized interconnectivity and collaboration on a global scale.

According to Robert H. Sheldon
Technical Consultant & Freelance Technology Writer
I think we can get a good sense of where big data is moving to from some of the efforts going on today in various industries and disciplines. A good example is the OpenPOWER Foundation effort, which is based on IBM’s POWER platform. IBM has opened up much of the platform in a way unheard of a couple years ago, enabling collaboration among various organizations in order to innovate along trajectories not always possible when operating behind closed doors.
When we start talking about the systems necessary for advanced scientific computing and analysis, as well as machine learning and real-time event streaming, we’re likely to conclude that it’s no longer possible to go it alone, that open platforms and standards will ultimately be the only way to meet the demands of the type of data processing that will be coming our way. By opening up the technology, we invite the innovation and collaboration needed to meet the needs of data head on.
But OpenPOWER is not the only movement worth noting to help gain an understanding into what might be coming. Microsoft efforts such as Event Hubs and Stream Analytics point to the plethora of data expected from the string of connected Internet of Things (IoT) devices. Event Hubs makes it possible to stream real-time data from a wide range of devices and then send it on to Stream Analytics to make sense of it. What makes such solutions possible is embracing open standards and cloud technology, two areas that Microsoft was relatively slow to warm up to. But Microsoft has no doubt been making up for lost time and has become a formidable force in the cloud frontier. Like IBM, they saw the writing on the wall and are responding accordingly.
Regardless of the technology or platform or type of solution, integration and interoperability, along with open collaboration, represent the foundations on which the big data solutions of the future will be built.