IBM adds support for Apache Spark for z Systems

IBM has announced that z Systems will support Apache Spark for Linux. Such support will be provided in the framework of the analytics on mainframe project. Thanks to this, data mining specialists will be able to use Apache Spark on powerful z Systems mainframes.

Providing support for Apache Spark for Linux on systems such as z Systems opens up the possibility of expanding the ecosystem of such systems, while increasing the number of uses. IBM developers are integrating Apache Spark with z / OS this year. Data professionals will be able to use a standard software framework regardless of the specifics of the data format.

IBM introduced the z13 mainframe a bit earlier this year. z13 is one of the most powerful servers of this type, while z13 is distinguished not only by high performance, but also by the ability to encrypt and analyze transactions in real time. It took five years and about a billion US dollars to build this mainframe. In the process of working on the creation of z13, innovative technologies of more than 500 new patents were used. It is worth noting that the mainframe is an open platform, with support for Linux and OpenStack. The corporation has also released a new OS release - z / OS, in which a new type of analytics is used, there is support for Hadoop and support for data storage systems. IBM is currently the largest mainframe manufacturer in the world.
')
Simultaneously with the introduction of Apache Spark for z / OS, IBM begins work with three large companies that specialize in analytics: these are Zementis (predictive analysis), Rocket Software (data visualization) and Elite Analythics (working with projects running on z Systems).

Cooperation with Zementis will allow specialists to build models using SPSS, R, Python, SAS and other commercial or open-source tools. Such models can then be run in the z / OS operating environment. Users can work with Zementis to create IMS, DB2 for z / OS, and VSAM operating models.

The IBM-Rocket Software collaboration makes Rocket Service's Data Virtualization Service available for Spark at z Systems. The service allows you to combine various data sources into a single system. Plus, this company announced its intention to add support for the analytical platform R on z / OS.

Working with Elite Analythics includes the provision of new services for the development and management of various projects on z Systems. These include the real-time capabilities of Zementis or SPSS, plus projects developed on Apache Spark on z / OS.

The “analytics on mainframe” strategy fully complies with the plans announced in June for integrating the Spark platform into various IBM products. Now Apache Spark is offered by the company and as a service for the Bluemix cloud platform. According to company representatives, 3,500 developers and researchers have already submitted applications for work with projects related to Spark.