Apache Spark
Best of 2023: Using Airflow to Run Spark on Kubernetes
Here's how to set up a Spark application on Kubernetes using the Airflow scheduler for data-intensive workloads ...
NetApp Automates Apache Spark Management on Kubernetes
NetApp today announced Spot Wave by NetApp, an offering that automates the deployment of the open source Apache Spark in-memory computing framework on Kubernetes clusters. Spot Wave enables Apache Spark deployment on ...
Google Aims to Wed Apache Spark to Kubernetes
Google today announced it will extend Google Cloud Dataproc, a managed service for accessing the Apache Spark in-memory computing framework, to Kubernetes. James Malone, a Google senior product manager, says Google will ...
MapR Embraces Kubernetes for Big Data
MapR Technologies announced it has integrated its distribution of the open source Apache Spark framework and the Drill query engine platform with Kubernetes. Suzy Visvanathan, senior director for product management at MapR, ...
Pepperdata Project Hosts HDFS on Kubernetes
Pepperdata has launched a project aiming to enable the Apache Spark in-memory computing framework for big data analytics applications. Pepperdata CTO Sean Suchter says the Hadoop File System (HDFS) on Kubernetes open-source ...
SAP Deploys Vora 2.0 on Kubernetes
More evidence emerged today that Kubernetes is rapidly evolving into a platform on which some of the largest enterprise applications will be deployed. SAP announced that Vora 2.0, a big data analytics ...
Using Google Trends to Chart Docker’s Rise to Fame
There’s no question that Docker containers have become extremely popular in a short period of time. But just how quickly has Docker risen to fame? That’s an interesting question to ponder—and one ...
HPE Commits to Mesosphere
When it comes to container technologies, Hewlett Packard Enterprise (HPE) has been considerably more aggressive than any other major vendor in terms of bundling third-party platforms with its IT infrastructure offering. After ...