March 25th, 2014

In-memory Big Data: Spark + H2O

RSS icon RSS Category: Uncategorized
H2O_Spark

Big Data has moved in-memory. Customers using SQL in their Join & Munging efforts via SHARK and Apache Spark need to use Regressions and Deep Learning. To make their experiences great & seamlessly weave SQL workflows with Data Science and Machine Learning, we are architecting a simple RDD data import-export in H2O. This brings continuity to their in-memory interactive experience. And support for Spark MLI using our native Scala API – Shalala.
Big Data users can now use SHARK to extract and fuse datasets and H2O for better predictions.

H2O_Spark-800x559
Here’s a typical pipeline in this (using the unix pipe analogy)

 hdfs | Spark | SHARK/SQL | RDD | h2o.readRDD() | h2o.deepLearning() | h2o.predict() | h2o.persist(RDD or HDFS)

Calling h2o.deepLearning() from within Scala interface alongside Spark (via Shalala) will make the workflow even more seamless for end users.

Leave a Reply

Fallback Featured Image
Machine Learning in the Age of AutoML

“Just as electricity transformed almost everything 100 years ago, today I actually have a hard

May 15, 2020 - by Parul Pandey
Are All Your AI and ML Models Wrong?

We are living in unprecedented times. Our society and economy are experiencing shocks beyond anything

May 5, 2020 - by James Orton
Lessons of COVID-19 and Moving Forward: Key Takeaways

This week, we hosted our second virtual panel focused on how AI can empower healthcare

May 1, 2020 - by Ingrid Burton
Running H2O cluster on a Kubernetes cluster

H2O is an open-source, in-memory platform for distributed, scalable machine learning. A perfect match for

April 14, 2020 - by Pavel Pscheidl
H2O Release 3.30 (Zahradnik)

There’s a new major release of H2O, and it’s packed with new features and fixes! Among

April 7, 2020 - by Michal Kurka
Brief Perspective on Key Terms and Ideas in Responsible AI

INTRODUCTION As fields like explainable AI and ethical AI have continued to develop in academia and

April 2, 2020 - by Benjamin Cox

Join the AI Revolution

Subscribe, read the documentation, download or contact us.

Subscribe to the Newsletter

Start Your 21-Day Free Trial Today

Get It Now
Desktop img