March 25th, 2014

In-memory Big Data: Spark + H2O

Category: Uncategorized
H2O_Spark

Big Data has moved in-memory. Customers using SQL in their Join & Munging efforts via SHARK and Apache Spark need to use Regressions and Deep Learning. To make their experiences great & seamlessly weave SQL workflows with Data Science and Machine Learning, we are architecting a simple RDD data import-export in H2O. This brings continuity to their in-memory interactive experience. And support for Spark MLI using our native Scala API – Shalala.
Big Data users can now use SHARK to extract and fuse datasets and H2O for better predictions.

H2O_Spark-800x559
Here’s a typical pipeline in this (using the unix pipe analogy)

 hdfs | Spark | SHARK/SQL | RDD | h2o.readRDD() | h2o.deepLearning() | h2o.predict() | h2o.persist(RDD or HDFS)

Calling h2o.deepLearning() from within Scala interface alongside Spark (via Shalala) will make the workflow even more seamless for end users.

Leave a Reply

AI/ML Model Scoring – What Good Looks Like in Production

One of the main reasons why we build AI/Machine Learning models is for it to

March 10, 2019 - by Karthik Guruswamy
Fallback Featured Image
Machine Learning with H2O – the Benefits of VMware

This blog was originally posted by Justin Murray of VMware and can be accessed here.   This

March 6, 2019 - by Vinod Iyengar
Fallback Featured Image
How to explain a model with H2O Driverless AI

The ability to explain and trust the outcome of an AI-driven business decision is now

February 26, 2019 - by Vinod Iyengar
Boosting your ROI with AutoML & Automatic Feature Engineering

If your business has started using AI/ML tools or just started to think about it,

February 25, 2019 - by Karthik Guruswamy
Fallback Featured Image
What is Your AI Thinking? Part 3

In the past two posts we’ve learned a little about interpretable machine learning in general. In

February 19, 2019 - by Patrick Hall
8 Tips to Make AI Happen Without Getting Fired

“AI is the fastest growing workload on the planet,” Mike Gualtieri of Forrester Research. Last week,

February 15, 2019 - by Ingrid Burton

Join the AI Revolution

Subscribe, read the documentation, download or contact us.

Subscribe to the Newsletter

Start Your 21-Day Free Trial Today

Get It Now
Desktop img