May 14th, 2019

H2O.ai Automatic Machine Learning on Red Hat OpenShift Container Platform Delivers Data Science Ease and Flexibility at Scale

Category: Cloud, Data Science, Demos, Driverless AI

Last week at Red Hat Summit in Boston, Sri Ambati, CEO and Founder, demonstrated how to use our award-winning automatic machine learning platform, H2O Driverless AI, on Red Hat OpenShift Container Platform.  You can watch the replay here.

What we showed not only helps data scientists achieve results, it also enables them to scale their machine learning efforts and easily deploy their models for enterprises. Sri talked about the five easy steps to do automatic machine learning with Driverless AI on Red Hat OpenShift.

  1. Drag and Drop Data: Bring in your data, whether it’s on prem or on cloud, you just drag and drop data from various different sources. H2O Driverless AI has over 10 different connectors including Amazon S3, Google Big Query, Snowflake, HDFS, and more.
  2. Automatic Visualization: Next we can run the data through automatic visualization, which does a number of statistical checks on your data to find some most of the most interesting patterns and helps you fix your data quality as well.
  3. Automatic Machine Learning: After that you run through our automatic machine learning platform, an engine which does automatic feature engineering, modeling and ensembling for you. If you are an expert data scientist, you can select your own algorithms or tweak the parameters, otherwise, it does it all for you.
  4. Automatic Scoring Pipelines: Driverless AI automatically generates a scoring pipeline, that can easily be deployed as a Java or Python object.
  5. Interpret the results: Using Driverless AI machine learning interpretability, it is easy to understand and see the reason codes for why the model that was selected or prediction was made. It also automatically creates a document to walk through the entire workflow and record every step of the process.

Now let’s see how all of these come together on OpenShift. Using the H2O.ai OpenShift templates, we can train a model with one, and with the other deploy it.

The demonstration was focused on determining sentiment analysis which we did on a tweet at the end of the presentation.  We started with a sentiment data set that we had pre-loaded.

We can visualize the data to get a snapshot of how the data set looks.  Auto Visualization, part of Driverless AI, allows us to look at the data in many ways from determining data outliers, to correlations, heat maps and more.

We want to find out whether the sentiment is positive or negative, and the only thing we need to do at this point is to optimize for the accuracy, time and interpretability, the “knobs and dials” that tell us how complex we want the model to be, how much time to train, and how interpretable the model will be.  Driverless AI automatically detected that this is an NLP problem and applied one of our NLP recipes to the problem.

We saw about 93% accuracy, which is pretty good for a problem that was trained on a really small dataset with only 12,000 rows.

You can look at different charts like a ROC curve, lift and gains and also look at the summary quickly. You can see we created about 352 features out of the one feature that was given originally. We only gave the text column to start. Based on the text column, we created word embeddings and those were the ones that were used by the model.

Once the models were built, you can download the scoring pipeline or you can interpret this model. We’ll show how to deploy it.

Using the OpenShift console, and we now have a template to deploy this Mojo (our format for deploying models) that is optimized for low latency.

We had a small web app running and typed in the following to see the sentiment based on the model:

“The Red Hat keynote was beautiful & awesome”

Which resulted in positive sentiment.  This was a fairly easy demonstration with Driverless AI on OpenShift, but it showed how easy and seamless it is to start an instance, build and interpret a model, and finally publish that model to score live data.

It was great to participate at the Red Hat Summit. We enjoyed demonstrating how H2O.ai and Red Hat are working together to democratize AI for the enterprise.

About the Author

vinod iyengar
Vinod Iyengar

Vinod is VP of marketing and technical alliances at H2O.ai. He leads all product marketing efforts, new product development and integrations with partners. Vinod comes with over 10 years of Marketing & Data Science experience in multiple startups. He was the founding employee for his previous startup, Activehours (Earnin), where he helped build the product and bootstrap the user acquisition with growth hacking. He has worked to grow the user base for his companies from almost nothing to millions of customers. He’s built models to score leads, reduce churn, increase conversion, prevent fraud and many more use cases. He brings a strong analytical side and a metrics driven approach to marketing. When he is not busy hacking, Vinod loves painting and reading. He is a huge foodie and will eat anything that doesn’t crawl, swim or move.

Leave a Reply

A Maker Data Scientist’s journey: from Sudoku to Kaggle

If you put enough smart people together in one space, good things happen. Erik Hersman One

August 16, 2019 - by Parul Pandey
Interns Gonna Make

When I first walked through the front doors of the H2O.ai Mountain View office, I

August 16, 2019 - by Megan Chan
My Summer Internship at H2O.ai

I can’t believe the summer is nearing an end.  What an amazing experience I have

August 10, 2019 - by Priya Jain
Detecting Sarcasm is difficult, but AI may have an answer

Recently, while shopping for a laptop bag, I stumbled upon a pretty amusing customer review: “This

August 5, 2019 - by Parul Pandey
Mitigating Bias in AI/ML Models with Disparate Impact Analysis

Everyone understands that the biggest plus of using AI/ML models is a better automation of

August 2, 2019 - by Karthik Guruswamy
H2O Release 3.26 (Yau)

There’s a new major release of H2O, and it’s packed with new features and fixes!

July 30, 2019 - by Michal Kurka

Join the AI Revolution

Subscribe, read the documentation, download or contact us.

Subscribe to the Newsletter

Start Your 21-Day Free Trial Today

Get It Now
Desktop img