April 12th, 2018

Sparkling Water 2.3.0 is now available!

Category: Sparkling Water
Fallback Featured Image

Hi Makers!
We are happy to announce that Sparkling Water now fully supports Spark 2.3 and is available from our download page.
If you are using an older version of Spark, that’s no problem. Even though we suggest upgrading to the latest version possible, we keep the Sparkling Water releases for Spark 2.2 and 2.1 up-to-date with the latest version if we are not limited by Spark.
The last release of Sparkling Water contained several important bug fixes. The 3 major bug fixes are:

  • Handle nulls properly in H2OMojoModel. In the previous versions, running predictions on the H2OMojoModel with null values would fail. We now handle the null values as missing values and it no longer fails.

  • We marked the Spark dependencies in our maven packages as provided. This means that we assume that Spark dependencies are always provided by the run-time, which should always be true. This ensures a cleaner and more transparent Sparkling Water environment.

  • In PySparkling, the method as_h2o_frame didn’t issue an alert when we passed in a wrong input type. This method accepts only Spark DataFrames and RDDs, however, some users tried to pass different types and this method ended silently. Now we fail if the user passes a wrong data type to this method.

It is also important to mention that Spark 2.3 removed support for Scala 2.10. We’ve done the same in the release for Spark 2.3. Scala 2.10 is still supported in the older Spark versions.
The latest Sparkling Water versions also integrated with H2O 3.18.0.5 which brings several important fixes. The full change log for H2O 3.18.0.5 is available here and the full Sparkling Water change log can be viewed here.
Thank you!
Kuba
Senior Software Engineer, Sparkling Water Team

Leave a Reply

A Maker Data Scientist’s journey: from Sudoku to Kaggle

If you put enough smart people together in one space, good things happen. Erik Hersman One

August 16, 2019 - by Parul Pandey
Interns Gonna Make

When I first walked through the front doors of the H2O.ai Mountain View office, I

August 16, 2019 - by Megan Chan
My Summer Internship at H2O.ai

I can’t believe the summer is nearing an end.  What an amazing experience I have

August 10, 2019 - by Priya Jain
Detecting Sarcasm is difficult, but AI may have an answer

Recently, while shopping for a laptop bag, I stumbled upon a pretty amusing customer review: “This

August 5, 2019 - by Parul Pandey
Mitigating Bias in AI/ML Models with Disparate Impact Analysis

Everyone understands that the biggest plus of using AI/ML models is a better automation of

August 2, 2019 - by Karthik Guruswamy
H2O Release 3.26 (Yau)

There’s a new major release of H2O, and it’s packed with new features and fixes!

July 30, 2019 - by Michal Kurka

Join the AI Revolution

Subscribe, read the documentation, download or contact us.

Subscribe to the Newsletter

Start Your 21-Day Free Trial Today

Get It Now
Desktop img