Customers Share Their Machine Learning Success Stories in the Data Mastery Tour

Posted Leave a commentPosted in Company Blog, Events

The most important factor to successful machine learning is having the right data at scale, but organizations struggle how to get the right datasets combined into the right format for their projects. At Databricks, we’ve seen customers achieve success by bringing data and ML together, and we’ve partnered with Snowflake to share their stories across […]

Introducing Delta Time Travel for Large Scale Data Lakes

Posted Leave a commentPosted in Announcements, Company Blog, Databricks Delta, Delta

Data versioning for reproducing experiments, rolling back, and auditing data We are thrilled to introduce time travel capabilities in Databricks Delta, the next-gen unified analytics engine built on top of Apache Spark, for all of our users. With this new feature, Delta automatically versions the big data that you store in your data lake, and […]

Accelerating Machine Learning on Databricks: On-Demand Webinar and FAQ Now Available!

Posted Leave a commentPosted in Company Blog, Data Science, Databricks Runtime, Deep Learning, Ecosystem, Engineering Blog, Horovod, HorovodRunner, Keras, Machine Learning, MLflow, Platform, Product, TensorFlow

Try this notebook in Databricks On January 15th, we hosted a live webinar—Accelerating Machine Learning on Databricks—with Adam Conway, VP of Product Management, Machine Learning, at Databricks and Hossein Falaki, Software Development Engineer and Data Scientist at Databricks. In this webinar, we covered some of the latest innovations brought into the Databricks Unified Analytics Platform […]

New videos from Databricks Academy: Introduction to Machine Learning Series and the Apache Spark™ Cost-Based Optimizer

Posted Leave a commentPosted in Company Blog, Education

Databricks’ commitment to education is at the center of the work we do. Through Instructor-Led Training, Certification, and Self-Paced Training, Databricks Academy provides strong pathways for users to learn Apache Spark and Databricks, and to push their knowledge to the next level. In that spirit, we are pleased to present some great new free content. […]

5 Reasons to Become an Apache Spark Expert

Posted Leave a commentPosted in Apache Spark, Company Blog, Education, Engineering Blog, Spark, Spark + AI Summit, training

Apache Spark™ has fast become the most popular unified analytics engine for big data and machine learning. It was originally developed at UC Berkeley in 2009 by the team who later founded Databricks. Since its release, Apache Spark has seen rapid adoption. Today’s most cutting-edge companies such as Apple, Netflix, Facebook, and Uber have deployed Spark […]

Introducing Databricks Runtime 5.1 for Machine Learning

Posted Leave a commentPosted in Announcements, Apache Spark, Company Blog, Databricks Runtime 5.1 ML, Deep Learning, Engineering Blog, Machine Learning, PyTorch, TensorFlow

Last week, we released Databricks Runtime 5.1 Beta for Machine Learning. As part of our commitment to provide developers the latest deep learning frameworks, this release includes the best of these libraries. In particular, our PyTorch addition makes it simple for a developer to simply import the appropriate Python torch modules and start coding, without […]

A Guide to AI, Machine Learning, and Deep Learning Talks at Spark + AI 2019

Posted Leave a commentPosted in AI, Apache Spark, Company Blog, Deep Learning, Events, Machine Learning, Spark + AI Summit

To a good degree, this back-of-the-envelope flowchart, by Karen Hao of MIT Technology Review, charts to elucidate what constitutes the use of AI in the grand scheme of things. source: While many conferences may not have a flowchart to select sessions to identify what’s AI, the sessions, though, do speak to technical aspects that […]

CIO Survey: Top 3 Challenges Adopting AI and How to Overcome Them

Posted Leave a commentPosted in AI, Announcements, CIO, Company Blog, data, Events, ML, Product, Survey, Unified analytics

  We recently hosted the webinar — CIO Survey: Enterprise Challenges to AI and How to Overcome Them — featuring Jen Garofalo, Research Director at IDG, the parent company to, and Pat McDonough, VP of Customer Success at Databricks. This webinar covered key findings from a recent survey of 200 executives on the […]

Introducing Databricks Runtime 5.0 for Machine Learning

Posted Leave a commentPosted in Announcements, Company Blog, Databricks Runtime 5.0 ML, Deep Learning, Ecosystem, Engineering Blog, Machine Learning, Platform

Six months ago we introduced the Databricks Runtime for Machine Learning with the goal of making machine learning performant and easy on the Databricks Unified Analytics Platform. The Databricks Runtime for ML comes pre-packaged with many ML frameworks and enables distributed training and inference. Today we are excited to release the second iteration including Conda […]