A Guide to Financial Services Talks at Spark + AI Summit 2019

Posted Leave a commentPosted in Announcements, Apache Spark, Company Blog, Events, Financial Services, Spark + AI Summit, Summit

The financial services industry is transforming rapidly. Customers today demand more personalized experiences, better returns on their investments and improved protection against fraud. As a result,  every bank, insurance company and institutional investor is turning towards big data and AI to meet these demands and outmaneuver the competition. Spark + AI Summit is the premier […]

Announcing Databricks Runtime 5.3 – The Databricks Blog

Posted Leave a commentPosted in Announcements, Company Blog, Databricks Runtime, Runtime 5.3

We are proud to announce the release of Databricks Runtime 5.3, which includes several new features and improvements, including: GA of Delta Time Travel Public Preview of MySQL table replication to Delta Optimized DBFS FUSE folder for deep learning workloads (Azure-only) Databricks Delta Time Travel (Generally Available) Delta Time Travel has graduated to general availability. […]

Databricks Runtime 5.3 ML Now Generally Available

Posted Leave a commentPosted in Announcements, Company Blog, Data Science, Databricks Runtime 5.3 ML, Deep Learning, Ecosystem, Engineering Blog, Machine Learning, Product

We are excited to announce the general availability (GA) of Databricks Runtime for Machine Learning, as part of the release of Databricks Runtime 5.3 ML. Built on top of Databricks Runtime, Databricks Runtime ML is the optimized runtime for developing ML/DL applications in Databricks. It offers native integration with popular ML/DL frameworks, such as scikit-learn, […]

A Guide to Keynotes at Spark + AI Summit 2019

Posted Leave a commentPosted in Announcements, Company Blog, Events, Keynotes, Spark + AI Summit, Spark Summit, Summit

Over the past several years, Spark + AI Summit has become the premier event for data scientists, engineers, and Apache SparkTM enthusiasts to come together and share how they’re driving innovation with the latest data and machine learning technologies. Last year’s Summit set a new record, with more than 4000 attendees and over 100 talks […]

Improving Data Management and Analytics in the Federal Government

Posted Leave a commentPosted in Announcements, Apache Spark, Company Blog, Engineering Blog, Federal Government, government, Platform, Product, Public Sector, Unified analytics, Warehouse

From Static Data Warehouse to Scalable Insights and AI On-Demand Government agencies today are dealing with a wider variety of data at a much larger scale. From satellite imagery to sensor data to citizen records, petabytes of semi- and unstructured data is collected each day. Unfortunately, traditional data warehouses are failing to provide government agencies […]

Data Engineering Light: Expanding Choice for Production Workloads

Posted Leave a commentPosted in Announcements, Company Blog, Data Engineering, Data Engineering Light, Unified Analytics Platform

Adding a Lower Tier, Lower Price Option Since its inception a guiding principle for Databricks has been the unification of data science and engineering helping to bring together silos and raising the level of collaboration and productivity among the analytics professionals. And our customers have been reaping the benefits of this to solve some of […]

Efficient Upserts into Data Lakes with Databricks Delta

Posted Leave a commentPosted in Announcements, Change Data Capture, Company Blog, Databricks Delta, Delta, Merge, Product

Simplify building big data pipelines for change data capture (CDC) and GDPR use cases. Databricks Delta, the next-generation unified analytics engine built on top of Apache Spark™, now supports the MERGE command, which allows you to efficiently upsert and delete records in your data lakes. MERGE dramatically simplifies how a number of common data pipelines […]

Tangible Impacts of AI on the Business

Posted Leave a commentPosted in Announcements, Company Blog, Customers

With 2019 in full swing, the excitement for data and AI driven innovation continues.  Over the past few years, we’ve seen leading innovators – like Riot Games, Regeneron and Shell – become early adopters of the latest machine learning and AI technologies, building and deploying AI applications into production. But with great promise comes great challenges, as […]

Managed MLflow on Databricks now in public preview

Posted Leave a commentPosted in Announcements, Company Blog, Data Science, Ecosystem, Engineering Blog, Machine Learning, Managed MLflow, MLflow, Platform, Product

Try this tutorial in Databricks Building production machine learning applications is challenging because there is no standard way to record experiments, ensure reproducible runs, and manage and deploy models. To address these challenges, last June we introduced MLflow, an open source platform to manage the ML lifecycle that works with any machine learning library and […]