University Web Developer Programs Must Prep Students For Big Data Era

Posted Leave a commentPosted in Big Data, Education, News, SmartData Collective Exclusive, university, web developer programs, web developers

Big data is playing a monumental role in economic development in 2019. It is being used in every industry from healthcare delivery to insurance modeling to political science. According to economic analysts, the market size for big data is currently estimated to be $203 billion. Unfortunately, there is a growing shortage of data scientists. As […]

Big Data Should be a Priority in Every College Curriculum

Posted Leave a commentPosted in Analytics, Big Data, big data technology, data analytics, data analytics education, Education, SmartData Collective Exclusive, stem education, stem fields

As technology progresses, more companies are producing huge amounts of data as a by-product of their day-to-day operations. While I’m not one to claim that “most businesses are practically drowning” in a sea of data, it’s fair to say that companies wanting a long future had better start taking Big Data seriously. To put this […]

Managing the Complete Machine Learning Lifecycle: On-Demand Webinar now available!

Posted Leave a commentPosted in Company Blog, Data Science, Ecosystem, Education, Machine Learning, Managed MLflow, MLflow, Model Management, Open Source, Product, Webinar

On March 7th, our team hosted a live webinar—Managing the Complete Machine Learning Lifecycle—with Andy Konwinski, Co-Founder and VP of Product at Databricks. In this webinar, we walked you through how MLflow, an open source framework for the complete Machine Learning lifecycle, helps solve for challenges around experiment tracking, reproducible projects and model deployment. Specifically, […]

Azure Databricks – Bring Your Own VNET

Posted Leave a commentPosted in Azure Databricks, Azure Security, Company Blog, Custom VNET, Education, Security

Azure Databricks Unified Analytics Platform is the result of a joint product/engineering effort between Databricks and Microsoft. It’s available as a managed first-party service on Azure Public Cloud. Along with one-click setup (manual/automated), managed clusters (including Delta), and collaborative workspaces, the platform has native integration with other Azure first-party services, such as Azure Blob Storage, […]

A Guide to Data Science, Python, and Advanced Analytics Talks at Spark + AI Summit 2019

Posted Leave a commentPosted in Advanced Analytics, Company Blog, Data Science, Education, python, Spark + AI Summit

With a tsunami of data, scale of computing resources available, and rapid development of easy-to-learn open source Machine Learning frameworks, data science and machine learning concepts are much easier to learn and implement today than they were a decade ago. As a result, across all industries, practitioners are using cutting-edge ML algorithms to solve tough […]

Unbelievable Ways Artificial Intelligence Is Revolutionizing Education

Posted Leave a commentPosted in AI, Artificial Intelligence, Education, education tech, education technology, educators, SmartData Collective Exclusive, students, teachers

Due to technological progress, artificial intelligence is influencing education. How can it help both teachers and students? Even today, many countries not only educate kids about artificial intelligence (AI), but also apply it to improve the quality of education. Providing data training is becoming more essential. Young people need to be computer literate to develop […]

A Guide to Developer, Deep Dive, and Continuous Streaming Applications Talks at Spark + AI Summit

Posted Leave a commentPosted in Apache Spark, Company Blog, Databricks, Databricks Delta, Education, Events, Spark + AI Summit, Spark SQL, Spark Training, Structured Streaming

In January 2013 when Stephen O’Grady, an analyst at RedMonk, published “The New Kingmakers: How Developers Conquered the World,” the book’s central argument (then and still now) universally resonated with an emerging open-source community. He convincingly charts developers’ movement “out of the shadows and into the light as new influencers on society’s [technical landscape].” Using […]

Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning

Posted Leave a commentPosted in Education, Machine Learning, Product

Try this notebook in Databricks You might be using Bayesian techniques in your data science without knowing it! And if you’re not, then it could enhance the power of your analysis. This blog follows the introduction to Bayesian reasoning on Data Science Central, and will demonstrate how these ideas can improve a real-world use case: […]

New videos from Databricks Academy: Introduction to Machine Learning Series and the Apache Spark™ Cost-Based Optimizer

Posted Leave a commentPosted in Company Blog, Education

Databricks’ commitment to education is at the center of the work we do. Through Instructor-Led Training, Certification, and Self-Paced Training, Databricks Academy provides strong pathways for users to learn Apache Spark and Databricks, and to push their knowledge to the next level. In that spirit, we are pleased to present some great new free content. […]