How To Solve The Data Management Challenge Of Self-Driving Cars

Posted Leave a commentPosted in Big Data, cars, data, data analytics, Data Management, Data Visualization, Lyft, self-driving cars, SmartData Collective Exclusive, Uber

Self-driving cars and trucks once seemed like a staple of science fiction which could never morph into a reality here in the real world. Nevertheless, the past few years have given rise to a number of impressive innovations in the field of autonomous vehicles that have turned self-driving cars from a funny idea into a […]

New Big Data Visualization Platforms Help You Optimize Decision Making

Posted Leave a commentPosted in Big Data, big data visualization, Data Visualization, Decision Making, SmartData Collective Exclusive

We have addressed a number of ways big data is changing industries across the economy. We have focused more heavily on some factors than others, but there are some universal changes that big data has created. Big data visualization is a more effective way to utilize this data for optimal performance. What is the Role […]

Data Science Professional Certificate – Cognitive Class

Posted Leave a commentPosted in AI, Coursera, Data Science, Data Visualization, Databases, Machine Learning, Partnerships, Professional Certificate, python, Relational databases

Today IBM and Coursera launched an online Data Science Professional Certificate to address the shortage of skills in data-related professions. This certificate is designed for those interested in a career in Data Science or AI, and equips people to become job-ready through hands-on, practical learning. IBM Data Science Professional Certificate In this post we look […]

Loan Risk Analysis with XGBoost and Databricks Runtime for Machine Learning

Posted Leave a commentPosted in Apache Spark, Company Blog, data pipeline, Data Visualization, Ecosystem, Education, Engineering Blog, financial, Machine Learning, MLlib, Platform, Product, XGBoost

Try this notebook series in Databricks For companies that make money off of interest on loans held by their customer, it’s always about increasing the bottom line. Being able to assess the risk of loan applications can save a lender the cost of holding too many risky assets. It is the data scientist’s job to […]

Simplify Advertising Analytics Click Prediction with Databricks Unified Analytics Platform

Posted Leave a commentPosted in Advertising Analytics, Apache Spark, Data Visualization, Ecosystem, Education, ETL, Machine Learning, Platform, Product, Spark SQL, Streaming

Try this notebook series in Databricks Advertising teams want to analyze their immense stores and varieties of data requiring a scalable, extensible, and elastic platform.  Advanced analytics, including but not limited to classification, clustering, recognition, prediction, and recommendations allow these organizations to gain deeper insights from their data and drive business outcomes. As data of […]

Analyze Games from European Soccer Leagues with Apache Spark and Databricks

Posted Leave a commentPosted in ad hoc analysis, Apache Spark, Data Engineering, Data Visualization, Education, Engineering Blog, ETL, Machine Learning, Platform, Product, Unified Analytics Platform

Try this notebook series in Databricks Introduction The global sports market is huge, comprised of players, teams, leagues, fan clubs, sponsors, etc., and all of these entities interact in myriad ways generating an enormous amount of data. Some of that data is used internally to help make better decisions, and there are a number of […]

Here’s Why Python Is The Top Programming Language For Data

Posted Leave a commentPosted in Artificial Intelligence, Big Data, big data language, Blockchain, Business Intelligence, Data Management, Data Mining, Data Quality, Data Science, Data Visualization, Hadoop, IT, Machine Learning, python, Unstructured Data

Packt Publishing, publisher of software learning resources, has revealed the results of its 2018 Skill Up survey in a new report—including the top programming language for data. From what programming languages, frameworks, and libraries are most used, to job satisfaction and what it’s like to work in the software industry today, the report offers a […]

Understanding the Different Forms of Data Virtualization

Posted Leave a commentPosted in Big Data, cloud data services, data blending, Data Management, data security, data services module, data virtualization, Data Virtualization Platforms, Data Visualization, IT, Privacy, Security, SmartData Collective Exclusive

Data virtualization provides enterprises with numerous benefits. From greater data security and integrity to enhanced collaboration with internal and external partners, the proper application of data virtualization can turn a struggling enterprise into a profitable and successful one. In practice, data virtualization takes on many different forms. While some are more useful than others, they […]

Women in Big Data and Apache Spark: Bay Area Apache Spark Meetup Summary

Posted Leave a commentPosted in Apache Spark, Company Blog, Data Visualization, Databricks, DevOps, Events, WiBD

In collaboration with the local chapter of Women in Big Data Meetup and our continuing effort by Databricks diversity team to have more women in the big data space as speakers to share their subject matter expertise, we hosted our second meetup with a diverse and highly-accomplished women in their respective technical fields as speakers […]