5 ways data science can help you work smarter, not harder

Posted Leave a commentPosted in data, Data Science, sentiment analysis, trends

Today, the internet bleeds into almost every facet of everyday life — it empowers our productivity, enhances our entertainment, and enables our communication. As it does these things, of course, it generates a vast quantity of data: rich, complex, wide-reaching data on everything from the money we spend to the websites we visit. Data science […]

A Guide To Machine Learning Foundations of Task Management Software

Posted Leave a commentPosted in Machine Learning, SmartData Collective Exclusive, Software, task management, task management software

Task management applications are changing the way we manage teams. Here are some of the primary benefits of these task management applications: Task management tools improve team productivity Task management tools make sure that teams operate more efficiently Task management tools minimize worker stress Task management tools help with monitoring trends Machine learning is playing […]

How Big Data Makes Us Rethink The Design Of Magnetic Devices

Posted Leave a commentPosted in Big Data, design, magnetic device, magnetic devices, magnetics, SmartData Collective Exclusive

One of the most fascinating things about big data is its ability to optimize the design of products that have pre-dated digital technology by centuries. One of the most interesting examples is with magnets. Magnets are ancient devices. They are so old, that the history of their discovery has been lost in legend. It is […]

Hyperparameter Tuning with MLflow, Apache Spark MLlib and Hyperopt

Posted Leave a commentPosted in Apache Spark, AutoML, Data Science, Databricks Runtime 5.4 ML, Deep Learning, Ecosystem, Engineering Blog, Hyperopt, Hyperparameter Tuning, Machine Learning, MLflow, MLlib

Hyperparameter tuning is a common technique to optimize machine learning models based on hyperparameters, or configurations that are not learned during model training.  Tuning these configurations can dramatically improve model performance. However, hyperparameter tuning can be computationally expensive, slow, and unintuitive even for experts. Databricks Runtime 5.4 and 5.4 ML (Azure | AWS) introduce new […]

Announcing the MLflow 1.0 Release

Posted Leave a commentPosted in Announcements, Company Blog, Data Science, Ecosystem, Engineering Blog, Lifecycle, Machine Learning, MLflow, Model Management, Product

MLflow is an open source platform to help manage the complete machine learning lifecycle. With MLflow, data scientists can track and share experiments locally (on a laptop) or remotely (in the cloud), package and share models across frameworks, and deploy models virtually anywhere. Today we are excited to announce the release of MLflow 1.0. Since […]

Protecting the Securities Market with Predictive Fraud Detection

Posted Leave a commentPosted in Company Blog, Customers, Financial Fraud, Financial Markets, Financial Services, FINRA, Fraud, Fraud Detection, Securities Market

FINRA (Financial Industry Regulatory Authority), a regulatory body charged with protecting the U.S. securities market, spoke at the Spark + AI Summit on how they use Databricks Unified Analytics Platform to analyze up to a 100 billion stock market events per day for fraud detection and prevention. This is a summary of their story from Summit. […]

Customers and Banks Priorities Collide as AI Jolts Financial Industry

Posted Leave a commentPosted in AI, Artificial Intelligence, Fintech, Machine Learning, SmartData Collective Exclusive

In a previous article I shared some of the challenges, benefits and trends of Big Data in the telecommunications industry. This time, I will focus on the financial services industry based on previous IBM studies in this industry and some personal experiences. An Industry Without Physical Products Big Data’s promise of value in the financial […]

Why the Government of Tomorrow is Also a Data Organisation

Posted Leave a commentPosted in Artificial Intelligence, Big Data

Nowadays, every organisation is a data organisation. This not only applies to commercial organisations, but also to governments. Governments at every level – local, regional, national and supranational – should take a different approach to organise their activities. However, becoming a data organisation is not an easy feat. It requires governments to rethink all their […]

Big Data Leads To An Impressive Array Of Chatbots In Customer Service

Posted Leave a commentPosted in Artificial Intelligence, Big Data, chatbot, chatbots, customer service, data driven customer service, SmartData Collective Exclusive

Big data is changing the direction of customer service. Machine learning tools have led to the development of chatbots. They rely on big data to better serve customers. Namee Jani wrote a fascinating article on chatbots and data analytics last year. She said they are the next big thing in business optimization in her article […]