by BDW Editor on March 9, 2018 Today big data, machine learning and location data are playing huge roles in business, finance, politics and almost every sector. There is some concern playing itself out regarding location data and other technology features. While it is important to understand the risks involved in big data and […]
by BDW Editor on March 8, 2018 This is a guest post by Danish Wadhwa. The IT sector is awash with data. This means more data is available to us than we can use. Data science is the field related to the development of insights from large sets of unstructured data. Its practical significance lies in […]
So you have decided to learn Python, but you don’t have prior programming experience. So you are confused on where to start, and how much Python to learn. These are some of the common questions a beginner has while getting started with Python(for data centric application). “How long does it take to learn Python” “How much […]
In recent years, machine learning has become ubiquitous in industry and production environments. Both academic and industry institutions had previously focused on training and producing models, but the focus has shifted to productionizing the trained models. Now we hear more and more machine learning practitioners really trying to find the right model deployment options. In […]
This is a community blog from Anirudh Ramanathan and Palak Bhatia, software engineer and product manager respectively at Google, working in the Kubernetes team. They are part of the group of companies that contributed to native Kubernetes support for the Apache Spark 2.3. This post is cross-posted on blog.kubernetes.io Kubernetes and Big Data The open […]
Today we are happy to announce the availability of Apache Spark 2.3.0 on Databricks as part of its Databricks Runtime 4.0. We want to thank the Apache Spark community for all their valuable contributions to Spark 2.3 release. Continuing with the objectives to make Spark faster, easier, and smarter, Spark 2.3 marks a major milestone […]
This is a guest post by Preetish Panda. Twitter has always been a rich source of social data that allows us to perform analysis on wide range of topics. Considering more than 6,000 tweets are posted per second and the open API gives real-time access, twitter data mining has compelling use cases in trend analysis, […]
by BDW Editor on February 15, 2018 Guest post by Finnegan Pierson. One of the biggest news in the world of Big Data vs. Small Data today is the plan of China to establish a sort of social credit score where the government can rank its citizens based on their behavior, social actions and decision made […]
It’s hard to believe that we are already three weeks into 2018. If you’re still struggling to get valuable insights from your data, now is the perfect time to try something new! We recently announced Azure Databricks, a fast, easy and collaborative Apache® Spark™ based analytics platform optimized for Azure. With Azure Databricks, you can help your […]
Every business now recognizes the power of Big Data Analytics in developing deep actionable insights to enjoy business advantages. However, unlike before when businesses were required to deal with gigabytes of data, the present scenario requires to store and process huge piles of data that is measured in petabytes and terabytes as it is produced […]