You've requested...
Big Data verstehen: Hadoop-Analytics für Unternehmen
Download this next:
Focus: Open source
Open source used to be an alternative to commercial off –the-shelf software. Today, the largest commercial software providers are big supporters of open source technologies. Enterprises are finding their software stacks increasingly rely on open source components, and developers have access to extensive open source repositories, which they can draw on to help them produce code more efficiently or to work around a particular technical problem they may have. Some enterprises are also contributing code back, supporting open source development, while at the same time, enabling a wide pool of open source developers to improve the code. Some companies are also starting to use open source to foster interest and develop a community to bolster their digitally-enabled product strategies.
These are also closely related to: "Big Data verstehen: Hadoop-Analytics für Unternehmen"
-
Spark Muscles Into Big Data Processing
It comes as no great surprise that the Apache Spark architecture has been horning in on the batch processing domain once controlled by Hadoop's MapReduce. But that's only part of the story. With data processing, streaming and machine learning capabilities on its résumé, the open source engine is learning to get along entirely without Hadoop in certain applications. In fact, one industry analyst cautiously sees a day when Spark could declare total independence, potentially bust up Hadoop cluster dominance and link separately with other Apache technologies.
In this three-part handbook, senior news writer Jack Vaughan examines the distinct advantages the Apache Spark architecture has over MapReduce. Also highlighted is how Spark's ability to process and analyze streaming data is helping detect fraudulent activities at a major banking and credit-card company. Next, Spark 2.0's upcoming upgrades to analytics speed, machine learning libraries, SQL support and stream processing are detailed. To close, Vaughan and senior news writer Ed Burns look at combining Spark and NoSQL databases in operational analytics applications, which could help broaden the use of both technologies.
-
Advanced analytics meld with machine learning to press more value from big data
There has long been a distinction, within the field of business intelligence and analytics, between the former and the latter. BI is traditionally about reporting what’s happened, against a data warehouse or other database; while analytics is about statistical analysis to predict the probability of things happening.
Advanced analytics is also now melding with the machine learning sub-set of artificial intelligence, with the rise, and now consolidation of big data environments, like data lakes, in organisations. Often, when people say “AI” they really mean machine learning that then feeds into the analytical work done by data scientists, using a plethora of data preparation and visualisation tools, as well as statistical analysis tools from SAS, the R programming language, Python, and so on.
As often, Silicon Valley is the place where some of the most pioneering technologies are being developed. On a trip to the Valley in March 2018, Computer Weekly found a slew of California-based startup and early-stage data analytics companies promising CIOs better ways to get value from their investments in databases and analytics. The lead article in this e-guide provides an account of what this group has to offer.
SAS co-founder and CEO Jim Goodnight is one of the pioneers of the field of statistical software analytics, and one who insists on the distinction between mere BI and analytics. In this interview he says the value of the current vogue for artificial intelligence lies in massively parallel computing, as well as cheaper storage.
Also from SAS, Peter Pugh-Jones, head of technology for the firm in the UK & Ireland, reflects, in a guest blog-post, on how the analytics industry is evolving and what organisations need in a data-driven economy.
One aspect of this evolution is the infusing of artificial intelligence into business applications. And so, customer analytics applications developers are seeking to add layers of machine intelligence to improve sellers’ interactions with buyers online.
One instance of this is the self-styled “Uber of Wi-Fi”, iPass, which is using Databricks’ Unified Analytics Platform and machine learning to monitor its worldwide network and help its customers get a better experience.
It is not only data scientists who need to do data discovery that goes beyond simple BI reporting. The data visualisation tools developed over the last fifteen or so years by the likes of Qlik and Tableau continue to gain ground among corporate users. One recent example is the United Nations, which has decided to use Tableau as a global standard.
Finally, we discover how, down under, Australia is becoming a hot zone for data analytics development and use.
