Spark Muscles Into Big Data Processing

It comes as no great surprise that the Apache Spark architecture has been horning in on the batch processing domain once controlled by Hadoop's MapReduce. But that's only part of the story. With data processing, streaming and machine learning capabilities on its résumé, the open source engine is learning to get along entirely without Hadoop in certain applications. In fact, one industry analyst cautiously sees a day when Spark could declare total independence, potentially bust up Hadoop cluster dominance and link separately with other Apache technologies.

In this three-part handbook, senior news writer Jack Vaughan examines the distinct advantages the Apache Spark architecture has over MapReduce. Also highlighted is how Spark's ability to process and analyze streaming data is helping detect fraudulent activities at a major banking and credit-card company. Next, Spark 2.0's upcoming upgrades to analytics speed, machine learning libraries, SQL support and stream processing are detailed. To close, Vaughan and senior news writer Ed Burns look at combining Spark and NoSQL databases in operational analytics applications, which could help broaden the use of both technologies.

Vendor:: TechTarget Data Management
Posted:: Feb 8, 2021
Published:: Mar 29, 2016
Format:: PDF
Type:: eBook

Already a Bitpipe member? Log in here

Download this eBook!

Corporate Email Address:
You forgot to provide an Email Address.

This email address doesn’t appear to be valid.

Please provide a Corporate Email Address.

This email address is already registered. Please log in.
First Name:
You forgot to provide your first name.
Last Name:
You forgot to provide your last name.
Company Name:
You forgot to provide a company name.
Job Title:
You forgot to provide a job title.
Seniority:
You forgot to select your seniority.
Job Function:
You forgot to select your job function.
# of employees:
You did not select the number of employees at your company.
Industry:
You did not select which industry you are in.
Sub-Industry:
You did not select which industry you are in.
Address 1:
You did not provide a full local address.
Address 2:
City/Town:
You did not provide a full local address.
Country:
You did not select the country you are from.
State/Province:

You did not provide a full local address.
Zip/Postal Code:
You did not provide a full local address.
Phone:
You forgot to provide a phone number.

This phone number format is not recognized. Please check the country and number.
- I agree to TechTarget’s Terms of Use, Privacy Policy, and the transfer of my information to the United States for processing to provide me with relevant information as described in our Privacy Policy.
Please check the box if you want to proceed.
- I agree to my information being processed by TechTarget and its Partners to contact me via phone, email, or other means regarding information relevant to my professional interests. I may unsubscribe at any time.
Please check the box if you want to proceed.