Big data is a combination of structured, semi structured and unstructured data collected by organizations that can be mined for information and used in machine learning projects, predictive modelling and other advanced analytics applications. Systems that process and store big data have become a common component of data management architectures in organizations, combined with tools that support big data analytics uses. Big data is often characterized by the three V’s:the large volume of data in many environments;the wide variety of data types frequently stored in big data systems; andthe velocity at which much of the data is generated, collected and processed. Big data is a great quantity of diverse information that arrives in increasing volumes and with ever-higher velocity. Big data can be structured (often numeric, easily formatted and stored) or unstructured (more free-form, less quantifiable).Nearly every department in a company can utilize findings from big data analysis but handling its clutter and noise can pose problems. Big data can be collected from publicly shared comments on social networks and websites, voluntarily gathered from personal electronics and apps, through questionnaires, product purchases, and electronic check-ins. Big data is most often stored in computer databases and is analysed using software specifically designed to handle large, complex data sets. Topics Covered in these course are: Big Data Enabling TechnologiesHadoop Stack for Big DataHadoop Distributed File System (HDFS)Hadoop MapReduceMapReduce ExamplesSparkParallel Programming with SparkSpark Built-in LibrariesData Placement StrategiesData Placement StrategiesDesign of ZookeeperCQL (Cassandra Query Language)Design of HBaseSpark Streaming and Sliding Window AnalyticsKafkaBig Data Machine LearningMachine Learning Algorithm K-means using Map Reduce for Big Data AnalyticsParallel K-means using Map Reduce on Big Data Cluster AnalysisDecision Trees for Big Data AnalyticsBig Data Predictive AnalyticsPageRank Algorithm in Big DataSpark GraphX & Graph AnalyticsCase Studies of big companies and how they operate.
