Udemy – Master Big Data – Apache Spark/Hadoop/Sqoop/Hive/Flume 2020-8

Description

Master Big Data - Apache Spark / Hadoop / Sqoop / Hive / Flume, is the name of the comprehensive big data training course and its famous tools and frameworks such as Apache Spark, Hadoop, Sqoop, Flume and Apache Hive. In this course, you will first get acquainted with the Hadoop distributed filesystem and its application, and learn the most common commands. Then you will learn how to import data using Sqoop, the life cycle of its commands, how to transfer data from Mysql to HDFS and Hive, and how to use different file formats, compression and queries. In addition, you will learn to output data using Sqoop (from HDFS and Hive to Mysql).

In the following, you will get acquainted with the Apache Flume architecture and its use to receive data from Twitter and netcat and save in HDFS along with the use of Flume Interceptors and Flume Consolidation. The next section is dedicated to Apache Hive, in which external and managed tables work with various files such as Parquet and Avro, compressions, analysis in Hive, string and historical Hive functions, partitioning and data stacking. take . Finally with the Apache Spark framework, an overview of the cluster, actions and transformations with examples, flexible distributed datasets or RDD, Spark datasheets with examples and working with formats And you will get acquainted with various compressions, Spark SQL and integration with Cassandra.

What do you learn?

Hadoop Distributed System File and Sqoop Command Lifecycle

Sqoop commands for transferring data from Mysql to HDFS and Hive

Work with various file formats, compressions and queries

Use incremental mode to transfer data using Sqoop

Get data from sources with the help of Flume

And

This training is suitable for people who

Anyone who wants to get acquainted with big data in full detail

Profile of Big Data - Apache Spark / Hadoop / Sqoop / Hive / Flume 2020-10

Publisher: Udemy

Instructor: Navdeep Kaur

English language

Level of training: from basic to advanced

Number of lessons: 86 lessons in 10 sections

Duration: 8h 22m

Prerequisites

No

Installation

After Extract, watch with your favorite Player.

English subtitle

Quality: 720p