Course: BigData on Amazon Web Services (AWS) BigData processing on AWS with Hadoop, Spark, RedShift and more explained

BigData on Amazon Web Services (AWS)

BigData processing on AWS with Hadoop, Spark, RedShift and more explained


Big Data on AWS introduces you to cloud-based big data solutions such as Amazon Elastic MapReduce (EMR), Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform. In this course, we show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We also teach you how to create big data environments, work with Amazon DynamoDB, Amazon Redshift, and Amazon Kinesis, and leverage best practices to design big data environments for security and cost-effectiveness.

Intended Audience

This course is intended for individuals responsible for designing and implementing big data solutions, namely Solutions Architects and SysOps Administrators, Data Scientists and Data Analysts interested in learning about big data solutions on AWS.

Prerequisites

We recommend that attendees of this course have the following prerequisites:

  • Basic familiarity with big data technologies, including Apache Hadoop, MapReduce, HDFS, and SQL/NoSQL querying
  • Students should complete the Big Data Technology Fundamentals web-based training or have equivalent experience
  • Working knowledge of core AWS services and public cloud implementation
  • Students should complete the AWS Technical Essentials course or have equivalent experience
  • Basic understanding of data warehousing, relational database systems, and database design

Modules

  Module 1 - Starting with BigData on AWS
  • Overview of Big Data
  • Ingestion, Transfer, and Compression
  • Storage Solutions
  • Storing and Querying Data on DynamoDB
  • Big Data Processing and Amazon Kinesis
  • Introduction to Apache Hadoop and Amazon EMR
  • Using Amazon Elastic MapReduce
  Module 2 - Computing at scale with Hadoop, EMR, Hue, Pig and Spark
  • Hadoop Programming Frameworks
  • Processing Server Logs with Hive on Amazon EMR
  • Processing Chemistry Data Using Hadoop Streaming on Amazon EMR
  • Streamlining Your Amazon EMR Experience with Hue
  • Running Pig Scripts in Hue on Amazon EMR
  • Spark on Amazon EMR
  • Interactively Creating and Querying Tables with Spark and Spark SQL on Amazon EMR
  • Managing Amazon EMR Costs
  • Securing your Amazon EMR Deployments
  Module 3 - Data warehousing
  • Data Warehouses and Columnar Datastores
  • Amazon Redshift and Big Data
  • Optimizing Your Amazon Redshift Environment
  • BigData Design Patterns
  • Visualizing and Orchestrating BigData

Related Courses


Introduction to BigData and Cloud Technologies

Introduction to BigData and Cloud Technologies

BigData and Cloud explained with real-world examples in this intensive 1-day workshop
BigData on Amazon Web Services (AWS)

BigData on Amazon Web Services (AWS)

BigData processing on AWS with Hadoop, Spark, RedShift and more explained
Elasticsearch for developers

Elasticsearch for developers

Master how to use Elasticsearch for everything from text search to log analysis and anomaly detection in this hands-on 2 day course