Explanation
Azure Databricks & Spark for Data Engineers (PySpark / SQL) I look forward to helping you learn one of the most important cloud data engineering tools, Azure Databricks! In this course you are introduced to the implementation of a data engineering solution using Azure Databricks and Spark core in a real world project for analyzing and reporting Formula1 car racing data. This is like another Udemy course on Azure Databricks. Once you have completed the course including all assignments, we strongly believe that you will be able to start a real world data engineering project on your own as well as become familiar with Azure Databricks. I have also included tutorials on Data Lake Storage Gen2, Azure Data Factory as well as PowerBI. The primary focus of the course is Azure Databricks and Spark core, but it also covers relevant concepts and connections to the other technologies mentioned. Please note that the course does not cover other aspects of Spark such as Spark streaming and Spark ML.
Also the course is taught using PySpark as well as Spark SQL; It does not cover Scala or Java. The course follows a logical progression of implementing a real-world project with technical concepts explained and a Databricks notebook built at the same time. Although this course is not specifically designed to teach you the skills needed to pass the Azure Data Engineer Associate Certification DP203 exam, it can greatly help you acquire most of the skills necessary for the exam. I value your time as much as mine. So, I’ve designed this course to be fast-paced. Also, the course is taught in plain English without jargon. I start the course with the basics, by the end of the course you will be well versed in the technology used.
What will you learn?
- You will learn how to build a real-world data project using Azure Databricks and Spark Core. This course is taught using real world data from Formula1 car racing
- You will gain professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF).
- You will learn how to create notebooks, dashboards, clusters, cluster pools and jobs in Azure Databricks.
- You will learn how to import and transform data using PySpark in Azure Databricks
- You will learn how to transform and analyze data using Spark SQL in Azure Databricks
- You will learn about Data Lake architecture and lake architecture. Also, you will learn how to implement a Lakehouse construction solution using Delta Lake.
- You will learn how to create Azure Data Factory pipelines to execute Databricks notebooks
- You will learn how to create Azure Data Factory triggers to schedule pipelines as well as monitor them.
- You will get the skills needed around Azure Databricks and Data Factory to pass the Azure Data Engineer Associate DP203 certification exam, but the primary purpose of the course is not to teach you how to pass the exams.
- You will learn how to connect Azure Databricks to PowerBI to create reports
Who is this course for?
- University students looking for a career in Data Engineering
- IT developers working in other fields trying to move into data engineering
- Database Engineers/Database Developers currently working in on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Information Technologies
- Data architects looking to gain an understanding of Azure engineering data storage
Specialization in Azure Databricks & Spark for Data Engineers (PySpark / SQL)
- Publisher: Udemy
- Teacher: Ramesh Retnasamy
- Language : English
- Level : All Levels
- Number of Courses: 164
- Duration : 17 hours and 20 minutes
Features of Azure Databricks & Spark for Data Engineers (PySpark / SQL)
Requirements
- All code and step-by-step instructions are provided, but the skills below will benefit you most on your journey.
- Basic Python programming experience will be required
- Basic knowledge of SQL will be required
- Basic knowledge of the cloud would be an advantage, but not required
- An Azure subscription will be required, If you don’t have one we will create a free account in the course
Pictures
Sample Clip
Installation Guide
Extract files and watch your favorite player
Subtitle : English
Quality: 720p
Changes:
Version 2023/3 does not present any course changes compared to 2023/2.
Download Links
Password file: free download software
file size
3.74 GB