Description
Spark and Python for Big Data with PySpark is the name of a training course on Udemy that teaches how to use Spark and Python in big cities. In this course, you will also learn about PySpark and Spark Streaming, and you will learn well about machine learning topics. One of the most valuable skills in technology is the ability to analyze large data sets, and this course aims to introduce you to one of the best technologies in the field, Apache Spark.
Apache Spark is an open source framework and distributed system used by many large companies such as Google, Facebook, Amazon and NASA to solve big data problems. This framework can provide up to 100 times better performance than Hadoop MapReduce and fully meet your needs. In this course, you will become fully familiar with Spark and learn how to use Python in macro data.
Courses taught in this course:
- Use Spark and Python to analyze big data
- Use the Spark 2.0 DataFrame syntax
- Work with consulting projects
- Use Spark with Random Forests for classification
- Use a reinforcing gradient tree
- Use MLlib to build machine learning models
Spark and Python Specifications for Big Data with PySpark:
- English
- Duration: 10 hours and 35 minutes
- Number of lessons: 66
- Education level: average
- Instructor: Jose Portilla
- File format: mp4
course topics
66 lectures 10:35:05
Introduction to the course
4 lectures 30:12
Setting up Python with Spark
2 lectures 06:11
Setting up a local VirtualBox
3 lectures 31:09
Setting up PySpark on AWS EC2
4 lectures 38:58
Set up Databricks
1 lecture 11:41
Setting up an AWS EMR cluster
1 lecture 17:16
A crash course in Python
7 lectures 58:50
Spark DataFrame Basics
7 lectures 01:04:52
Spark DataFrame Project Exercise
2 lectures 20:06
Introduction to Machine Learning with MLlib
2 lectures at 19:25
Linear regression
6 lectures 01:00:03
Logistic regression
5 lectures 01:00:02
Decision trees and random forests
5 lectures 52:26
K-stands for clustering
5 lectures 41:20
Collaborative filtering of recommendation systems
2 lectures at 18:39
Natural language processing
4 lectures 46:26
Spark Streaming with Python
5 lectures 57:18
Bonus
1 lecture 00:10
Course prerequisites
- General programming skills in any language (Python preferred)
- 20 GB of free space on your local computer (or alternatively a strong Internet connection for AWS)
Pictures
Sample movie
installation manual
After extracting, watch with your favorite player.
english subtitles
Quality: 720p
Download link
File password(s): free download software
size
1.26 GB