50 Hrs Big Data Mastery: PySpark, AWS, Scala & Data Scraping
Loại khoá học: Data Science
Comprehensive Big Data Mastery: Scala, Spark, PySpark, AWS, Data Scraping & Data Mining with Python, Mining and MongoDB
Mô tả
Welcome to the comprehensive Big Data and Data Science bundle, where you'll embark on an educational journey covering a wide range of essential skills and technologies. This course equips you with expertise in Scala, PySpark, AWS, Data Scraping, Data Mining, and MongoDB. Whether you're an absolute beginner or possess some programming knowledge, this course provides in-depth coverage of these critical topics.
I. Scala:
Scala may not be the most popular coding language, but it's undeniably one of the most sought-after skills for data scientists and data engineers. This course is meticulously designed to make Scala simple to grasp and implement. You'll engage with quizzes and mini-projects to reinforce your learning, making your Scala experience seamless.
Key Highlights:
High Demand Skill: Scala is in high demand in the industry, and this course ensures you acquire essential skills
Practical Learning: Quizzes and mini-projects serve as building blocks for a comprehensive understanding of Scala
Hands-on Experience: Gain practical experience by working on a Scala Spark project
Versatility: Scala is a powerful language suitable for a wide range of applications, from web development to machine learning
Learning Materials:
Comprehensive Scala tutorials
Scala quizzes and assessments
Hands-on Scala Spark project
Scala code examples and exercises
II. PySpark and AWS:
Python and Apache Spark are at the forefront of Big Data analytics, and PySpark bridges the gap between them. In this section, you'll start with the basics and progress to advanced data analysis. You'll work with PySpark for data analysis, explore Spark RDDs, Dataframes, and Spark SQL queries, and delve into Spark and Hadoop ecosystems. Additionally, you'll discover how to leverage AWS cloud services with Spark.
Key Highlights:
Python and Spark Integration: Master the art of using Python and Spark together for effective Big Data analysis
Comprehensive Coverage: Explore Spark RDDs, Dataframes, Spark SQL queries, and seamlessly integrate with AWS
Hands-on Practice: Apply your knowledge through practical exercises and projects
Learning Materials:
In-depth PySpark and AWS tutorials
PySpark quizzes and assessments
AWS integration guides and examples
PySpark code samples and hands-on projects
III. Data Scraping and Data Mining:
Data scraping involves extracting data from websites and APIs, making it a valuable skill for data professionals. This section is tailored for beginners, starting with foundational concepts and gradually delving into advanced techniques through practical implementations. Hands-on projects are a pivotal part of this segment, allowing you to learn through experimentation and real-world applications.
Key Highlights:
Beginner-Friendly: Perfect for individuals new to data scraping and mining
Practical Implementation: Gain deep insights through hands-on projects and real-world examples
Lucrative Career: Data scraping offers rewarding career prospects and competitive salaries
Learning Materials:
Comprehensive Data Scraping and Mining tutorials
Hands-on data extraction projects
Data scraping and mining quizzes and assessments
Data scraping code samples and automation scripts
IV. MongoDB:
This section introduces you to MongoDB, a popular NoSQL database. You'll learn the fundamentals of MongoDB, including Create, Read, Update, and Delete operations. Dive deep into MongoDB query and project operators, enhancing your understanding of NoSQL databases. Two comprehensive projects will provide you with practical experience using MongoDB in Django and implementing an ETL (Extract, Transform, Load) pipeline with PySpark.
Key Highlights:
NoSQL Proficiency: Develop expertise in MongoDB, a highly sought-after NoSQL database
Hands-on Projects: Apply your knowledge to real-world scenarios and gain practical skills
Versatile Skills: MongoDB is invaluable for data management and analytics
Learning Materials:
MongoDB fundamentals and advanced tutorials
Hands-on MongoDB projects, including Django integration and ETL pipeline development
MongoDB quizzes and assessments
MongoDB code examples and best practices
Course Benefits:
Upon completing this comprehensive course successfully, you will be proficient in implementing projects from scratch that require expertise in Data Scraping, Data Mining, Scala, PySpark, AWS, and MongoDB. You'll be adept at connecting theoretical concepts to real-world problem-solving, efficiently extracting data from websites, and be well-prepared for various data-related roles.
Learning Materials:
Video lectures and tutorials.
Quizzes, assessments, and solutions.
Hands-on projects with step-by-step guidance.
Code examples and templates.
Reference materials and best practices.
Enroll now to embark on your journey toward mastering Big Data and Data Science comprehensively!
Who Should Enroll:
Ideal for beginners or those looking to apply theoretical knowledge in practical scenarios
Aspiring data scientists and machine learning experts
Individuals aiming to excel in the realm of Big Data and Data Science
What You'll Learn:
Proficiency in implementing projects requiring expertise in Data Scraping, Data Mining, Scala, PySpark, AWS, and MongoDB
Efficient data extraction from websites
Skills applicable to various data-related roles
Why This Course:
High demand for Scala skills in the industry
Comprehensive coverage of PySpark, AWS, Data Scraping, Data Mining, and MongoDB
Hands-on experience through projects and practical exercises
Versatile skills for a wide range of applications
List of Keywords:
Big Data
Data Science
Scala
PySpark
AWS
Data Scraping
Data Mining
MongoDB
NoSQL Database
Data Extraction
Data Analysis
Bạn sẽ học được gì
Yêu cầu
Nội dung khoá học
4 sections
Introduction: Why Data Scraping
02:42
Introduction: Applications of Data Scraping
07:09
Introduction: Introduction of Instructor
00:40
Introduction: Introduction to Course, Scraping, Tools
01:39
Introduction: Projects Overview
03:42
Introduction: Request for Your Honest Review
01:18
Requests: Introduction to Python Requests
03:57
Requests: Hand on with Requests
08:28
Requests: Extracting Quotes Manually
10:05
Requests: Quiz(Extracting Authors)
00:40
Requests: Solution(Extracting Authors)
06:11
Requests: Pagination
09:46
Requests: Quiz(Extracting Author and Quotes)
00:58
Requests: Solution 01(Extracting Author and Quotes)
06:27
Requests: Solution 02(Extracting Author and Quotes)
05:52
Requests: Ajax Requests
06:36
Requests: Ajax Requests for Cricinfo
08:25
Requests: Ajax Requests Paggination
03:53
Requests: Quiz(Extracting Top Stats from Cricinfo)
01:22
Requests: Solution 01(Extracting Top Stats from Cricinfo)
07:16
Requests: Solution 02(Extracting Top Stats from Cricinfo)
09:17
Beautiful Soap 4(BS4): Introduction to BS4
03:02
Beautiful Soap 4(BS4): Quiz(Difference between Requests and BS4)
00:25
Beautiful Soap 4(BS4): Solution(Difference between Requests and BS4)
01:04
Beautiful Soap 4(BS4): Hands on with BS4
05:54
Beautiful Soap 4(BS4): Extracting Data from Tree
08:50
Beautiful Soap 4(BS4): Extracting Quotes from the Website
07:33
Beautiful Soap 4(BS4): Quiz(Extracting Author Names)
00:38
Beautiful Soap 4(BS4): Solution(Extracting Author Names)
05:28
Beautiful Soap 4(BS4): Attributes of Tags in BS4
09:10
Beautiful Soap 4(BS4): Multi Valued Attributes of Tags in BS4
03:55
Beautiful Soap 4(BS4): Scraping Movie Names from IMDB
19:31
Beautiful Soap 4(BS4): Quiz(Getting the Rattings,Year,Name of the Movie)
00:55
Beautiful Soap 4(BS4): Solution 01(Getting the Rattings,Year,Name of the Movie)
07:00
Beautiful Soap 4(BS4): Solution 02(Getting the Rattings,Year,Name of the Movie)
07:08
Beautiful Soap 4(BS4): Scraping Time,Genre and Releasing Date from IMDB 01
06:56
Beautiful Soap 4(BS4): Scraping Time,Genre and Releasing Date from IMDB 02
17:21
Beautiful Soap 4(BS4): Combining Two Requests Data for IMDB
06:50
Beautiful Soap 4(BS4): Movies Recommender System (CreatingMovie Url)
06:26
Beautiful Soap 4(BS4): Movies Recommender System (Creating Director Url)
06:10
Beautiful Soap 4(BS4): Movies Recommender System using BS4(Getting Top 4 Movies)
08:55
Beautiful Soap 4(BS4): Movies Recommender System using BS4(Merge All Requests Together)
04:02
CSS Selectors: Introduction to CSS Selectors
02:49
CSS Selectors: CSS Selectors Handson(Tags)
05:17
CSS Selectors: Quiz(Tags)
01:08
CSS Selectors: Solution(Tags)
02:15
CSS Selectors: CSS Selectors Handson(Decendants, Id, Class)
07:04
CSS Selectors: Quiz(Descendants)
00:49
CSS Selectors: Solution(Descendants)
01:50
CSS Selectors: Quiz(ID)
00:44
CSS Selectors: Solution(ID)
01:46
CSS Selectors: Solution(Class)
01:00
CSS Selectors: Solution(Class)
03:16
CSS Selectors: CSS Selectors Handson(Nested Tags, ID Tags, Class Tags)
04:32
CSS Selectors: Quiz(Class with Tag)
00:40
CSS Selectors: Solution(Class with Tag)
02:26
CSS Selectors: CSS Selectors Handson(Coma Seprator, Universial Selectors
06:31
CSS Selectors: Quiz(Combining Two Selectors)
00:46
CSS Selectors: Solution(Combining Two Selectors)
02:48
CSS Selectors: CSS Selectors Handson(Sibling Notations and Direct Child)
07:24
CSS Selectors: Quiz(Adjacent Sibling)
00:45
CSS Selectors: Solution(Adjacent Sibling)
02:38
CSS Selectors: Quiz(General Sibling)
00:57
CSS Selectors: Solution(General Sibling)
02:59
CSS Selectors: CSS Selectors Handson(Child Selectors)
07:19
CSS Selectors: Quiz(First Child)
00:40
CSS Selectors: Solution(First Child)
03:49
CSS Selectors: Quiz(Only Child)
00:40
CSS Selectors: Solution(Only Child)
02:58
CSS Selectors: Quiz(Last Child)
00:44
CSS Selectors: Solution(Last Child)
03:10
CSS Selectors: CSS Selectors Handson (Nigations, Attributes)
06:36
CSS Selectors: Quiz(Negation)
00:41
CSS Selectors: Solution(Negation)
02:06
CSS Selectors: CSS Selectors Handson (Attributes, Attributes Values)
03:51
CSS Selectors: Quiz(Attributes Values)
00:39
CSS Selectors: Solution(Attributes Values)
03:26
CSS Selectors: CSS Selectors Handson (Attributes Wild Cards Values)
06:25
CSS Selectors: Quiz(Attributes Wild Card)
00:50
CSS Selectors: Solution(Attributes Wild Card)
02:49
Scrapy: Introduction to Scrapy
04:10
Scrapy: Comparison of Scrapy and Requests
03:40
Scrapy: Scrapy at a Glance Documentation
08:31
Scrapy: Getting Started with Scrapy
11:04
Scrapy: Running Documentation Spider 1
03:25
Scrapy: Running Documentation Spider 2
12:00
Scrapy: Writing Spider from the Scratch
07:23
Scrapy: Understanding the Response(url, Status)
07:09
Scrapy: Understanding the Response(headers)
04:12
Scrapy: Understanding the Response(values in headers)
06:51
Scrapy: Understanding the Response(body)
06:04
Scrapy: Understanding the Response(request)
04:41
Scrapy: Understanding the Response(meta)
08:29
Scrapy: Understanding the Response(flags, certificate, ip_address, copy)
05:16
Scrapy: Understanding the Response(replace, urljoin, follow, follow_all)
08:07
Scrapy: Response CSS and Scrapy Shell
09:26
Scrapy: Extracting quotes
05:47
Scrapy: Understanding Nested selectors
10:02
Scrapy: Extracting the Author and Quotes
10:05
Scrapy: Checking for Next Page
07:36
Scrapy: Checking for Next Page in Spider
05:36
Scrapy: Checking for Next Page URL
08:16
Scrapy: Scraping Quotes from Next Pages
11:07
Scrapy: Exporting Extracted Data
03:26
Scrapy: Quiz(Get The Tags)
00:58
Scrapy: Solution(Get The Tags)
07:30
Scrapy: Next Website
01:57
Scrapy: CSS Selectors for Movie Names and URLs
12:09
Scrapy: Combined CSS Selectors for Movie Names and URLs
03:22
Scrapy: Sent request to the film info page
04:35
Scrapy: Merge Data from Two Callbacks
08:44
Scrapy: Extracting Movie Duration and Genres
06:59
Scrapy: Exporting the Extracted Data
05:34
Scrapy: Quiz(Extracting the Year)
01:18
Scrapy: Solution(Extracting the Year)
10:08
Scrapy: Getting Director Name and Url
08:21
Scrapy: Getting Top Four Movies of Directors
09:28
Scrapy: Extracting Data Anomaly (dont_filter Flag)
09:50
Scrapy Project: Hugoboss webiste for scraping
02:30
Scrapy Project: Understanding Site Structure
07:11
Scrapy Project: Writing CSS Selectors for Listings
07:43
Scrapy Project: Listings in Scrapy Shell
04:20
Scrapy Project: Sending Request to Listings Urls
07:23
Scrapy Project: Extracting Products Url from the Listings
11:02
Scrapy Project: Sending Requests to Products of the Listings
05:02
Scrapy Project: Writing CSS for getting the Product Info
16:55
Scrapy Project: Getting the bigger Images of the Product
07:54
Scrapy Project: Checking Next Page Url
13:57
Scrapy Project: Adding Pagination to Spider and Running it
09:40
Scrapy Project: Output of the Spider
04:36
Selenium: Introduction To Selenium
02:12
Selenium: Getting Started with Selenium
03:36
Selenium: Configuring the Webdriver
03:40
Selenium: Extracting Quotes
10:16
Selenium: Extracting Quotes and Author Names
07:17
Selenium: Quiz(Extracting Quotes)
00:41
Selenium: Solution(Extracting Quotes)
07:22
Selenium: Clicking on Button
05:01
Selenium: Paggination and Extracting Data
08:06
Selenium: Exception Handling for Unavailable Element
05:41
Selenium: Navigating the Website for Login
09:37
Selenium: Quiz(Log in and Extract Quote)
00:43
Selenium: Solution(Log in and Extract Quote)
07:03
Project Selenium: Overview of Project
01:28
Project Selenium: Closing the Cookie Button
03:26
Project Selenium: Setting the Language for Translation
05:50
Project Selenium: Sending the Text for Transaltion
03:46
Project Selenium: Downaloading the Translation
03:55
Project Selenium: Reading Data from File for Translation
03:44
Project Selenium: THANK YOU Bonus Video
01:20
Link for the Course's Materials and Codes
00:09
Link for the Course's Materials and Codes
00:09
Introduction: Why Scala
04:56
Introduction: Scala Applications
03:27
Introduction: About the Instructor
00:50
Introduction: Introduction to Course
03:30
Introduction: Projects Overview
02:55
Introduction: Request for Your Honest Review
01:18
Overview: What is Scala
02:02
Overview: Scala Setup (Local Machine)
09:46
Overview: Scala Setup (Online)
05:05
Overview: Variables in Scala
09:18
Overview: Arithamatic Operations on Variables-1
05:55
Overview: Arithamatic Operations on Variables-2
09:39
Overview: Quiz (Arithmatic Operations)
00:55
Overview: Solution (Arithmatic Operations)
08:17
Overview: Quiz (Strings)
00:42
Overview: Solution (Strings)
07:06
Overview: Type Casting
11:23
Overview: Taking input from User
05:47
Overview: Quiz (User Input and Type Casting)
00:29
Overview: Solution (User Input and Type Casting)
03:50
Flow Control: Overview of Control Statements
03:49
Flow Control: If else statements
06:29
Flow Control: Conditions in If
06:10
Flow Control: Quiz (if statement)
01:27
Flow Control: Solution (if statement)
04:17
Flow Control: Nested if else
07:37
Flow Control: Quiz (nested if else)
01:06
Flow Control: Solution (nested if else)
05:15
Flow Control: Logical operators
10:27
Flow Control: Quiz (Logical operators)
00:43
Flow Control: Solution (Logical operators)
06:27
Flow Control: If else if
07:01
Flow Control: Quiz (if else if)
01:00
Flow Control: Solution(if else if)
07:54
Flow Control: Overview of Loops
01:52
Flow Control: Overview of While Loop
05:34
Flow Control: While Loop
08:17
Flow Control: Quiz (while loop)
01:18
Flow Control: Solution 1 (while loop)
12:00
Flow Control: Solution 2 (while loop)
04:31
Flow Control: Do While Loop
05:23
Flow Control: For Loop
09:21
Flow Control: Quiz (For Loop)
01:13
Flow Control: Solution (For Loop)
06:53
Flow Control: Quiz(For Loop)
01:20
Flow Control: Solution(For Loop)
12:26
Flow Control: Break
07:30
Flow Control: Break Fix
03:45
Flow Control: Project Overview
04:19
Flow Control: Project Solution Design
05:58
Flow Control: Project Solution Code 1
08:07
Flow Control: Project Solution Code 2
05:11
Flow Control: Project Solution Code 3
08:18
Flow Control: Project Solution Code 4
07:34
Functions: Overview of Functions
05:57
Functions: Writing addition function
08:10
Functions: Quiz (Basic Function)
00:52
Functions: Solution (Basic Function)
05:18
Functions: Functions common issues
05:24
Functions: Named Arguments
05:11
Functions: Quiz (String Concatination Function)
00:46
Functions: Solution (String Concatination Function)
03:08
Functions: Quiz (Dividing Code in Functions)
01:12
Functions: Solution (Dividing Code in Functions)
09:55
Functions: Default Arguments
07:08
Functions: Quiz(Default Arguments)
01:44
Functions: Solution(Default Arguments)
10:00
Functions: Anonymous Functions
05:15
Functions: Quiz(Anonymous Functions)
01:11
Functions: Solution(Anonymous Functions)
04:55
Functions: Scopes
10:44
Functions: Project Overview
04:04
Functions: Checking Credentials
07:12
Functions: Prompting the menu
07:50
Functions: Baisc Functions
08:12
Functions: Breaking code in more functions
12:28
Functions: Final Run
05:11
Classes: Introduction to Classes
01:59
Classes: Creating Class
06:46
Classes: Class Constructor
04:29
Classes: Functions and Classes
13:24
Classes: Project Overview
02:32
Classes: Basic Strucuture
06:20
Classes: Final Run
03:30
Data Structures: Introduction of Data Structures
02:46
Data Structures: Lists introduction
04:59
Data Structures: Lists Create and Delete Elements
06:08
Data Structures: Lists Take
03:38
Data Structures: ListBuffer Introduction
04:38
Data Structures: Add data in ListBuffer
03:43
Data Structures: Remove data from ListBuffer
03:13
Data Structures: Take data from ListBuffer
02:32
Data Structures: Project Overview
03:35
Data Structures: Project Architecture Discussion
04:52
Data Structures: Project Architecture Implementation
10:17
Data Structures: User Input for Objects
05:34
Data Structures: Implementing the control flow
06:11
Data Structures: Creating Required Functions inside Class
07:25
Data Structures: Overview of Maps
02:53
Data Structures: Creating Maps
04:00
Data Structures: Check Key in Map
03:15
Data Structures: Update Value in Map
03:04
Data Structures: Add and Remove items from Maps
05:04
Data Structures: Iterating on Maps
03:12
Data Structures: Project Overview
01:57
Data Structures: Project Architecture
05:54
Data Structures: Project Structure Code
03:26
Data Structures: Using Maps for word count
07:05
Data Structures: Final Run
07:46
Data Structures: Sets Overview
05:01
Data Structures: Add and Remove Item from the Set
03:23
Data Structures: Set Operations
03:41
Data Structures: Overview of Stack
01:59
Data Structures: Push and Pop in Stack
03:58
Data Structures: Stack Attributes
05:23
Data Structures: Project Overview
02:41
Data Structures: Project Architecture
10:47
Data Structures: Extra Closing Bracket Use Case
10:26
Data Structures: Extra Starting Bracket Use Case
08:29
Project: Project Introduction
00:56
Project: Why Spark
05:05
Project: Hadoop EcoSystem
05:22
Project: Spark Architecture
02:29
Project: Spark EcoSystem
03:07
Project: DataBricks Account
03:16
Project: Setting up DataBricks Cluster
04:14
Project: Spark Local Setup
04:23
Project: Spark Hadoop Setup
04:02
Project: Spark RDDs
01:55
Project: Spark RDDs (textFile, collect)
15:36
Project: Spark Local Run
02:37
Project: Understanding Map
06:06
Project: Understanding Flat Map
09:54
Project: Understanding Reduce By Key
05:25
Project: Word Count Example
14:52
Project: Spark DFs
03:13
Project: Spark DF Read Data
06:24
Project: Spark Print Schema, Select
03:30
Project: Spark GroupBy
04:22
Project: Spark DF Write
11:27
Project: Creating S3 bucket
04:12
Project: Creating Database in RDS
04:15
Project: Performing ETL
19:38
Links for the Course's Materials and Codes
00:09
Introduction: Why Big Data
03:23
Introduction: Applications of PySpark
03:12
Introduction: Introduction to Instructor
00:46
Introduction: Introduction to Course
01:49
Introduction: Projects Overview
03:25
Introduction: Request for Your Honest Review
01:18
Introduction to Hadoop, Spark EcoSystems and Architectures: Why Spark
03:53
Introduction to Hadoop, Spark EcoSystems and Architectures: Hadoop EcoSystem
04:49
Introduction to Hadoop, Spark EcoSystems and Architectures: Spark Architecture and EcoSystem
08:08
Introduction to Hadoop, Spark EcoSystems and Architectures: DataBricks SignUp
03:41
Introduction to Hadoop, Spark EcoSystems and Architectures: Create DataBricks Notebook
04:52
Introduction to Hadoop, Spark EcoSystems and Architectures: Download Spark and Dependencies
03:16
Introduction to Hadoop, Spark EcoSystems and Architectures: Java Setup on Window
04:16
Introduction to Hadoop, Spark EcoSystems and Architectures: Python Setup on Window
01:31
Introduction to Hadoop, Spark EcoSystems and Architectures: Spark Setup on Window
02:58
Introduction to Hadoop, Spark EcoSystems and Architectures: Hadoop Setup on Window
02:40
Introduction to Hadoop, Spark EcoSystems and Architectures: Runing Spark on Window
02:49
Introduction to Hadoop, Spark EcoSystems and Architectures: Java Download on MAC
01:52
Introduction to Hadoop, Spark EcoSystems and Architectures: Installing JDK on MAC
01:01
Introduction to Hadoop, Spark EcoSystems and Architectures: Setting Java Home on MAC
03:02
Introduction to Hadoop, Spark EcoSystems and Architectures: Java check on MAC
01:18
Introduction to Hadoop, Spark EcoSystems and Architectures: Installing Python on MAC
01:13
Introduction to Hadoop, Spark EcoSystems and Architectures: Setup Spark on MAC
04:18
Introduction to Hadoop, Spark EcoSystems and Architectures: Which of the following statement is True
1 question
Introduction to Hadoop, Spark EcoSystems and Architectures: Which of the following is not a part of spark ecosystem?
1 question
Spark RDDs: Spark RDDs
08:28
Spark RDDs: Creating Spark RDD
11:00
Spark RDDs: Running Spark Code Locally
10:16
Spark RDDs: RDD stands for:
1 question
Spark RDDs: RDD is created by using:
1 question
Spark RDDs: RDD Map (Lambda)
11:08
Spark RDDs: RDD Map (Simple Function)
09:37
Spark RDDs: Quiz (Map)
01:23
Spark RDDs: Solution 1 (Map)
06:37
Spark RDDs: Solution 2 (Map)
04:01
Spark RDDs: RDD FlatMap
10:13
Spark RDDs: RDD Filter
08:02
Spark RDDs: Quiz (Filter)
01:37
Spark RDDs: Solution (Filter)
16:19
Spark RDDs: RDD Distinct
06:24
Spark RDDs: RDD GroupByKey
17:02
Spark RDDs: RDD ReduceByKey
13:46
Spark RDDs: Quiz (Word Count)
01:02
Spark RDDs: Solution (Word Count)
15:07
Spark RDDs: RDD (Count and CountByValue)
07:11
Spark RDDs: RDD (saveAsTextFile)
15:30
Spark RDDs: RDD (Partition)
18:06
Spark RDDs: Finding Average-1
15:03
Spark RDDs: Finding Average-2
07:09
Spark RDDs: Quiz (Average)
01:29
Spark RDDs: Solution (Average)
11:25
Spark RDDs: Finding Min and Max
10:18
Spark RDDs: Quiz (Min and Max)
00:57
Spark RDDs: Solution (Min and Max)
06:13
Spark RDDs: Project Overview
02:26
Spark RDDs: Total Students
03:40
Spark RDDs: Total Marks by Male and Female Student
06:51
Spark RDDs: Total Passed and Failed Students
04:49
Spark RDDs: Total Enrollments per Course
05:06
Spark RDDs: Total Marks per Course
03:13
Spark RDDs: Average marks per Course
12:45
Spark RDDs: Finding Minimum and Maximum marks
03:50
Spark RDDs: Average Age of Male and Female Students
05:48
Spark DFs: Introduction to Spark DFs
08:08
Spark DFs: Creating Spark DFs
10:34
Spark DFs: DF stands for:
1 question
Spark DFs: DF is created by using:
1 question
Spark DFs: Spark Infer Schema
07:48
Spark DFs: Spark Provide Schema
08:28
Spark DFs: Create DF from Rdd
08:21
Spark DFs: Rectifying the Error
05:17
Spark DFs: Select DF Colums
11:49
Spark DFs: Spark DF withColumn
19:46
Spark DFs: Spark DF withColumnRenamed and Alias
06:12
Spark DFs: Spark DF Filter rows
16:05
Spark DFs: Quiz (select, withColumn, filter)
01:26
Spark DFs: Solution (select, withColumn, filter)
10:19
Spark DFs: Spark DF (Count, Distinct, Duplicate)
10:56
Spark DFs: Quiz (Distinct, Duplicate)
00:45
Spark DFs: Solution (Distinct, Duplicate)
05:19
Spark DFs: Spark DF (sort, orderBy)
06:24
Spark DFs: Quiz (sort, orderBy)
01:55
Spark DFs: Solution (sort, orderBy)
09:14
Spark DFs: Spark DF (Group By)
12:30
Spark DFs: Spark DF (Group By - Multiple Columns and Aggregations)
10:37
Spark DFs: Spark DF (Group By -Visualization)
13:25
Spark DFs: Spark DF (Group By - Filtering)
11:08
Spark DFs: Quiz (Group By)
00:52
Spark DFs: Solution (Group By)
07:50
Spark DFs: Quiz (Word Count)
00:54
Spark DFs: Solution (Word Count)
04:39
Spark DFs: Spark DF (UDFs)
08:34
Spark DFs: Quiz (UDFs)
01:30
Spark DFs: Solution (UDFs)
08:09
Spark DFs: Solution (Cache and Presist)
07:30
Spark DFs: Spark DF (DF to RDD)
07:24
Spark DFs: Spark DF (Spark SQL)
06:16
Spark DFs: Spark DF (Write DF)
10:45
Spark DFs: Project Overview
02:11
Spark DFs: Project (Count and Select)
04:11
Spark DFs: Project (Group By)
04:26
Spark DFs: Project (Group By, Aggregations and Order By)
05:03
Spark DFs: Project (Filtering)
08:20
Spark DFs: Project (UDF and WithColumn)
06:11
Spark DFs: Project (Write)
03:17
Collaborative filtering: Collaborative filtering
02:31
Collaborative filtering: Utility Matrix
04:04
Collaborative filtering: Explicit and Implicit Ratings
04:15
Collaborative filtering: Expected Results
03:09
Collaborative filtering: Dataset
06:38
Collaborative filtering: Joining Dataframes
06:42
Collaborative filtering: Train and Test Data
06:26
Collaborative filtering: ALS model
05:56
Collaborative filtering: Hyperparameter tuning and cross validation
08:24
Collaborative filtering: Best model and evaluate predictions
04:13
Collaborative filtering: Recommendations
10:43
Spark Streaming: Introduction to Spark Streaming
04:46
Spark Streaming: Spark Streaming with RDD
04:25
Spark Streaming: Spark streaming is used to:
1 question
Spark Streaming: Spark Streaming Context
05:09
Spark Streaming: Spark Streaming Reading Data
05:18
Spark Streaming: Spark Streaming Cluster Restart
04:00
Spark Streaming: Spark Streaming RDD Transformations
07:41
Spark Streaming: Which statement is true about SparkContext and StreamingContext
1 question
Spark Streaming: Spark Streaming DF
08:22
Spark Streaming: Spark Streaming Display
05:14
Spark Streaming: Spark Streaming DF Aggregations
05:35
ETL Pipeline: Introduction to ETL
04:58
ETL Pipeline: We can perform ETL using PySpark:
1 question
ETL Pipeline: ETL stands for:
1 question
ETL Pipeline: ETL pipeline Flow
02:20
ETL Pipeline: Data set
02:34
ETL Pipeline: Extracting Data
03:20
ETL Pipeline: Transforming Data
14:15
ETL Pipeline: Loading data (Creating RDS-I)
09:07
ETL Pipeline: Load data (Creating RDS-II)
02:49
ETL Pipeline: RDS Networking
05:30
ETL Pipeline: Downloading Postgres
01:16
ETL Pipeline: Installing Postgres
01:53
ETL Pipeline: Connect to RDS thorugh PgAdmin
02:35
ETL Pipeline: Loading Data
15:40
Project - Change Data Capture / Replication On Going: Introduction to Project
01:48
Project - Change Data Capture / Replication On Going: Project Architecture
15:43
Project - Change Data Capture / Replication On Going: In this project we are going to implement:
1 question
Project - Change Data Capture / Replication On Going: The cloud service DMS will be used to:
1 question
Project - Change Data Capture / Replication On Going: Creating RDS MySql instance
09:27
Project - Change Data Capture / Replication On Going: Creating S3 Bucket
03:32
Project - Change Data Capture / Replication On Going: Creating DMS Source Endpoint
05:37
Project - Change Data Capture / Replication On Going: Creating DMS Destination Endpoint
05:35
Project - Change Data Capture / Replication On Going: Creating DMS Instance
02:42
Project - Change Data Capture / Replication On Going: MySql WorkBench
01:16
Project - Change Data Capture / Replication On Going: Connecting with RDS and Dumping Data
06:02
Project - Change Data Capture / Replication On Going: Quering RDS
01:57
Project - Change Data Capture / Replication On Going: DMS Full Load
08:30
Project - Change Data Capture / Replication On Going: DMS Replication Ongoing
06:03
Project - Change Data Capture / Replication On Going: Stoping Instances
01:45
Project - Change Data Capture / Replication On Going: Glue Job (Full Load)
08:28
Project - Change Data Capture / Replication On Going: Glue Job (Change Capture)
03:50
Project - Change Data Capture / Replication On Going: Glue Job (CDC)
15:26
Project - Change Data Capture / Replication On Going: Creating Lambda Function and Adding Trigger
06:46
Project - Change Data Capture / Replication On Going: Checking Trigger
05:21
Project - Change Data Capture / Replication On Going: Getting S3 file name in Lambda
04:28
Project - Change Data Capture / Replication On Going: Creating Glue Job
05:24
Project - Change Data Capture / Replication On Going: Adding Invoke for Glue Job
04:49
Project - Change Data Capture / Replication On Going: Testing Invoke
04:59
Project - Change Data Capture / Replication On Going: Writing Glue Shell Job
05:51
Project - Change Data Capture / Replication On Going: Full Load Pipeline
06:41
Project - Change Data Capture / Replication On Going: Change Data Capture Pipeline
07:12
Links for the Course's Materials and Codes
00:09
Introduction: Why MongoDB
03:03
Introduction: Applications of MongoDB
04:03
Introduction: Instructor Introduction
00:57
Introduction: What_s inside
02:13
Introduction: Methodology
01:10
Introduction: Project
01:29
Introduction: Request for Your Honest Review
01:18
Overview: SQL Schema
10:16
Overview: NoSQL Schema
12:13
Overview: What's the major difference between Sql and NoSql?
1 question
Overview: Installing MongoDB
04:54
Overview: Setting Enviroment Variable
03:20
Overview: Analogies
04:26
Overview: Which of the below statement is not true?
1 question
Basic Mongo Operations: Basic Database commands
06:31
Basic Mongo Operations: Basic Database commands
06:14
Basic Mongo Operations: Basic Collection Commands
10:18
Basic Mongo Operations: Which is the correct Command to see all collections?
1 question
Basic Mongo Operations: Is it mandatory to create collection in database for viewing it?
1 question
Basic Create Operation: Introduction to module
01:53
Basic Create Operation: Create operation is used to
1 question
Basic Create Operation: Create Document (Single)
09:10
Basic Create Operation: Create Documents (Many)
08:04
Basic Create Operation: Which command is used to see all the documents in the collection?
1 question
Basic Create Operation: Quiz (Create Docuements)
01:56
Basic Create Operation: Solution (Create Docuements)
07:59
Basic Create Operation: Quiz (Create Document)
01:09
Basic Create Operation: Solution (Create Document)
05:46
Basic Create Operation: Outro
01:23
Basic Update Operation: Introduction
02:53
Basic Update Operation: Update Documents (Sinlge Filter)
13:02
Basic Update Operation: Update operation is used to
1 question
Basic Update Operation: Update Documents
04:32
Basic Update Operation: Which command will update document where name is John?
1 question
Basic Update Operation: Quiz (Update Operation)
00:53
Basic Update Operation: Solution (Update Operation)
04:23
Basic Update Operation: Quiz (Update Operation)
00:46
Basic Update Operation: Solution (Update Operation)
04:23
Basic Update Operation: Solution (Update Operation)
04:53
Basic Update Operation: Outro
01:08
Basic Read Operation: Introduction
01:52
Basic Read Operation: Read operation is used to
1 question
Basic Read Operation: Read Docuements
03:06
Basic Read Operation: Which command is used to see all the documents in the collection?
1 question
Basic Read Operation: Quiz (Read Documents)
01:12
Basic Read Operation: Solution (Read Documents)
06:09
Basic Read Operation: Quiz (Read Documents)
00:48
Basic Read Operation: Solution (Read Documents)
02:26
Basic Read Operation: Outro
01:14
Basic Delete Operation: Introduction
00:36
Basic Delete Operation: Delete operation is used to
1 question
Basic Delete Operation: Delete Document
06:25
Basic Delete Operation: Which command is used to delete all the documents in the collection where quantity is 10?
1 question
Basic Delete Operation: Quiz (Delete Operation)
00:47
Basic Delete Operation: Solution (Delete Operation)
04:18
Basic Delete Operation: Quiz (Delete Operation)
00:43
Basic Delete Operation: Solution (Delete Operation)
01:23
Basic Delete Operation: Outro
01:00
Query and projection operators: Module Introduction
01:57
Query and projection operators: $eq Operator
15:23
Query and projection operators: $gt Operator
03:35
Query and projection operators: $lt Operator
03:26
Query and projection operators: $in Operator
03:09
Query and projection operators: $ne Operator
02:07
Query and projection operators: $nin Operator
02:25
Query and projection operators: $and Operator
06:39
Query and projection operators: $or Operator
03:24
Query and projection operators: $not Operator
05:11
Query and projection operators: $exists Operator
07:18
Query and projection operators: $types Operator
03:09
Query and projection operators: $expr Operator
06:19
Query and projection operators: $mod Operator
04:26
Query and projection operators: $text Operator
10:53
Query and projection operators: $all Operator
05:47
Query and projection operators: $elemMatch Operator
10:04
Query and projection operators: $size Operator
04:10
Query and projection operators: $ Operator
07:30
Query and projection operators: $slice Operator
03:39
Query and projection operators: Select the correct statement:
1 question
Query and projection operators: Select the correct statement:
1 question
Query and projection operators: Quiz ($eq)
00:51
Query and projection operators: Solution ($eq)
07:07
Query and projection operators: Quiz ($gt)
01:02
Query and projection operators: Solution ($gt)
03:01
Query and projection operators: Quiz ($gte)
00:54
Query and projection operators: Solution ($gte)
06:14
Query and projection operators: Quiz ($in)
00:54
Query and projection operators: Solution ($in)
08:02
Query and projection operators: Quiz ($lt)
01:17
Query and projection operators: Solution ($lt)
02:32
Query and projection operators: Quiz ($lte)
00:51
Query and projection operators: Solution ($lte)
04:47
Query and projection operators: Solution ($lte)
01:48
Query and projection operators: Quiz ($ne)
00:45
Query and projection operators: Solution ($ne)
04:22
Query and projection operators: Quiz ($nin)
00:56
Query and projection operators: Solution ($nin)
02:13
Query and projection operators: Solution ($nin)
03:03
Query and projection operators: Solution ($nin)
01:39
Query and projection operators: Quiz ($and)
00:55
Query and projection operators: Solution ($and)
07:44
Query and projection operators: Quiz ($or)
01:36
Query and projection operators: Solution ($or)
08:40
Query and projection operators: Solution ($or)
05:18
Query and projection operators: Quiz ($not)
01:47
Query and projection operators: Solution ($not)
04:58
Query and projection operators: Solution ($not)
04:35
Query and projection operators: Solution ($not)
06:10
Query and projection operators: Quiz ($exists)
00:51
Query and projection operators: Solution ($exists)
04:56
Query and projection operators: Quiz($expr)
00:57
Query and projection operators: Solution($expr)
06:22
Query and projection operators: Quiz($mod)
00:41
Query and projection operators: Solution($mod)
04:12
Query and projection operators: Quiz($text)
01:22
Query and projection operators: Solution($text)
13:19
Query and projection operators: Quiz($all)
00:59
Query and projection operators: Solution($all)
04:32
Query and projection operators: Solution($all)
04:23
Query and projection operators: Quiz($elemMatch)
01:11
Query and projection operators: Solution($elemMatch)
06:00
Query and projection operators: Solution($elemMatch)
05:33
Query and projection operators: Quiz($size)
00:42
Query and projection operators: Solution($size)
03:20
Update Operators: $currentDate operator
09:05
Update Operators: $inc operator
07:25
Update Operators: $inc operator
02:54
Update Operators: $min operator
02:57
Update Operators: $max operator
04:28
Update Operators: $mul operator
03:06
Update Operators: $rename operator
05:26
Update Operators: $inc operator is used to:
1 question
Update Operators: $set operator
07:17
Update Operators: $set operator
03:50
Update Operators: $unset operator
02:58
Update Operators: $addToSet operator
03:52
Update Operators: $pop operator
03:49
Update Operators: $pull operator
09:29
Update Operators: $push operator
02:13
Update Operators: $each operator
03:44
Update Operators: $position operator
02:51
Update Operators: $sort operator
02:52
Update Operators: $push operator is used to:
1 question
Update Operators: Quiz (Update Operators)
01:02
Update Operators: Solution (Update Operators)
03:26
Update Operators: Solution (Update Operators)
02:56
Update Operators: Solution (Update Operators)
01:32
Update Operators: Solution (Update Operators)
03:22
Update Operators: Quiz (Update Operators)
00:47
Update Operators: Solution (Update Operators)
02:11
Update Operators: Solution (Update Operators)
01:41
Update Operators: Solution (Update Operators)
02:45
Mongo with Node: Installing Node on local machine
02:43
Mongo with Node: Installing VS code
04:33
Mongo with Node: Mongo atlas
01:37
Mongo with Node: Create Cluster on Mongo atlas
04:21
Mongo with Node: Creating User in Atlas
06:21
Mongo with Node: Network Access
03:23
Mongo with Node: Is it a good practice to make your mongodb cluster publicly accessible from all IP addresses:
1 question
Mongo with Node: Database and Collections
06:32
Mongo with Node: Connect Node with Mongo
09:10
Mongo with Node: Get databases
04:26
Mongo with Node: Insert in Mongo using Node
08:27
Mongo with Node: Read from Mongo using Node
05:21
Mongo with Node: Update in Mongo using Node
07:25
Mongo with Node: Delete from Mongo using Node
03:32
Mongo with Node: Which of the statement is true:
1 question
Mongo with Python: PyCharm
04:21
Mongo with Python: Creating Connection
05:25
Mongo with Python: Insert in Mongo using Python
06:36
Mongo with Python: Read from Mongo using Python
04:28
Mongo with Python: Update in Mongo using Python
06:24
Mongo with Python: Delete in Mongo using Python
03:38
Django with Mongo: Django Installation
03:33
Django with Mongo: Which of the statement is true:
1 question
Django with Mongo: Creating App
04:10
Django with Mongo: Setting up Django with Mongo
06:04
Django with Mongo: Django Migrations
02:18
Django with Mongo: Django Urls and Views
04:22
Django with Mongo: Django with Postman
04:35
Django with Mongo: Django get Data from Postman
05:29
Django with Mongo: Insert in Mongo using Django
02:44
Django with Mongo: Read from Mongo using Django
06:03
Django with Mongo: Update in Mongo using Django
04:57
Django with Mongo: Detele in Mongo using Django
02:53
Spark With Mongo: Databricks for Spark
03:06
Spark With Mongo: Installing Libraries
02:05
Spark With Mongo: Data Overview
02:46
Spark With Mongo: ETL
13:05
Viết Bình Luận
Khoá học liên quan
![[NEW] Spring Boot 3, Spring 6 & Hibernate for Beginners](/uploads/courses/udemy/647428_be28_10.jpg)
![Machine Learning A-Z: AI, Python & R + ChatGPT Prize [2024]](/uploads/courses/udemy/950390_270f_3.jpg)
Đăng ký get khoá học Udemy - Unica - Gitiho giá chỉ 50k!
Get khoá học giá rẻ ngay trước khi bị fix.
Đánh giá của học viên
Bình luận khách hàng