Mô tả

Get into the world of Web Scraping and Data Mining with NodeJs. Learn modern methods of scraping with NodeJs - Puppeteer and with direct NodeJs Requests.


Introduce yourself and improve your knowledge on Scraping

  • Learn Scraping with Puppeteer, NightmareJs or Manual Requests

  • Build scraper modules for various websites ( Imdb, twitter, instagram..etc )

  • Learn multiple ways of scraping and when to choose them

  • Get familiar with the ethics, do's and dont's of Scraping


Enjoy coding and learning Web Scraping with real world examples and real world problem solving while building scrapers with NodeJs.


Web Scraping is a very gray area and not many talk about it or even teach about this. You are going to find valuable scraping informations and techniques that you can directly put to practice for yourself.

I've been working with Data Mining with NodeJs for more than 2 years on dozens of websites and I've learned many ways of creating a scraper and the best practices. All of which you are going to find out and learn in just a few hours in this course.


Overview

I designed this Web Scraping Crash Course to be easily understood by absolute beginners and people who already have some knowledge about the subject. 

Complete crash course with all files and code samples, you’ll be able to work alongside with me as we work through each concept and scraper module.

This is not some random tutorial that you usually find on the internet with extremely simple examples. I am showing you everything that you need to think about when starting to build a scraper with NodeJs, while building, problem solving techniques and all you need to know  that by the end of the course to be confident and create one for yourself.

Bạn sẽ học được gì

Create Data Scrapers from Scratch to Finish with NodeJs

Choosing the right tools for Scraping different websites

How to use the Top Scraping tools for NodeJs to your Advantage

How to Automate User Interactions with NodeJs

Build Scrapers with Puppeteer by Google

Build Scrapers with the native Request & Cheerio

Learn how to scrape with NightmareJs

Yêu cầu

  • JavaScript Knowledge with ES6 Syntax
  • Be familiar with CSS / jQuery selectors

Nội dung khoá học

10 sections

Introduction

3 lectures
Introduction
02:11
Tools & Project Setup
03:29
Writing a Simple IMDB Scraper
10:31

More Info & Concepts

5 lectures
Why & When to Choose Scraping
03:56
The biggest "problem" with scraping
02:37
Running with Terminal / CMD & Basics on VSCode Debugger
06:38
The Request library / method
05:12
The Browser Automation method
06:10

IMDB Simple Scraper ( Request Method )

8 lectures
01 - How to spoof / add custom request headers
06:51
02 - Deal with GZIP Compression enabled websites
04:44
03 - Selectors & More Parsing
19:06
04 - Multiple Movies & Saving JSON to File
07:59
05 - Exporting data to CSV
06:48
06 - Easiest method of getting the proper selectors
05:36
07 - Downloading Images Locally
10:21
08 - Promisifying callback based functions
09:12

Request Method

3 lectures
Using a Proxy Server
04:43
Status Codes & Error Handling
10:04
Manual Login with CSRF Protection & Cookie Parsing
18:35

Instagram User Simple Scraper ( Request Method )

3 lectures
01 - Introduction and inspecting the structures
08:28
02 - Building the scraper
20:24
03 - Parsing latest posts of an ig user
12:08

The Puppeteer Method

9 lectures
01 - Installation, introduction and testing
04:19
02 - Writing a simple automated task
09:04
03 - Generating PDF's, Emulating Phone Views, Getting Title & Url of pages
07:36
04 - Using Puppeteer to login on Instagram
11:35
05 - Making Websites Load Much Faster with a simple trick
08:23
06 - HTTP Basic Authentication
03:46
07 - Ignoring HTTPS / SSL Errors & Changing the ViewPort
03:40
08 - Learning how to use Proxies
02:55
09 - Exposing and working with Custom Functions in Puppeteer
09:25

Twitter Scraper with Puppeteer

8 lectures
01 - How to login on Twitter
10:21
02 - Refactoring code and improving it
07:14
03 - How to post Tweets with Puppeteer
11:33
04 - Scraping Twitter User Details
13:56
05 - Scraping More User Details
15:45
06 - Scraping User Tweets
14:09
07 - Scraping More Tweet Details ( Likes, Replies..etc )
14:10
08 - Handling The Infinite Loader of the Tweets
08:28

Amazon Scraper with Puppeteer

3 lectures
01 - Creating the Module Structure
06:43
02 - Parsing Product Details
11:28
03 - More Details and Tricks on the Product Details page of Amazon
06:59

The NightmareJs Method

7 lectures
01 - Installation, introduction and testing
06:28
02 - Talking and testing more about NightmareJs
07:15
03 - Scraping Ycombinator News with Vanilla Javascript
13:02
04 - Scraping Ycombinator News - More details
10:16
05 - Scraping Ycombinator News - Modulate & Pagination
11:40
06 - Handling Downloads
06:06
07 - Injecting Custom Javascript
05:23

The end

1 lectures
Congratulations!
00:54

Đánh giá của học viên

Chưa có đánh giá
Course Rating
5
0%
4
0%
3
0%
2
0%
1
0%

Bình luận khách hàng

Viết Bình Luận

Bạn đánh giá khoá học này thế nào?

image

Đăng ký get khoá học Udemy - Unica - Gitiho giá chỉ 50k!

Get khoá học giá rẻ ngay trước khi bị fix.