access
Lifetime
content
7 Hours
enrolled
148
Description
This comprehensive web scraping course gives you a look at the basics of web scraping and data extraction in just 7 hours. For the uninitiated, web scraping removes the burden of manually copying data from a website and instead provides an automated way to do it. Data extraction is done from websites using some sort of a code written called a “scraper” which takes a Web URL, parses the HTML DOM of that site, and then returns the result which can be saved in some format for future use. These processes are tackled in this 59-lecture course in 3 parts: Setting up the environment, Building Blocks & Syntax, and Projects. This course is built using the easy to understand NodeJS and automation testing tool Selenium so you can get up to speed faster.- Access 59 lectures & 7 hours of content 24/7
- Get an introduction on what NodeJS is & how it works
- Learn & try the basics of scraping and understand how to use Selenium
- Try working on 3 projects: Google Translate 2018, Google Translate 2019 & a travel insurance website
- Learn how to read data from CSV files
- Understand & try saving scraped data into new CSV files and applying validations
Instructor
Jazeb Akram is a developer and a web designer with the great passion for building beautiful new Desktop/Web Applications from scratch. He has been working as a Freelancer since 2011.He designed various Applications for many web design companies as an Out Sourcer. Jazeb also has a university degree in computer science along with many research activities.Important Details
- Length of time users can access this course: lifetime
- Access options: web & mobile streaming
- Certification of completion included
- Redemption deadline: redeem your code within 15 days of purchase
- Experience level required: beginner
Requirements
- Basic HTML knowledges
- Basic programming concepts such as Variable, If Condition, Loop Structure
- Basics of JavaScript
- Node JS v10.13.0 (installed inside course)
- Chrome Driver v2.43 (installed inside course)
Terms
- Unredeemed licenses can be returned for store credit within 30 days of purchase. Once your license is redeemed, all sales are final.
Course Outline
- Setting Up the Environment
- Intro - 1:01
- Lec 1 What is NodeJS - 4:11
- Lec 2 Installing NodeJS - 3:02
- Lec 3 NPM - 6:39
- Lec 4 Editor - 1:39
- Exercise Files | Resources
- All Coding Files
- Basics of Scraping
- Lec 5 Scraping Parts - 2:46
- Lec 6 Driver - 4:32
- Lec 7 Seleinum Elements - 3:42
- Lec 8 Selenium methods - 2:26
- Lec 9 Basic Scrape - 7:26
- Lec 10 Selenium wait - 3:27
- Lec 11 Quiting Browser - 3:51
- Lec 12 Writing Method - 16:11
- Lec 13 Exception Handling - 14:01
- Lec 14 ScreenShot - 9:51
- lec 14.1 Project Division - 1:58
- Project (Google Translate 2018)
- Lec 15 1st Project Preview - 2:49
- Lec 16 Getting Language id GT2K18 - 15:30
- Lec 17 Getting Language Related to Array GT2K18 - 7:00
- Lec 18 Creating Language File GT2K18 - 7:29
- Lec 19 Deleting Existing File GT2K18 - 5:07
- Lec 20 Removing Bug and Running the Process in BackGround GT2K18 - 6:56
- Lec 21 Building Scrape File GT2K18 - 9:36
- Lec 22 Scrape GoogleTranslate Function Part 1 GT2K18 - 6:50
- Lec 23 Scrape GoogleTranslate Function Part 2 GT2K18 - 14:50
- Lec 24 Adding Data to CSV File GT2K18 - 5:33
- Lec 25 Limiting the Characters according to Google GT2K18 - 5:54
- Lec 26 Adding Delays GT2K18 - 5:34
- Lec 27 Final Testing GT2K18 - 3:41
- Project (Google Translate 2019)
- 1 Google Translate 2019 Preview GT2K19 - 2:10
- 2 Opening Language Box GT2K19 - 8:02
- 3 Getting Class GT2K19 - 14:40
- 4 Getting Language Id GT2K19 - 10:56
- 5 Getting Name GT2K19 - 18:32
- 6 Creating File GT2K19 - 9:25
- 7 Deleting Existing File GT2K19 - 7:47
- 8 Reading Client CSV File GT2K19 - 9:36
- 9 Starting Scrape function GT2K19 - 7:29
- 10 Running Script GT2K19 - 16:31
- 11 Exception Handling GT2K19 - 10:08
- 12 Limiting Translation Content GT2K19 - 3:56
- 13 Saving Output Data for Client GT2K19 - 10:06
- 14 Adding Delay Factor and Testing GT2K19 - 11:20
- Project | Scraping Travel Insurance Website
- Lec 28 2nd Project Preview - 3:56
- Lec 29 Understanding Test Cases - 5:41
- Lec 30 Adding Const and Variables - 6:22
- Lec 31 Looping Params - 4:47
- Lec 32 Executing Test Case and Sending it to Index.JS file - 11:00
- Lec 34 Starting Index File - 13:10
- Lec 35 Convert Date Function - 7:17
- Lec 36 Selecting 1st Two Fields - 6:05
- Lec 37 Trip Duration - 9:23
- Lec 38 Finishing Current Page - 9:19
- Lec 39 Compiling Results - 13:14
- lec 40 Appending to CSV File - 4:36
- lec 41 Debugging - 16:42
- lec 42 Final Testing Travel Pro - 7:33
- Goodbye - 0:48
access
Lifetime
content
7 Hours
enrolled
148