Skip to content

Aly-Reda/Scraper_School

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 

Repository files navigation

Scraper School

This is the complete guide to know how to scrape almost any website

Prerequisites 💪

  1. Basic HTML
  2. Basic Python

Installation 🔨

Python 3.8

install python with pip

pip install scrapy
pip install pandas 
pip install pyquery
pip install selenium
pip install random_user_agent

Frameworks Documentation 📙

  1. Scrapy
  2. Requests
  3. Pyquery
  4. Selenium
  5. Pandas

Websites 🚀

  1. Quotes to Scrape
  2. Glassdoor
  3. Elmenus
  4. Indeed
  5. Canadapost
  6. Repocast
  7. Tadawul
  8. Poshmark
  9. Anmeld-haandvaerker
  10. Tripadvisor
  11. Seekingalpha
  12. Flexioffices
  13. Easydata
  14. Yahoo Finance
  15. Opendiary
  16. Google Maps

Useful Chrome Extensions 🔖

  1. Quick Javascript Switcher
  2. Json Formatter
  3. Web Scraper
  4. Data Scraper