Skip to content
#

python-crawler

Here are 70 public repositories matching this topic...

Wikipedia Web Crawler written in Python and Scrapy. The ETL process involves multiple steps, extracting specific data from multiple wikipedia web pages/links using scrapy and organizing it into a structured format using scrapy items. Additionally, the extracted data is saved in JSON format for further analysis and integration into MySQL Workbench.

  • Updated Sep 12, 2023
  • Python

Web Crawler for Google Search and YouTube Channel Extraction" is a Python project that fetches search results from Google and extracts YouTube channel links. It utilizes Selenium WebDriver and BeautifulSoup, supports sequential and parallel crawling, and enables easy storage and analysis of extracted data.

  • Updated Jun 4, 2023
  • Python

Improve this page

Add a description, image, and links to the python-crawler topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the python-crawler topic, visit your repo's landing page and select "manage topics."

Learn more