Skip to content

Web scraper for Cape-Verdean news website using httpx, async and queue.

Notifications You must be signed in to change notification settings

eric-martial/noticiascv_http

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

71 Commits
 
 
 
 
 
 
 
 

Repository files navigation

noticiascv_http

Web scraper for Cape-Verdean news website using httpx package and asyncio. It uses queue to manage scraped items before saving them to db. Websites currently scraped are:

Run by doing python -m src.main

About

Web scraper for Cape-Verdean news website using httpx, async and queue.

Topics

Resources

Stars

Watchers

Forks

Languages