Project created to collects results from search engines.
- DuckDuckGo
- beautifulsoup4
- scrapy
Install depends
pip install -r requirements.txt
Start DuckDuckGO search:
scrapy crawl duckduckgo -o {OUTPUT_PATH} -a query="{SEARCH_PARAMS}"
Example
scrapy crawl duckduckgo -o result.json -a query="proxies free list"