DESCRIPTION:

A web crawler written in python.

SOFTWARE REQUIREMENTS:

Requires python 3 to be installed on your machine most of Linux or Unix machines have it.

            OR

You can get it from http://python.org/download/

Requires a Python library named Beautiful Soup. It is available at http://www.crummy.com/software/BeautifulSoup/

HOW TO RUN:

python3 crawler.py