-
Notifications
You must be signed in to change notification settings - Fork 533
/
cewl
20 lines (14 loc) 路 589 Bytes
/
cewl
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
# To spider a site and write all found words to a file
cewl -w <file> <url>
# To spider a site and follow links to other sites
cewl -o <url>
# To spider a site using a given user-agent
cewl -u <user-agent> <url>
# To spider a site for a given depth and minimum word length
cewl -d <depth> -m <min word length> <url>
# To spider a site and include a count for each word
cewl -c <url>
# To spider a site inluding meta data and separate the meta_data words
cewl -a -meta_file <file> <url>
# To spider a site and store email adresses in a separate file
cewl -e -email_file <file> <url>