Skip to content

Ruthalas/Yiff.party-Image-Scraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Yiff.party-Image-Scraper

Description

A simple Image Scraper for yiff.party profiles.

Setup

To ensure that the python modules requests and bs4 are on a working version, open a shell and type:

pip install -r requirements.txt

You will also need Python 3.7.3. (At least that is the version I'm using. Lower Versions might work too.)

Usage

python yiff_image_scraper.py [start page] [last page] firstLink secondLink ...

Replace firstLink, secondLink, ... with your own Links.
Note that every Link after the first one ist optional.

Optional: You can choose at what page the scraper should start and end (Only for the first link!).

If any links are skipped you can/should find them in SkippedFiles.txt.

There is also an additional script, which removes all files with the same md5-hash.

python duplicate_remover.py

Examples

python yiff_image_scraper.py https://yiff.party/patreon/42

python yiff_image_scraper.py 2 3 https://yiff.party/patreon/42

python yiff_image_scraper.py 8 8 https://yiff.party/patreon/42

Known Issues

File formats can sometimes be corrupt/invalid (e.g. image.pngformat)

About

A simple Image Scraper for yiff.party profiles.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%