Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Byte ripper #1575

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Adding Byte ripper #1575

wants to merge 3 commits into from

Conversation

0x1f595
Copy link
Contributor

@0x1f595 0x1f595 commented Feb 17, 2020

This rips byte.co user posts by byte.co/username URLs.

Category

This change is exactly one of the following (please change [ ] to [x]) to indicate which:

  • a new Ripper

Description

This adds a ripper for the Byte mobile app (byte.co). It uses byte.co/username URLs since the app itself has no public URLs. For example byte.co/grant.

Testing

Required verification:

  • I've verified that there are no regressions in mvn test (there are no new failures or errors).
  • I've verified that this change works as intended.
    • Downloads all relevant content.
    • Downloads content from multiple pages (as necessary or appropriate).
    • Saves content at reasonable file names (e.g. page titles or content IDs) to help easily browse downloaded content.
  • I've verified that this change did not break existing functionality (especially in the Ripper I modified).

Optional but recommended:

  • I've added a unit test to cover my change.

I have not added any tests because the automated nature would make it more likely for the account used to get banned. If the ripper does stop working, we'll probably need to create another Byte account and update the AUTH_HEADER value.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant