This repository contains a collection of Python scripts for scraping data about the mobile game Arknights from various sources and storing the data in a SQL database. The scraped data can then be easily accessed and queried using SQL.
- Python 3.6 or higher
- The following Python packages:
- requests
- sqlalchemy
To use the scraper, clone this repository and install the required packages using pip:
pip install -r requirements.txt
Then, run the arknights_scraper.py script to scrape the data and save it to a SQLite database using the sqlite3 library:
python arknights_scraper.py
This will scrape the data from the Arknights Wiki and the Arknights Database, and save the scraped data to a SQLite database called arknights.db. The database will contain the following tables:
operators: contains information about each operator, including their name, in-game stats and role
banners: contains information about each upcoming banner including the banner name, the date which it released in China and the name of the characters the banner conntains
popular: contains information about the most popular operators based on Gamepress-Arknights operator popularity category. This SQL databse contains only the name of the characters