You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is a big one, almost a mini-project in its own right.
Too many csvs have been hand edited to fix errors or mistakes where the scraper was lacking (ie the manual header row fixes for season, playoffs, the entire csv for the 1918 wanderers, etc.)
Really need to fix this, potentially by doing a full rewrite of both scrapers in beautiful soup, so as to eliminate the hacky workarounds required to deal with empty spaces in tables, etc, etc.
The text was updated successfully, but these errors were encountered:
Simplest way of doing this is probably to get master as stable as possible, make a branch, and repeatedly scrape the data and test until everything is working in one scrape->run step
This is a big one, almost a mini-project in its own right.
Too many csvs have been hand edited to fix errors or mistakes where the scraper was lacking (ie the manual header row fixes for season, playoffs, the entire csv for the 1918 wanderers, etc.)
Really need to fix this, potentially by doing a full rewrite of both scrapers in beautiful soup, so as to eliminate the hacky workarounds required to deal with empty spaces in tables, etc, etc.
The text was updated successfully, but these errors were encountered: