when I scrap big amount of data. I had to generate many CSV or spreadsheet files to avoid losing progress. this package should combine all this data together in one CSV file.
To use this install csv-combiner package, import it. and use from_dir function