Use new crawler.exportData helper

[B4nan]

Hello from the crawlee team!

Just a small suggestion, I was taking a peek at the code and saw you do this to create a data bundle at the end.

gpt-crawler/src/core.ts

Lines 115 to 129 in 27b65d3

	export async function write(config: Config) {
	configSchema.parse(config);
	const jsonFiles = await glob("storage/datasets/default/*.json", {
	absolute: true,
	});
	const results = [];
	for (const file of jsonFiles) {
	const data = JSON.parse(await readFile(file, "utf-8"));
	results.push(data);
	}
	await writeFile(config.outputFileName, JSON.stringify(results, null, 2));
	}

We recently added a new helper that does exactly the same:

https://crawlee.dev/api/basic-crawler/class/BasicCrawler#exportData

So you could replace the whole function with a simple crawler.exportData(config.outputFileName) call, and it will support both JSON and CSV automatically (based on the file extension).