Skip to content

Run Firecrawl Scraper #91

Run Firecrawl Scraper

Run Firecrawl Scraper #91

Workflow file for this run

name: Run Firecrawl Scraper
on:
schedule:
- cron: "0/1 * * * *" # Runs every minute
workflow_dispatch: # Allows manual trigger
jobs:
scrape:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- name: Set up Python
uses: actions/setup-python@v4
with:
python-version: "3.x"
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install pydantic firecrawl-py
- name: Run scraper
run: python scheduling_scrapers/firecrawl_scraper.py
env:
# Add any environment variables your scraper needs
FIRECRAWL_API_KEY: ${{ secrets.FIRECRAWL_API_KEY }}