Pipedream (HTTP Trigger)

Start a Pipedream workflow for every completed scrape and run code or prebuilt actions on the rows.

Setup Steps

1. Create a workflow → Trigger: “HTTP / Webhook” → “HTTP Requests with a Body” → copy the endpoint URL.
2. In Lection, set the delivery channel to "Pipedream" and paste the URL.
3. Run a test scheduled scrape so Pipedream captures a sample event.
4. Add steps that loop over steps.trigger.event.body.dataset.records and send each row to your destination.
5. Deploy the workflow; Lection will POST after every completed scheduled scrape.

Mapping Tips

• The Lection payload is at steps.trigger.event.body.
• dataset.columns gives header order; dataset.records[*] keys match those names.
• download.url is a signed, time-limited link to the exported file.

Payload Highlights

• event: scheduled_scrape.completed, version: 1.
• dataset: rowCount, columns, records.
• Headers: Content-Type: application/json.

Helpful Links

• Pipedream HTTP trigger docs

Test Checklist

• Set webhook URL and optional secret in Lection.
• Run a scheduled scrape to capture sample data.
• Confirm dataset.records and download.url arrive in your tool.
• Publish/activate the workflow so production runs stay wired.