Scheduling
Scheduling allows your pipelines to run automatically at specified intervals. This feature requires a Pro subscription.
Setting Up a Schedule
Section titled “Setting Up a Schedule”- Open your pipeline in the web app
- Click on Schedule in the pipeline settings
- Choose your schedule type and configure the timing
- Save and enable the schedule
Schedule Types
Section titled “Schedule Types”Interval
Section titled “Interval”Run the pipeline at regular intervals:
- Every hour
- Every 6 hours
- Every 12 hours
- Every 24 hours
Run at a specific time each day:
- Choose the time (e.g., 8:00 AM)
- Select which days of the week
Weekly
Section titled “Weekly”Run once per week:
- Choose the day of the week
- Choose the time
Custom (Cron)
Section titled “Custom (Cron)”For advanced users, define a custom cron expression:
# Every Monday at 9 AM0 9 * * 1
# Every day at midnight0 0 * * *
# Every 6 hours0 */6 * * *Enabling/Disabling
Section titled “Enabling/Disabling”You can temporarily disable a schedule without deleting it:
- Go to your pipeline settings
- Toggle the schedule off
- The pipeline will stop running automatically but keep its schedule configuration
Run History
Section titled “Run History”See when your pipeline last ran and its status:
- Open your pipeline
- Click Run History
- View past runs, their status, and any errors
Best Practices
Section titled “Best Practices”- Don’t schedule too frequently - Spotify has rate limits; running too often may cause failures
- Check run history - Monitor your pipelines to ensure they’re running successfully
- Use appropriate times - Schedule during off-peak hours if possible