Creating jobs in Data Refinery
You can create a job to run a Data Refinery flow directly in Data Refinery.
To create a Data Refinery flow job:
-
In Data Refinery, click the Jobs icon from the Data Refinery toolbar and select Save and create a job.
-
Define the job details by entering a name and a description (optional).
-
On the Configure page, select an environment runtime for the job, and optionally modify the job retention settings.
-
On the Schedule page, you can optionally add a one-time or repeating schedule.
If you define a start day and time without selecting Repeat, the job will run exactly one time at the specified day and time. If you define a start date and time and you select Repeat, the job will run for the first time at the timestamp indicated in the Repeat section.
You can't change the time zone; you must set your job schedule in your web browser's time zone. The schedule will be translated to the time zone of the compute node where your job runs.
If you exclude certain weekdays, the job might not run as you would expect. The reason might be due to a discrepancy between the time zone of the user who creates the schedule, and the time zone of the compute node where the job runs.
Note: Your scheduled job can appear differently if your web browser’s time zone is set to your local time zone following Daylight Savings Time (DST). For example, your scheduled job appears at 3:00PM Eastern Standard Time Zone (EST) daily corresponding to 8:00PM Coordinated Universal Time (UTC). When your local time zone changes to Eastern Daylight Time Zone (EDT), your scheduled job continues to run at 8:00PM (UTC) which will now appear as 4:00PM (EDT) daily. -
Optional: Set up notifications for the job. You can select the type of alerts to receive.
-
Review the job settings. Then, create the job and run it immediately, or create the job and run it later.
The Data Refinery flow job is listed in the Jobs in your project.
Learn more
Parent topic: Jobs