Origin Source Calculations

Origin Source Dates

• For Source Format origin sources, the [date] column in [origin] comes from [source].[created] and/or [activity].[date] (they are identical).
• We are moderately confident that the overnight update considers the [person].[updated] timestamp.

We hope to document similar factoids in the future.

Origin Sources Not Updating

Some users have noticed that changes to Origin Source configurations don't seem to work retroactively, although they should. The official documentation states,

Slate calculates Origin Sources overnight for records that were updated the previous day. If any configuration changes are made to your Origin Sources, then the calculation will run for any records that were updated within the previous 365 days during the overnight process.

Our theory is that an overnight job updates all records updated the previous day and/or all records updated in the last 365 days (if config changes were made). This job has limited resources, and on larger Slate instances, it simply times out when trying to process the full year batch.

An easy but tedious solution is to update your Origin Source config, wait for the overnight job to fail, then query for records whose Origin Source output should have changed but didn't. Retroactively refresh those records, or a subset of them. The overnight job should succeed on the smaller group. Keep doing this until all records are correct.

We have had success updating in batches as large as ~400,000 rows.