Sync & Data Refresh
Manage how your data stays up to date. Whether you need real-time updates or a daily snapshot, you can control the frequency and method of synchronization for every data source.
1. Automatic Sync (Cloud Sources)
Cloud sources sync automatically based on your chosen frequency. Select the interval that best matches your reporting needs:
| Frequency | Best Use Case |
|---|---|
| Every 5 minutes | Real-time dashboards and mission-critical data. |
| Every 15 minutes | Near real-time operational reporting. |
| Every hour | Standard business intelligence and daily tracking. |
| Every 6 hours | Recommended. Ideal for daily analysis without high API overhead. |
| Every 24 hours | Long-term trends, weekly, or monthly reporting. |
2. Manual Sync
Need the latest data right now? You can bypass the schedule and trigger a manual refresh at any time.
- Navigate to the Source Details page.
- Click the Sync Now button in the top right corner.
- Monitor the progress bar; stay on the page until the process completes to ensure success.
3. Re-uploading Local Files
When working with flat files (CSV, Excel), you can update your data using the Upsert method.
What is an Upsert?
An Upsert (Update + Insert) is the most efficient way to refresh local files. It works by:
- Updating existing records if a match is found in your "Key Columns."
- Inserting brand new records that don't already exist in the system.
Note
To use Upsert, you must have a unique identifier (Primary Key) defined in your dataset so the system can distinguish between new and existing rows.
4. Sync History & Status
To audit your data health, check the Sync History tab within any data source. This log provides:
- Status: Success, Warning, or Failed.
- Rows Processed: Total number of records updated.
- Duration: How long the sync took to complete.