Customised data export

You can create a regular, scheduled data export from Ometria to an AWS S3 bucket or Databricks.

The data includes all records that changed in the past 24 hours.

If a change happens after midnight but before the data starts sending (between 1:00am and 5:00am), it likely won't be exported until the next day.

File batches

Depending on how much data you're exporting, and how often, you'll receive your exported files in batches no larger than 300MB.

Export security

We recommend familiarising yourself with industry standard best practices for data security, as well as any specific policies your organisation details. 

Amazon's documentation: Security best practices for Amazon S3

Databricks' documentation: Security best practices for Databricks

Data dictionaries

See also: Data export examples

To understand the data you export, refer to: 

• Data export dictionary: Contact records 
• Data export dictionary: Email events
• Data dictionary: Website interaction events

Historical data and your first export

In your first export, you have the opportunity to export historical data for a set period of time (e.g. all data from the past year).

This historical export will only happen when you create a new export, so make sure you save these files in a safe place and make a copy for your records.

Create an export

You will need to have the right permissions to create a data export connection. 

In Ometria, go to Settings and select the Data exports tab, then click Add a new data export.

Give your export a name, then select the type of data you want to export:

• Contact records
• Email events
• Website interactions

Choose your fields

Select the fields you'd like to export. 

You can find a full list of data fields and definitions here: 

• Data export dictionary: Contact records
• Data export dictionary: Email events
• Data dictionary: Website interaction events

Select Next. 

Create connection

Choose your connection type and complete the setup form:

• Create a Databricks connection for custom exports
• Create an S3 bucket connection for custom exports

Click Next. 

Configure export format

In the next screen, choose the format you want to export in:

• CSV
• JSON object

Next, choose how frequently you'd like to export your data:

• Daily
• Weekly
• Monthly

Daily

Receive your export daily (once every 24 hours).

You can choose the time you want your report to start exporting.

Next, choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Weekly

Receive your export weekly on any day of the week, at any time of day.

Next, choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Monthly

Receive your export monthly.

Choose which day to receive the report on:

• The last day of the month (includes weekends)
• The first day of the month (includes weekends)
• A specific day each month 

Select the Export time.

Lastly, you can choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Perform an initial data export

Click Perform historical export to export historical data from a specific date.

You can only do this once, the first time you create an export, so make sure you save these files in a safe place and make a copy for your records.

What happens when I delete a connection?

If you delete a data export connection, Ometria stops sending the data to your S3 bucket.

If you create the connection again later, you can perform a second historical export.

Download sample

You can now download a few rows of "dummy data" to review your export setup.

You can do this while setting up your export, right before activating:

And also from the saved export screen by clicking Trigger sample generation:

Pausing your export

To pause your contact data export at any time, select Edit and then Set to paused from the dropdown on the top right.

Save your changes to finalise:

You can start the export again any time you like by following the same steps and choosing Set to active.

However - you won't be able to retrieve data from the period the connection was paused.  

The only way to run a second historical export is to delete the export and create a new one.