Customised data export

You can create a regular, scheduled data export from Ometria to an AWS S3 bucket, Databricks, Google Cloud, Microsoft Azure, or an SFTP you host. 

The data includes all records that changed in the past 24 hours, with a one hour buffer before the time of export.

This means that if you've set up a daily export with an export time of 09:00, the export includes all data from 08:00 the previous day to 08:00 the current day. 

Exports are occasionally delayed by a few minutes when a large number of exports start at the same time. Ometria attempts to process exports as soon as possible. 

File batches

Depending on how much data you're exporting, and how often, you'll receive your exported files in batches no larger than 300MB or 100k rows. 

Export security

We recommend familiarising yourself with industry standard best practices for data security, as well as any specific policies your organisation details. 

Amazon's documentation: Security best practices for Amazon S3

Databricks' documentation: Security best practices for Databricks

Google Cloud's documentation: Cloud security best practices

Microsoft Azure's documentation: Security best practices for Azure

SFTP users: Please look up the recommended secure configuration appropriate to your SFTP server. See also: CIS (Centre for Internet Security) benchmarks  

Ometria audit logs

See: Data exports in the audit log

Exported data

See also: Data export examples

To understand the data you export, refer to:

• Data export dictionary: Contact records 
• Data export dictionary: Email events
• Data dictionary: Website interaction events

Historical data and your first export

In your first export, you have the opportunity to export historical data for a set period of time (e.g. all data from the past year).

This historical export only happens when you create a new export, so make sure you save these files in a safe place and make a copy for your records.

The only way to generate a second historical export is to delete the connection and create a new one.

See also: What happens when I delete a connection?

Create an export

You will need to have the right permissions to create a data export connection. 

In Ometria, go to Settings and select the Data exports tab, then click Add a new data export.

Give your export a name, then select the type of data you want to export:

• Contact records
• Email events
• Website interactions

Choose your fields

Select the fields you'd like to export. 

You can find a full list of data fields and definitions here: 

• Data export dictionary: Contact records
• Data export dictionary: Email events
• Data dictionary: Website interaction events

Select Next. 

Create connection

Choose your connection type and complete the setup form:

• Create an Azure connection for custom exports
• Create a Databricks connection for custom exports
• Create a Google Cloud connection for custom exports
• Create an S3 bucket connection for custom exports
• Create a custom SFTP export

Configure export format

In the next screen, choose the format you want to export in:

• CSV
• JSON object

Next, choose how frequently you'd like to export your data:

• Daily
• Weekly
• Monthly

Daily

Receive your export daily (once every 24 hours).

You can choose the time you want your report to start exporting.

Next, choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Weekly

Receive your export weekly on any day of the week, at any time of day.

Next, choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Monthly

Receive your export monthly.

Choose which day to receive the report on:

• The last day of the month (includes weekends)
• The first day of the month (includes weekends)
• A specific day each month 

Select the Export time.

Lastly, you can choose to Overwrite export name or to use your connection name for the exported file. 

Define the name and date format for your exported file:

Perform an initial data export

Click Perform historical export to export historical data from a specific date.

You can only do this once, the first time you create an export, so make sure you save these files in a safe place and make a copy for your records.

What happens when I delete a connection?

If you delete a data export connection, Ometria stops sending the data to your S3 bucket.

If you create the connection again later, you can perform a second historical export.

Download sample

You can now download a few rows of "dummy data" to review your export setup.

You can do this while setting up your export, right before activating:

And also from the saved export screen by clicking Trigger sample generation:

Pausing your export

To pause your contact data export at any time, select Edit and then Set to paused from the dropdown on the top right.

Save your changes to finalise:

You can start the export again any time you like by following the same steps and choosing Set to active.

However - you won't be able to retrieve data from the period the connection was paused.  

The only way to run a second historical export is to delete the export and create a new one.