The Data Integrity Process File (DIP) compares data directly imported from your back-end database to the data collected and used by Digital Analytics reporting. Data is imported through the upload of a DIP file, which is sent via SFTP to Digital Analytics on a daily basis.

DIP File Format

The DIP file is a comma-separated values (CSV) file that contains line item data for all orders placed for the day. Each line has six values: Order Date, Order ID, Product ID, Order Subtotal, Quantity, and Unit Price.

Note: No quotes should exist anywhere within the DIP file. The DIP file should contain data for all orders placed online that would be tracked with Digital Analytics. It should not include any orders placed from other channels, such as a store, catalog, or call center/telephone sales. Do not include commas in Order Subtotal or Unit Price values.

Date Formatting

The Order Date should be in the same time zone as your Digital Analytics reports were set up to. They should not be translated to CST. If you have any questions about what time zone is appropriate, please contact your Implementation Engineer. The Order Date field must be in one of the following formats:

DD-MON-YYYY HH24:MI:SS
YYYY-MM-DD HH24:MI:SS
MM/DD/YY HH24:MI:SS
MM/DD/YYYY HH24:MI
DD-MON-YYYY HH24:MI:SS
MM/DD/YYYY HH24:MI:SS
DD-MON-YYYY
MM-DD-YYYY HH24:MI:SS

Example File

Below is an example set of order data for one day and the corresponding DIP file entries.

Example DIP File

27-Oct-2010 13:32:17,5328031,47175,20.97,3,6.99
27-Oct-2010 14:12:05,5328032,156564,243.87,4,3.49
27-Oct-2010 14:30:07,5328032,187167,243.87,1,29.99
27-Oct-2010 14:55:46,5328032,185767,243.87,4,19.99
27-Oct-2010 14:59:43,5328032,186891,243.87,4,29.99
27-Oct-2010 15:10:23,5328034,188353,231.76,1,19.97
27-Oct-2010 15:19:53,5328034,188396,231.76,2,15.97
27-Oct-2010 15:24:31,5328034,188412,231.76,1,24.97
27-Oct-2010 15:43:14,5328034,188487,231.76,1,29.97
27-Oct-2010 16:03:28,5328034,188529,231.76,1,64.97

Uploading the DIP File

The DIP file should be uploaded to the Digital Analytics SFTP server for your data center. Depending on the Data Center and database type used by your Client ID, the SFTP account and SFTP target used to upload the DIP files will vary.

SFTP Target Domain

US Data Center: ftp.coremetrics.com

Europe Data Center: ftp.de.coremetrics.com

SFTP Account Type

For 5- or 9-series Client IDs worldwide, use a "clientid-import" account self-configured in the appropriate Import application UI for your Data Center: import.coremetrics.com (US), import.de.coremetrics.com (Europe).

For 9-series Client IDs using Oracle, use a "clientname-dip" account created by Digital Analytics Support.

Contact Digital Analytics Support to confirm which type of SFTP account should be configured for your Client ID.

File Naming Convention

The DIP file should be named according to the following convention:

DIP_<client_id>_<YYYYMMDD>.csv

Where <client_id> is your assigned client ID and <YYYYMMDD> is the date in 'YYYYMMDD' format.