The Data Integrity Process File (DIP) compares data directly imported from your back-end database to the data collected and used by Digital Analytics reporting. Data is imported through the upload of a DIP file, which is sent via SFTP to Digital Analytics on a daily basis.
DIP File Format
The DIP file is a comma-separated values (CSV) file that contains line item data for all orders placed for the day. Each line has six values: Order Date, Order ID, Product ID, Order Subtotal, Quantity, and Unit Price.
|Order Date||Date of the order in an appropriate format|
|Order ID||Order ID should match the Order ID being sent in the Digital Analytics Order Tag.|
|Product ID||Product ID for the line item. This should match the Product ID being sent in the Shop 9 Tag.|
|Order Subtotal||Subtotal for the order. This should not include shipping and handling or tax.|
|Quantity||Quantity of the product purchased for this line item.|
|Unit Price||The unit price for the line item.|
Note: No quotes should exist anywhere within the DIP file. The DIP file should contain data for all orders placed online that would be tracked with Digital Analytics. It should not include any orders placed from other channels, such as a store, catalog, or call center/telephone sales. Do not include commas in Order Subtotal or Unit Price values.
The Order Date should be in the same time zone as your Digital Analytics reports were set up to. They should not be translated to CST. If you have any questions about what time zone is appropriate, please contact your Implementation Engineer. The Order Date field must be in one of the following formats:
DD-MON-YYYY HH24:MI:SS YYYY-MM-DD HH24:MI:SS MM/DD/YY HH24:MI:SS MM/DD/YYYY HH24:MI DD-MON-YYYY HH24:MI:SS MM/DD/YYYY HH24:MI:SS DD-MON-YYYY MM-DD-YYYY HH24:MI:SS
Below is an example set of order data for one day and the corresponding DIP file entries.
|Order Date||Order ID||Product ID||Order Total||Qty||Unit Price|
27-Oct-2010 13:32:17,5328031,47175,20.97,3,6.99 27-Oct-2010 14:12:05,5328032,156564,243.87,4,3.49 27-Oct-2010 14:30:07,5328032,187167,243.87,1,29.99 27-Oct-2010 14:55:46,5328032,185767,243.87,4,19.99 27-Oct-2010 14:59:43,5328032,186891,243.87,4,29.99 27-Oct-2010 15:10:23,5328034,188353,231.76,1,19.97 27-Oct-2010 15:19:53,5328034,188396,231.76,2,15.97 27-Oct-2010 15:24:31,5328034,188412,231.76,1,24.97 27-Oct-2010 15:43:14,5328034,188487,231.76,1,29.97 27-Oct-2010 16:03:28,5328034,188529,231.76,1,64.97
Uploading the DIP File
The DIP file should be uploaded to the Digital Analytics SFTP server for your data center. Depending on the Data Center and database type used by your Client ID, the SFTP account and SFTP target used to upload the DIP files will vary.
SFTP Target Domain
US Data Center:
Europe Data Center:
SFTP Account Type
For 5- or 9-series Client IDs worldwide, use a "clientid-import" account self-configured in the appropriate Import application UI for your Data Center: import.coremetrics.com (US), import.de.coremetrics.com (Europe).
For 9-series Client IDs using Oracle, use a "clientname-dip" account created by Digital Analytics Support.
Contact Digital Analytics Support to confirm which type of SFTP account should be configured for your Client ID.
File Naming ConventionThe DIP file should be named according to the following convention:
Where <client_id> is your assigned client ID and <YYYYMMDD> is the date in 'YYYYMMDD' format.