Bulk Data Export

Overview

The Bulk Data Export feature is designed to provide you with a streamlined and efficient way to export your MCM data to your cloud storage provider and analytics services. This service allows daily export of data regarding campaign information and ad performance, packaged in the efficient and fast parquet file format. This allows customers to ingest large amounts of data automatically without making requests to the Report API.

πŸ“˜

Note

If you’re interested in using Bulk Data Export, please contact your Moloco representative.

Export Schedule

The export schedule is configured for 6 A.M. local time to guarantee that the data from the previous day is fully complete and available for retrieval at your convenience.

🚧

Warning

For bulk data export the day of export is incomplete and subject to alteration due to the attribution window chosen for the platform. In contrast, the MCM Portal is real time and is continually updated with the latest attribution data.

Export Timezone

Depending on your chosen timezone, we'll use the local time clocks for our daily data export jobs. For instance, if you pick US Eastern Timezone, we'll automatically use either Eastern Standard Time (EST) or Eastern Daylight Time (EDT). If you opt for Coordinated Universal Time (UTC), we'll base our daily processing on UTC.

πŸ“˜

Note

During daylight saving time shifts, the daily export job will account for a 23-hour time window for the day. For example, on the second Sunday of March, the US East switches its clock to Eastern Daylight Time (UTC+4) from Eastern Standard Time (UTC+5). On the day daylight saving starts, the day's total hours will be 23.

Conversely, on the first Sunday of November, the region switches back to EST from EDT. On the day when daylight saving ends, the day's total hours will be 25.

Supported Use Cases

Currently, we support the bulk export of:

Data Lifecycle

MCM data is stored for a period of up to 30 days in the provided GCP bucket. We recommend using an automated continuous data transfer service to maintain a copy of the data on your cloud storage to conduct data analytics beyond 30 days.

Accessing Your Data

MCM Data should be exported to your cloud storage provider, the transfer method can vary per cloud service, for detailed access instructions and support, refer to our guide (How to Transfer Data).

Data Format and Storage path

  • All data is stored in parquet format.
  • Storage path format: gs://{bucket}/{version}/{revision}/{data_type}/{date}/{file_name}.
    • Example: gs://mcm-export-moloco/v1/r0/report/2024-01-08/data-000000000000.parquet
ParametersDescription
{bucket}mcm-export-<platform>
{version}The version number can increase when breaking changes are introduced. For example, an exiting schema is changed, a new dataset is added, or any other significant changes or additions are made. (e.g., v1)
{revision}The revision number can increase by the change of feature configuration, not by implementation. A specific change or set of changes made to a current version due to customer-specific needs. (e.g, r1)
{data_type}The type of data exported. (e.g., campaign_digests, or report)
{date}YYYY-MM-DD (e.g,. 2024-01-08)
{file_name}Only parquet file format is supported. There can be multiple files. e.g., data-000000000000.parquet