Note
Airbridge will deprecate all access key-based connections with Amazon S3 on July 1, 2024. To continue exporting data to Amazon S3, you must complete all of the following tasks by June 30, 2024:
Adjust columns in Amazon S3
Delete any access key-based connections
Create an IAM role-based connection
For detailed instructions, refer to this article.
Those using IAM role-based connections don’t have to take any action.
Airbridge supports integration with Amazon S3. With the integration, the raw data collected by the Airbridge SDK and tracking links are passed from Airbridge to Amazon S3 on a daily basis, allowing you to process data in various ways to suit your needs.
Attention
When you disable and then re-enable integration with cloud storage, the integration version is updated to the latest version. As the exported columns vary depending on the integration version, check whether the columns need to be adjusted before re-enabling to prevent any issues.
For more information about the columns, refer to this article.
To enable integration with Amazon S3, create a connection by submitting the following Amazon S3 information to Airbridge:
Bucket name
Region
IAM role ARN
The bucket name and region can be found in the AWS Amazon S3 console. The IAM role ARN can be found in the AWS IAM console.
Follow the steps below to get the bucket name and region in the Amazon S3 Console.
1. Sign in to the AWS Management Console and open the Amazon S3 console.
2. Navigate to [Buckets] to find the bucket list. Get the name and AWS Region of the bucket to receive data from Airbridge.
If you don’t have a bucket or want a new bucket, click Create bucket. For detailed instructions on creating a bucket, refer to AWS Documentation.
Follow the steps below to add an Amazon S3 bucket to Airbridge by submitting the bucket name and region.
1. Navigate to [Integrations]>[Third-party Integration] in the Airbridge dashboard. Select “Amazon S3.”
2. Click + Create a connection.
3. Enter the bucket name and region you got from the Amazon S3 console.
4. Under File Format, select between CSV and Parquet. Click Submit to save.
5. Once you have submitted all the information correctly, you will see the policy required to create an IAM policy.
Click Copy to copy the policy. Then, go back to the AWS Management Console.
Follow the steps below to create an IAM policy that manages access to AWS resources.
1. Sign in to the AWS Management Console and open the IAM console.
2. Navigate to [Access management]>[Policies] and click Create policy.
3. Select the [JSON] option. Paste the policy copied from the Airbridge dashboard and click Next.
4. Under [Review and create], enter your choice of policy name. Don’t change other settings. Click Create policy to finish creating the policy.
Follow the steps below to create an IAM role with specific permissions.
1. Go back to the Airbridge dashboard and click Next step.
2. Copy the account ID and external ID required to create an IAM role.
3. Go back to the IAM console. Navigate to [Access management]>[Roles] and click Create role.
4. Under [Select trusted entity], select “AWS account.”
5. Under [An AWS account], select “Another AWS account.” Paste the account ID copied from the Airbridge dashboard.
Then, select the “Require external ID” option and paste the external ID copied from the Airbridge dashboard. Click Next.
6. Under [Add permissions], search for the policy created for the integration. Check the checkbox and click Next.
7. Under [Name, review, and create], enter your choice of role name. Don’t change other settings. Click Create role to finish creating the role.
Follow the steps below to submit the IAM role ARN to Airbridge.
1. Navigate to [Access management]>[Roles] in the IAM console. Click the name of the IAM role created for the integration.
2. Copy the ARN.
3. Go back to the Airbridge dashboard. Paste the ARN copied from the IAM console and click Submit. Test the connection to complete the integration setup.
Test the connection to ensure data can be successfully exported from Airbridge to Amazon S3. The integration setup will only be complete once the connection has been tested.
1. Click Connection test in the Airbridge dashboard.
2. Wait for about 10 seconds for the test to complete. If the test succeeds, the connection you created has been successfully saved.
If the test fails, check the information you submitted to Airbridge and test the connection again. If you leave the page without succeeding the test, your changes won’t be saved and you will have to start over the integration process.
Find out how to edit credentials or delete connections for integration.
If your Amazon S3 credentials have changed, you must update them in Airbridge as well by following the steps below.
1. Navigate to [Integrations]>[Third-party Integration] in the Airbridge dashboard. Select “Amazon S3.”
2. Click the connection whose Amazon S3 credentials have changed.
3. Click the credential to edit and enter the changed value.
4. Click Done to save.
If you edit the bucket name, region, or file format, you will have to start over the integration process. If you edit the IAM role ARN, you will have to test the connection again.
Follow the steps below to delete a connection and disable integration with Amazon S3.
1. Navigate to [Integrations]>[Third-party Integration] in the Airbridge dashboard. Select “Amazon S3.”
2. Click the connection to delete.
3. Click Delete on the top right corner.
If you want to enable integration with Amazon S3 again after deleting a connection, start over the integration process.
Data already pushed from Airbridge to Amazon isn’t affected even though you delete a connection.
If the integration status shows “Error” on the [Integrations]>[Third-party Integration] page, you must submit the credentials again.
The error message is also shown in the [Integrations]>[Integration Overview] page. Click on the notification to move to the cloud storage integration page and resolve the error.
Once the integration setup is complete, you can view the integration status by data source on the cloud storage integration page.
Refer to the below for details about integration status and data export schedule.
Status | Description |
|---|---|
Waiting | The credentials have been submitted, but no data has been pushed yet. |
Success | The daily data has been successfully pushed to the cloud storage. |
Error | The data hasn’t been pushed due to an error with the credentials or others. |
No Data | The integration is enabled, but there is no data to push to the cloud storage. |
The status will show “Waiting” right after the credentials are submitted and will change to “Success” when data is pushed for the first time.
Data is pushed to cloud storage daily at 7:00 PM (UTC), regardless of your app time zone setup.
Because Airbridge collects events that occurred up to 24 hours ago, the event occurrence dat, the event collection date, and the data export date may differ from one another. All events occurred on the same day are saved with the same path within the Amazon S3 bucket integrated with Airbridge.
Note
Once your Amazon S3 integration setup is complete, data will be pushed to cloud storage starting at the next 7:00 PM (UTC). The data will be saved as .csv.gz files with the following paths within the bucket integrated with Airbridge:
App events:
${YOUR-BUCKET-NAME}/${YOUR-APP-NAME}/app/${VERSION}/date=${year}-${month}-${day}/Web events:
${YOUR-BUCKET-NAME}/${YOUR-APP-NAME}/web/${VERSION}/date=${year}-${month}-${day}/Tracking link events:
${YOUR-BUCKET-NAME}/${YOUR-APP-NAME}/tracking-link/${VERSION}/date=${year}-${month}-${day}/
Each file, created per event, uses the values from the Field Name column of the Airbridge Data Spec spreadsheet as the column names.
Airbridge supports free integration with a single cloud storage. Additional charges apply for integrating with two or more cloud storages.
The cloud storage integration status is shown under the name of each cloud storage on the [Integrations]>[Third-party Integration] page.
Refer to the table below for details about cloud storage integration status. You can also view the integration status specific to each data source.
Status | Description |
|---|---|
(No status shown) | The credentials have not been submitted, or the integration status is unknown. |
Configured | The credentials have been submitted, and the data is being successfully pushed to the cloud storage. |
Error | The data hasn’t been pushed due to an error. |
Closed | The cloud storage is not in use. To connect, reach out to your Airbridge CSM. |
Note
Those using IAM role-based connections don’t have to take any action.
Airbridge will deprecate all access key-based connections with Amazon S3 on July 1, 2024. To continue exporting data to Amazon S3, complete the steps below by June 30, 2024.
1. Review your project timeline. To avoid data loss, all of the remaining steps should be completed within a 22-hour timeframe, between 9:00 PM (UTC) and 7:00 PM (UTC) the next day. You may modify your code to adjust columns in Amazon S3 in advance, but refrain from deployment.
2. When you disable and then re-enable integration with cloud storage, the integration version is updated to the latest version. Adjust columns in Amazon S3 in line with the latest integration version.
For more information about the columns, refer to this article.
3. Delete access key-based connections. For detailed instructions, refer to this article.
4. Create an IAM role-based connection. For detailed instructions, refer to this article.
A newly created connection always uses the latest integration version. As the exported columns vary depending on the integration version, check whether the columns need to be adjusted before creating a connection to prevent any issues.
Note
Was this page helpful?