Skip to main content

​
Overview

Data Sharing via S3 provides businesses with automated transfer of user financial data to their designated Amazon S3 buckets. This service operates on configurable schedules, ensuring businesses receive timely updates without manual intervention.

​
Data Extraction & Transfer Process

​
Process Explanation

  1. Data Sharing Scheduled: The business configures a data sharing schedule based on their requirements (e.g., daily, weekly).
  2. Cron Triggered: At the scheduled interval, a cron job is automatically triggered to initiate the data sharing process.
  3. Fetch All Users of Business: The system retrieves a list of all users associated with the business.
  4. Extract All Available Data: For each user, the system extracts all available financial data including analytics and FI (Financial Information) data (as per business requirement)
  5. Send to Business’s S3 Bucket: The extracted data is transferred to the business’s designated S3 bucket.

​
S3 File Structure

​
File Structure Explanation

The data is organized in the S3 bucket using a hierarchical folder structure:
LevelDescription
bucket_nameThe S3 bucket name shared by the business
dateDate folder for organizing data by transfer date
user_idIndividual folder for each user’s data
ANALYTICSAnalytics data file containing analytics for all FI types
FI_DATARaw financial data file containing all FI types data

​
Example Path

s3-data-bucket/
└── 2024-12-24/
    └── user_12345/
        ├── ANALYTICS
        └── FI_DATA

​
Configuration Requirements

​
S3 Bucket Setup

The data sharing service requires cross-account access between our system and your S3 bucket. This involves configuration on both sides:

​
On Your Side (Business S3 Account)

  • S3 Bucket ARN: Share your S3 bucket ARN with us
  • Bucket Policy: Add our IAM role to your S3 bucket policy to grant write access
Example bucket policy structure: 
{
  "Version": "2012-10-17",
  "Statement": [{
    "Effect": "Allow",
    "Principal": {
      "AWS": "<IAM_ROLE_ARN_PROVIDED_BY_US>"
    },
    "Action": ["s3:PutObject"],
    "Resource": "arn:aws:s3:::your-bucket-name/*"
  }]
}

​
On Our Side

  • IAM Role: We configure an IAM role with access to your S3 bucket ARN and share the role ARN with you for bucket policy configuration

​
Required Information Exchange

  • We Provide - IAM Role ARN (to be added in your bucket policy)
  • You Provide - S3 Bucket ARN