Skip to Content
DestinationsAmazon S3Overview

Amazon S3

Destination — Vendo exports your Shopify e-commerce data and analytics to Amazon S3 as structured files, giving you a portable data lake for custom analytics, ETL pipelines, and long-term archival.

What Vendo Exports

Data Tables

Vendo exports these datasets to your S3 bucket:

DatasetDescriptionFormat
OrdersComplete order data with line itemsParquet / CSV / JSON
CustomersCustomer profiles and lifetime metricsParquet / CSV / JSON
ProductsProduct catalog with variantsParquet / CSV / JSON
EventsClient-side tracking eventsParquet / CSV / JSON
Abandoned CheckoutsAbandoned cart dataParquet / CSV / JSON
Ad PerformanceDaily ad metrics from connected platformsParquet / CSV / JSON

Export Formats

FormatBest For
ParquetAnalytics tools (Athena, Spark, Snowflake) — columnar, compressed
CSVSpreadsheets and simple integrations
JSONCustom processing pipelines

Storage Structure

Files are organized with date-based partitioning:

s3://your-bucket/vendo/ orders/ year=2026/month=03/day=14/ orders_20260314_001.parquet customers/ year=2026/month=03/day=14/ customers_20260314_001.parquet

Platform Details

SettingValue
Sync MethodServer-side export via AWS S3 API
Auth MethodAWS IAM credentials (Access Key + Secret Key)
File FormatsParquet, CSV, JSON
PartitioningDate-based (year/month/day)
CompressionSnappy (Parquet), Gzip (CSV/JSON)
Historical BackfillFull export on first sync

Setup

  1. In the Vendo app, navigate to Destinations > Amazon S3
  2. Enter your S3 Bucket Name and AWS Region
  3. Provide AWS Access Key ID and Secret Access Key with write permissions to the bucket
  4. Select the export format (Parquet, CSV, or JSON)
  5. Configure export schedule and data tables to include
  6. Save — Vendo will begin the initial full export

Required IAM Permissions

Your AWS IAM user or role needs s3:ListBucket, s3:PutObject, and s3:GetObject permissions.

Full bucket access:

{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": ["s3:ListBucket"], "Resource": "arn:aws:s3:::your-bucket" }, { "Effect": "Allow", "Action": ["s3:PutObject", "s3:GetObject"], "Resource": "arn:aws:s3:::your-bucket/*" } ] }

Prefix-scoped access (restrict Vendo to a specific folder):

{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": ["s3:ListBucket"], "Resource": "arn:aws:s3:::your-bucket", "Condition": { "StringLike": { "s3:prefix": ["your-folder/*"] } } }, { "Effect": "Allow", "Action": ["s3:PutObject", "s3:GetObject"], "Resource": "arn:aws:s3:::your-bucket/your-folder/*" } ] }

When using prefix-scoped access, enter the matching folder path in the Path Prefix field during setup. The prefix is the folder path only — do not include the bucket name.

Compatible Sources

Amazon S3 accepts table exports from all Vendo sources:

SourceWhat Vendo Exports
ShopifyOrders, customers, products, events, abandoned checkouts
StripePayments, subscriptions, customers, invoices
Google AdsAd performance metrics, geo data
Meta AdsAd performance metrics, geo data
TikTok AdsAd performance metrics, geo data
Snap AdsAd performance metrics, geo data
Microsoft AdsAd performance metrics, geo data
LinkedIn AdsAd performance metrics, geo data
X AdsAd performance metrics, geo data
MixpanelEvent and user data
SegmentEvent and user data
AmplitudeEvent and user data

Amazon S3 also receives output from SQL models, Python models, and audiences.

Verify Setup

  1. Confirm the Amazon S3 integration status is active in Vendo
  2. Check that files appear in your S3 bucket under the expected path
  3. Verify file contents by querying with Athena or downloading a sample file
  4. Review Vendo integration logs for any export errors
Last updated on