Skip to Content
DestinationsAmazon S3Overview

Amazon S3

Export your Shopify and analytics data to Amazon S3 as Parquet, CSV, or JSON Lines files with partitioned storage.

Last reviewed September 15, 2026

Destination: Vendo exports your Shopify e-commerce data and analytics to Amazon S3 as structured files. You get a portable data lake for custom analytics, ETL pipelines, and long-term archival.

What Vendo Exports

Data Tables

Vendo exports these datasets from the source to your S3 bucket:

DatasetDescriptionFormat
eventsEvent rows from the source (orders for Shopify, charges for Stripe)Parquet / CSV / JSON Lines
set_propertyUser rows from the source (customers, or users for Mixpanel)Parquet / CSV / JSON Lines

Export Formats

FormatBest For
ParquetAnalytics tools (Athena, Spark, Snowflake): columnar, compressed
CSVSpreadsheets and simple tools
JSON LinesCustom processing pipelines

Storage Structure

Vendo puts the files for each dataset in one folder for each day. If a day has more than one batch, Vendo adds a part number to the file name.

s3://your-bucket/your-prefix/ events/ 2026-03-14/ events_2026-03-14.parquet events_2026-03-14_part_002.parquet set_property/ 2026-03-14/ set_property_2026-03-14.parquet

Platform Details

SettingValue
Sync MethodServer-side export through the AWS S3 API
Auth MethodAWS IAM credentials (Access Key + Secret Key)
File FormatsParquet, CSV, JSON Lines
PartitioningDate-based (one YYYY-MM-DD folder for each day)
CompressionSnappy (Parquet). CSV and JSON Lines are not compressed.
Historical BackfillFull export on first sync

Setup

  1. In the Vendo app, go to Destinations > Amazon S3.
  2. Enter your S3 Bucket and AWS Region.
  3. Enter an AWS Access Key ID and AWS Secret Access Key with write permissions to the bucket.
  4. Select the Output Format (Parquet, CSV, or JSON Lines).
  5. Set the export schedule and the data tables to include.
  6. Save the destination. Vendo starts the initial full export.

Required IAM Permissions

Your AWS IAM user or role needs s3:ListBucket, s3:PutObject, and s3:GetObject permissions.

Full bucket access:

{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": ["s3:ListBucket"], "Resource": "arn:aws:s3:::your-bucket" }, { "Effect": "Allow", "Action": ["s3:PutObject", "s3:GetObject"], "Resource": "arn:aws:s3:::your-bucket/*" } ] }

Prefix-scoped access (restrict Vendo to a specific folder):

{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": ["s3:ListBucket"], "Resource": "arn:aws:s3:::your-bucket", "Condition": { "StringLike": { "s3:prefix": ["your-folder/*"] } } }, { "Effect": "Allow", "Action": ["s3:PutObject", "s3:GetObject"], "Resource": "arn:aws:s3:::your-bucket/your-folder/*" } ] }

If you use prefix-scoped access, enter the matching folder path in the Path Prefix (Optional) field during setup. The prefix is the folder path only. Do not include the bucket name.

Compatible Sources

Amazon S3 accepts table exports from all Vendo sources:

SourceWhat Vendo Exports
ShopifyOrders, customers
StripeCharges, customers
Google AdsAd performance metrics, geo data
Meta AdsAd performance metrics, geo data
TikTok AdsAd performance metrics, geo data
Snap AdsAd performance metrics, geo data
Microsoft AdsAd performance metrics, geo data
LinkedIn AdsAd performance metrics, geo data
X AdsAd performance metrics, geo data
MixpanelEvent and user data
SegmentEvent and user data
AmplitudeEvent and user data

Amazon S3 also receives output from SQL models and Python models.

Verify Setup

  1. Confirm that the Amazon S3 destination status is active in Vendo.
  2. Check that files appear in your S3 bucket under the expected path.
  3. Query the files with Athena, or download a sample file, to verify the contents.
  4. Review the Vendo Logs page for export errors.
Need help?

When you contact support, give your workspace, the source or destination name, the job ID and the first error message.

support@vendodata.com
Last updated on