Data Storage Standards

S3 naming convention

S3 Bucket Name	Description
b-<ORG>-<ENV>-landing	Raw data of all the incoming events. Stored in parquet format along a hive partition event_date
b-<ORG>-<ENV>-processed	Processed data of the events
b-<ORG>-<ENV>-stg	S3 bucket for Athena staging data
b-<ORG>-<ENV>-outbound	S3 data bucket for outbound data (activation)
b-<ORG>-<ENV>-airbyte-logs	S3 bucket for Airbyte connector logs
b-<ORG>-<ENV>-athena-logs	S3 bucket for Athena query logs
b-<ORG>-<ENV>-athena-mcp-server-logs	S3 bucket for Athena MCP server query logs
b-<ORG>-<ENV>-emr	S3 logs bucket for EMR cluster

Athena schema naming standard

Schema Name	Tables
<ORG>_<ENV>	view_core_events, view_events_sessions, view_unique_events, view_users, view_id_graph, unified_events. Click here for data dictionary
<SOURCE_NAME>_<ENV>	ELT source tables. source_name and env are the pipeline name and environment (tag) configured in the Web Application