Bulk Data Sharing Design

samber/developer-platform-skills/skills/bulk-data-sharing-design

by samber594cf70d343eMIT3 starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated 10 days ago

Design bulk file and lake export as a B2B product surface - the two-camp choice between Parquet file-drops on object storage and native warehouse/lake sharing (Snowflake shares, Delta Sharing, linked datasets), the partitioning and schema-evolution contract across batches, delivery cadence and freshness commitments (full dump vs incremental vs CDC vs streaming), shared-bucket security with per-recipient credentials, egress cost allocation, and cross-border data residency. Use whenever the user mentions bulk export, data dumps to S3, Parquet, Snowflake shares, Delta Sharing, or export freshness SLAs - even if they never say "bulk data sharing". Do NOT use for live SQL endpoints - use samber/developer-platform-skills@sql-jdbc-access-design instead.

Only the file list is public. File contents are available once the skill is installed in a workspace.

PathSizeType
evals/evals.json30.7 KBapplication/json
references/compliance-and-residency.md3.9 KBtext/markdown
references/file-layout-and-access-control.md6.1 KBtext/markdown
references/vendor-case-studies.md11.4 KBtext/markdown
SKILL.md23.1 KBtext/markdown

Source and attribution

Source:samber/developer-platform-skillsinskills/bulk-data-sharing-designat commit594cf70

License: MIT

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal