Spark Engineer
by jeffallan1be15d8064f8MIT11K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated 5 days ago
Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
Only the file list is public. File contents are available once the skill is installed in a workspace.
| Path | Size | Type |
|---|---|---|
| references/partitioning-caching.md | 14.5 KB | text/markdown |
| references/performance-tuning.md | 15.5 KB | text/markdown |
| references/rdd-operations.md | 16 KB | text/markdown |
| references/spark-sql-dataframes.md | 13.5 KB | text/markdown |
| references/streaming-patterns.md | 20 KB | text/markdown |
| SKILL.md | 6.6 KB | text/markdown |
Source and attribution
Source:jeffallan/claude-skillsinskills/spark-engineerat commit1be15d8
License: MIT
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from jeffallan/claude-skills
Wordpress Pro
jeffallan
Guides WordPress theme, plugin, Gutenberg block, and WooCommerce development with security and performance practices.
Vue Expert Js
jeffallan
Builds Vue 3 apps in JavaScript only, using JSDoc annotations instead of TypeScript.
The Fool
jeffallan
Applies five structured critical-reasoning modes to stress-test ideas, plans, and decisions.
Swift Expert
jeffallan
Guides Swift 5.9+ development for Apple platforms, covering SwiftUI, async/await, actors, protocols and testing.
Sql Pro
jeffallan
Guides SQL query optimization, database schema design, and performance troubleshooting across major dialects.
Spring Boot Engineer
jeffallan
Guides Spring Boot 3.x backend implementation: REST controllers, JPA data access, Security 6, WebFlux and testing.
More in Data & Analytics
Content Strategy
anthropics
Turns PayPal, QuickBooks or Square sales data into a prioritized 30-day content brief for small businesses.
Cash Flow Snapshot
anthropics
Builds a 30/60/90-day cash flow forecast with confidence bands and named risk flags from ledger, payment or CSV data.
Pipeline Review
anthropics
Reviews CRM sales pipeline health by stage, flagging aging, stale and at-risk deals and checking coverage.
Metrics Review
anthropics
Reviews product metrics, analyzes trends against targets, and produces a scorecard with recommended actions.
Performance Report
anthropics
Builds marketing performance reports with key metrics, trend analysis, wins and misses, and prioritized optimization recommendations.
People Report
anthropics
Generates HR people-analytics reports on headcount, attrition, diversity, and org health from workforce data.