Spark Optimization
by wshobson46891e7e60daNo licenseListed Oct 8, 2026Updated Oct 8, 2026
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
Only the file list is public. File contents are available once the skill is installed in a workspace.
| Path | Size | Type |
|---|---|---|
| references/details.md | 9.6 KB | text/markdown |
| SKILL.md | 3.1 KB | text/markdown |
Source and attribution
Source:wshobson/agentsinplugins/data-engineering/skills/spark-optimizationat commit46891e7
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from wshobson/agents
Uv Package Manager
wshobson
Reference guide for using the uv Python package manager for dependencies, virtual environments and project workflows.
Web Component Design
wshobson
Guides building reusable UI components in React, Vue and Svelte, covering composition patterns, CSS-in-JS choices and component API design.
Python Type Safety
wshobson
Guides Python type annotations, generics, protocols, and strict mypy/pyright checking.
Visual Design Foundations
wshobson
Guides typography, color, spacing and iconography decisions for cohesive, accessible visual design systems.
Responsive Design
wshobson
Guides implementation of responsive web layouts using container queries, fluid typography, CSS Grid and breakpoints.
Python Resource Management
wshobson
Guides Python developers in managing resources deterministically with context managers, cleanup patterns, and streaming.
More in Data & Analytics
Content Strategy
anthropics
Turns PayPal, QuickBooks or Square sales data into a prioritized 30-day content brief for small businesses.
Cash Flow Snapshot
anthropics
Builds a 30/60/90-day cash flow forecast with confidence bands and named risk flags from ledger, payment or CSV data.
Pipeline Review
anthropics
Reviews CRM sales pipeline health by stage, flagging aging, stale and at-risk deals and checking coverage.
Metrics Review
anthropics
Reviews product metrics, analyzes trends against targets, and produces a scorecard with recommended actions.
Performance Report
anthropics
Builds marketing performance reports with key metrics, trend analysis, wins and misses, and prioritized optimization recommendations.
People Report
anthropics
Generates HR people-analytics reports on headcount, attrition, diversity, and org health from workforce data.