Aidp Spark Optimization
作者 oracle-samples90b42d6c24d4無授權條款收錄於 2026年10月8日更新於 2026年10月8日
Use when a Spark job/notebook is slow, missing an SLA, spilling, OOMing, generating too many small files, or shuffling/skewing heavily; when reviewing Spark/PySpark code or a Spark UI for performance; or before running a large Spark workload. Covers open-source Apache Spark 3.5.0 (+ Delta Lake) tuning -- partitions, shuffle, joins, skew, file layout, memory, codegen, caching, AQE, compression, and configuration.
僅公開檔案列表。將技能安裝到工作區後即可檢視檔案內容。
| 路徑 | 大小 | 類型 |
|---|---|---|
| references/01-partitioning.md | 21.8 KB | text/markdown |
| references/02-joins.md | 24.8 KB | text/markdown |
| references/03-file-layout-io.md | 22 KB | text/markdown |
| references/04-memory-and-spill.md | 16 KB | text/markdown |
| references/05-codegen.md | 15.4 KB | text/markdown |
| references/06-caching-materialization.md | 6.8 KB | text/markdown |
| references/07-aqe.md | 21.1 KB | text/markdown |
| references/08-delta-lake.md | 18 KB | text/markdown |
| references/09-oracle-database.md | 23.1 KB | text/markdown |
| references/aidp-notes.md | 3.9 KB | text/markdown |
| references/case-studies.md | 6.9 KB | text/markdown |
| references/cluster-sizing.md | 6.6 KB | text/markdown |
| references/config-matrix.md | 13.2 KB | text/markdown |
| references/diagnosis.md | 5.3 KB | text/markdown |
| references/quick-reference.md | 6.1 KB | text/markdown |
| SKILL.md | 10.2 KB | text/markdown |
來源與署名
來源：oracle-samples/oracle-aidp-samples位於ai/claude-code-plugins/oracle-ai-data-platform-workbench-engineer-agent/skills/aidp-spark-optimization提交90b42d6
授權條款： 無授權條款
內容歸原作者所有。SourceWeft 從公開儲存庫中收錄這些內容。
更多來自 oracle-samples/oracle-aidp-samples 的技能
Aidp Workspace Admin
oracle-samples
Provision and inspect AIDP DataLake instances and workspaces, including private-network workspaces attached to a customer VCN/subnet. Use when the user wants to create/list/get a workspace or DataLake instance, set up a new (e.g. private) AIDP environment, or replicate a customer setup. Create/delete are guarded — confirm before any provisioning.
Aidp Volumes
oracle-samples
Work with AIDP volumes — list volumes, browse files inside a volume, upload/download via the PAR flow, and create directories. Use when the user mentions volumes, needs to stage large/binary files, or move data in/out of a volume (distinct from the workspace filesystem). Control-plane via the official `aidp` CLI.
Aidp Verified Queries
oracle-samples
維護經過驗證的問題到 Spark SQL 配對庫，讓代理在產生新 SQL 前優先重用可信查詢。
Aidp User Settings
oracle-samples
透過 aidp CLI 或 oci raw-request 備援方式管理 AIDP DataLake 使用者設定與偏好。
Aidp Semantic Model
oracle-samples
維護 .aidp/semantic.md 業務語意層，定義指標、連接、同義詞與值字典，為自然語言轉 SQL 提供依據。
Aidp Roles Access
oracle-samples
管理 AIDP 角色與存取權：列出角色、增減成員，以及授予或撤銷各項資源的權限。
更多Data & Analytics技能
Content Strategy
anthropics
把 PayPal、QuickBooks 或 Square 的銷售資料轉成排序過的 30 天內容簡報。
Cash Flow Snapshot
anthropics
依據帳簿、支付平台或 CSV 資料產出 30/60/90 天現金流預測，含信心區間與具名風險提示。
Pipeline Review
anthropics
依階段檢視 CRM 銷售管道健康狀況，標記老化、停滯與高風險商機並檢查覆蓋率。
Metrics Review
anthropics
檢視產品指標，分析趨勢並與目標對比，產出附建議行動的指標計分卡。
Performance Report
anthropics
產出營銷成效報告，包含關鍵指標、趨勢分析、成功與不足之處，以及依優先順序排列的優化建議。
People Report
anthropics
根據人力資料產出員額編制、流失率、多元性與組織健康度等人才分析報告。