Gcp Dataflow
作者 gemini-cli-extensions2df10e25bbf7Apache-2.0215 个星标收录于 2026年10月8日更新于 2026年10月8日仓库今天更新
Guides writing, packaging, executing, and troubleshooting Apache Beam pipelines on Dataflow. Use when creating new pipelines, configuring Flex Templates, or analyzing performance of Dataflow jobs. Capabilities include Java/Python/Go setup, Cloud Build integration, and deep diagnostic analysis of job health and autoscaling. Use when: - Creating an Apache Beam Dataflow pipeline. - Creating a Google Dataflow Flex Template. - Using an existing Google Dataflow Template. - Debugging Dataflow pipeline - Troubleshooting Dataflow pipeline - Analyzing Performance of Dataflow pipeline. Key capabilities: Java/Python/Go project setup, Flex Templates (with Cloud Build), and diagnostics for streaming job health, bottlenecks, and autoscaling. Do NOT use for: - General GCP resource management unrelated to Dataflow. - Issues with other GCP services (e.g., GCE, GCS, BigQuery) unless directly impacting Dataflow pipeline execution. - Pipeline technologies other than Apache Beam on Dataflow.
添加到 SourceWeft 工作区
- 在控制台中打开该技能，并将它添加到工作区。
- 为需要使用它的对话启用该技能。
该技能仅含说明：不附带任何可执行的脚本。
添加到 SourceWeft系统会先要求你登录，然后直接带你回到这个技能。
让你的智能体来安装
把这段提示词粘贴到 Claude Code、Codex、Cursor 或其他能运行命令的智能体中，也可以粘贴到 SourceWeft 对话里。智能体会阅读这个技能的安装说明，向你展示它的来源、许可证和脚本情况，在你同意后用 SourceWeft CLI 安装。
阅读 https://sourceweft.com/skills/gh-gemini-cli-extensions-data-agent-kit-starter-pack-gcp-dataflow/install.md 中的说明，按说明安装这个技能。安装前先告诉我它的来源、许可证以及是否附带脚本，等我确认。修改我电脑上的其他任何内容之前也要先问我。用命令行自行安装
适用于 Claude Code、Codex、Cursor 及其他本地智能体。SourceWeft CLI 会从源代码仓库中获取此处扫描过的那次提交，并根据扫描时记录的哈希值逐一校验每个文件。只要有任何不一致，就不会写入任何内容。
npx @sourceweft/cli skills install gh-gemini-cli-extensions-data-agent-kit-starter-pack-gcp-dataflow添加 --agent claude-code、codex、cursor 或 universal 来选择安装给哪个智能体（默认为 Claude Code）。
上游安装器——未经 SourceWeft 校验
开源的 skills 安装器会获取同一个固定的提交，但不会根据 SourceWeft 记录的哈希值校验文件。
npx skills add https://github.com/gemini-cli-extensions/data-agent-kit-starter-pack/tree/2df10e25bbf7dba2570dce1b2e2e77870143969e/skills/gcp-dataflow来源与署名
来源：gemini-cli-extensions/data-agent-kit-starter-pack位于skills/gcp-dataflow提交2df10e2
许可证： Apache-2.0
内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。
更多来自 gemini-cli-extensions/data-agent-kit-starter-pack 的技能
Schema Mapping
gemini-cli-extensions
为 ETL、ELT 或数据集成任务规划源到目标的模式映射，产出文档化的映射宣言。
Resolving Mcp Region Configs
gemini-cli-extensions
修复区域级 Google Cloud MCP 服务器配置中未替换的区域占位符，使缺失的 MCP 工具得以注册。
Notebook Guidance
gemini-cli-extensions
This skill guides the use of Jupyter notebooks for data analysis, exploration, and visualization, particularly with BigQuery. It outlines best practices for notebook execution and validation (supporting both cell-by-cell execution and full notebook generation depending on tool availability), library installation, and structuring notebooks for clarity. It also covers specific rules for data cleaning, plotting, and integrating with BigQuery SQL and machine learning workflows. Relevant when any of the following conditions are true: 1. The user request involves a data analysis, data exploration, data visualization, or data insights task that requires multiple steps, queries, or visualizations to answer. 2. The user explicitly requests a notebook (.ipynb). 3. You are creating, editing, or executing cells in a Jupyter notebook. 4. You need to query BigQuery from within a notebook. DO NOT use the Python BigQuery client library; instead, you MUST use the `%%bqsql` magics explained in this skill.
Ml Best Practices
gemini-cli-extensions
为机器学习笔记本提供分步方案，涵盖聚类、预测、分类、回归和模型比较。
Managing Python Dependencies
gemini-cli-extensions
指导代理检测 Python 项目的依赖管理器并正确安装依赖，而不是使用全局 pip。
Google Cloud Storage Fuse
gemini-cli-extensions
Mounts Cloud Storage buckets as a POSIX file system with Cloud Storage FUSE (gcsfuse). Use when you need to interact with gcsfuse — decide whether FUSE, native gs:// reads, or Filestore/Managed Lustre fits a workload, deploy tuned mounts on GKE, Compute Engine, or Cloud Run, enable and size the file, stat, and list caches, tune mount flags or config-file settings, apply workload profiles, keep ML checkpointing safe (rename atomicity, hierarchical namespace, close-time finalization, concurrent writers), or diagnose slow training, low throughput, or GCS bill spikes on existing mounts with gcsfuse metrics. Covers mount semantics, the gcsfuse CLI and config file, the GKE gcsfuse CSI driver (Workload Identity principal:// bindings, profile StorageClasses, sidecar sizing), and Cloud Run volume mounts. Don't use for bucket administration or data management without a mount (google-cloud-storage-basics) or for fully POSIX-compliant shared file systems (Filestore, Managed Lustre).
更多DevOps & Cloud技能
M5 Onboard
anthropics
通过 USB 检测 M5Stack ESP32 开发板，刷写 UIFlow 2.0 固件并安装 MicroPython 应用包。
Spanner Basics
指导 Google Cloud Spanner 的实例与数据库管理、架构设计、查询和性能诊断。
Secops Cases
通过 MCP 工具管理 Google Security Operations SOAR 案例的整个生命周期。
Managed Airflow Migrations
指导将 Apache Airflow DAG 迁移到 Managed Service for Apache Airflow 中的 Airflow 2.11.1 或 Airflow 3。
Managed Airflow Dag Troubleshooting
指导使用 gcloud 命令对 Managed Service for Apache Airflow 中失败的 DAG 运行和任务实例进行确定性排查。
Iam Helper For Privileged Access Management
指导 Google Cloud Privileged Access Manager 的权限配置增删改查、临时访问申请与授权审批流程。