Gcp Dataflow
作者 gemini-cli-extensions2df10e25bbf7Apache-2.0215 个星标收录于 2026年10月8日更新于 2026年10月8日仓库今天更新
Guides writing, packaging, executing, and troubleshooting Apache Beam pipelines on Dataflow. Use when creating new pipelines, configuring Flex Templates, or analyzing performance of Dataflow jobs. Capabilities include Java/Python/Go setup, Cloud Build integration, and deep diagnostic analysis of job health and autoscaling. Use when: - Creating an Apache Beam Dataflow pipeline. - Creating a Google Dataflow Flex Template. - Using an existing Google Dataflow Template. - Debugging Dataflow pipeline - Troubleshooting Dataflow pipeline - Analyzing Performance of Dataflow pipeline. Key capabilities: Java/Python/Go project setup, Flex Templates (with Cloud Build), and diagnostics for streaming job health, bottlenecks, and autoscaling. Do NOT use for: - General GCP resource management unrelated to Dataflow. - Issues with other GCP services (e.g., GCE, GCS, BigQuery) unless directly impacting Dataflow pipeline execution. - Pipeline technologies other than Apache Beam on Dataflow.
- 2df10e25bbf7当前提交 2df10e2发布于 2026年10月8日
来源与署名
来源：gemini-cli-extensions/data-agent-kit-starter-pack位于skills/gcp-dataflow提交2df10e2
许可证： Apache-2.0
内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。
更多来自 gemini-cli-extensions/data-agent-kit-starter-pack 的技能
Schema Mapping
gemini-cli-extensions
为 ETL、ELT 或数据集成任务规划源到目标的模式映射，产出文档化的映射宣言。
Resolving Mcp Region Configs
gemini-cli-extensions
修复区域级 Google Cloud MCP 服务器配置中未替换的区域占位符，使缺失的 MCP 工具得以注册。
Notebook Guidance
gemini-cli-extensions
This skill guides the use of Jupyter notebooks for data analysis, exploration, and visualization, particularly with BigQuery. It outlines best practices for notebook execution and validation (supporting both cell-by-cell execution and full notebook generation depending on tool availability), library installation, and structuring notebooks for clarity. It also covers specific rules for data cleaning, plotting, and integrating with BigQuery SQL and machine learning workflows. Relevant when any of the following conditions are true: 1. The user request involves a data analysis, data exploration, data visualization, or data insights task that requires multiple steps, queries, or visualizations to answer. 2. The user explicitly requests a notebook (.ipynb). 3. You are creating, editing, or executing cells in a Jupyter notebook. 4. You need to query BigQuery from within a notebook. DO NOT use the Python BigQuery client library; instead, you MUST use the `%%bqsql` magics explained in this skill.
Ml Best Practices
gemini-cli-extensions
为机器学习笔记本提供分步方案，涵盖聚类、预测、分类、回归和模型比较。
Managing Python Dependencies
gemini-cli-extensions
指导代理检测 Python 项目的依赖管理器并正确安装依赖，而不是使用全局 pip。
Google Cloud Storage Fuse
gemini-cli-extensions
Mounts Cloud Storage buckets as a POSIX file system with Cloud Storage FUSE (gcsfuse). Use when you need to interact with gcsfuse — decide whether FUSE, native gs:// reads, or Filestore/Managed Lustre fits a workload, deploy tuned mounts on GKE, Compute Engine, or Cloud Run, enable and size the file, stat, and list caches, tune mount flags or config-file settings, apply workload profiles, keep ML checkpointing safe (rename atomicity, hierarchical namespace, close-time finalization, concurrent writers), or diagnose slow training, low throughput, or GCS bill spikes on existing mounts with gcsfuse metrics. Covers mount semantics, the gcsfuse CLI and config file, the GKE gcsfuse CSI driver (Workload Identity principal:// bindings, profile StorageClasses, sidecar sizing), and Cloud Run volume mounts. Don't use for bucket administration or data management without a mount (google-cloud-storage-basics) or for fully POSIX-compliant shared file systems (Filestore, Managed Lustre).
更多DevOps & Cloud技能
M5 Onboard
anthropics
通过 USB 检测 M5Stack ESP32 开发板，刷写 UIFlow 2.0 固件并安装 MicroPython 应用包。
Spanner Basics
指导 Google Cloud Spanner 的实例与数据库管理、架构设计、查询和性能诊断。
Secops Cases
通过 MCP 工具管理 Google Security Operations SOAR 案例的整个生命周期。
Managed Airflow Migrations
指导将 Apache Airflow DAG 迁移到 Managed Service for Apache Airflow 中的 Airflow 2.11.1 或 Airflow 3。
Managed Airflow Dag Troubleshooting
指导使用 gcloud 命令对 Managed Service for Apache Airflow 中失败的 DAG 运行和任务实例进行确定性排查。
Iam Helper For Privileged Access Management
指导 Google Cloud Privileged Access Manager 的权限配置增删改查、临时访问申请与授权审批流程。