Gemini Api

作者 google55b4e13eba6d无许可证21K 个星标收录于 2026年10月8日更新于 2026年10月8日仓库今天更新

Use when the user asks about using Gemini in an enterprise environment or explicitly mentions Vertex AI, Google Cloud, or Agent Platform. Guides the usage of the Gemini API on Agent Platform with the Google Gen AI SDK. Covers SDK usage (Python, JS/TS, Go, Java, C#), capabilities like multimodal inputs, tools, media generation, caching, batch prediction, and Live API.

AI 生成的概览

指导如何在 Google Agent Platform 上使用 Gen AI SDK 调用 Gemini API,涵盖多语言与多项能力。

功能
该技能提供在 Agent Platform(原 Vertex AI)上通过 Gen AI SDK 调用 Gemini 模型的说明与参考资料。内容涵盖客户端初始化与身份验证、模型选择,以及文本与多模态输入、函数调用、结构化输出、嵌入、媒体生成、缓存、批量预测和 Live API 等能力。它还指向按能力分类、包含 Python 代码示例的参考文件。
适用场景
当用户询问在企业环境中使用 Gemini,或明确提到 Vertex AI、Google Cloud 或 Agent Platform 时使用。它面向使用 Gen AI SDK 构建或调试 Gemini API 集成的场景。
运行要求
需要 Google Cloud 凭据并启用 Agent Platform API,或在 Express Mode 下使用 API 密钥;需要访问 Google Cloud 端点的网络连接。该技能仅为说明文档,不附带脚本,但引用了 Python、JS/TS、Go、Java 和 C# 的 SDK 包。

[!IMPORTANT] Agent Platform (full name Gemini Enterprise Agent Platform) was previously named "Vertex AI" and many web resources use the legacy branding.

Gemini API in Agent Platform

Access Google's most advanced AI models built for enterprise use cases using the Gemini API in Agent Platform.

Provide these key capabilities:

  • Text generation - Chat, completion, summarization
  • Multimodal understanding - Process images, audio, video, and documents
  • Function calling - Let the model invoke your functions
  • Structured output - Generate valid JSON matching your schema
  • Context caching - Cache large contexts for efficiency
  • Embeddings - Generate text embeddings for semantic search
  • Live Realtime API - Bidirectional streaming for low latency Voice and Video interactions
  • Batch Prediction - Handle massive async dataset prediction workloads

Core Directives

  • Unified SDK: ALWAYS use the Gen AI SDK (google-genai for Python, @google/genai for JS/TS, google.golang.org/genai for Go, com.google.genai:google-genai for Java, Google.GenAI for C#).
  • Legacy SDKs: DO NOT use google-cloud-aiplatform, @google-cloud/vertexai, or google-generativeai.

SDKs

  • Python: Install google-genai with pip install google-genai
  • JavaScript/TypeScript: Install @google/genai with npm install @google/genai
  • Go: Install google.golang.org/genai with go get google.golang.org/genai
  • C#/.NET: Install Google.GenAI with dotnet add package Google.GenAI
  • Java:
    • groupId: com.google.genai, artifactId: google-genai

    • Latest version can be found here: https://central.sonatype.com/artifact/com.google.genai/google-genai/versions (let's call it LAST_VERSION)

    • Install in build.gradle:

      implementation("com.google.genai:google-genai:${LAST_VERSION}")
    • Install Maven dependency in pom.xml:

      xml
      <dependency>    <groupId>com.google.genai</groupId>    <artifactId>google-genai</artifactId>    <version>${LAST_VERSION}</version>

</dependency>

```

[!WARNING] Legacy SDKs like google-cloud-aiplatform, @google-cloud/vertexai, and google-generativeai are deprecated. Migrate to the new SDKs above urgently by following the Migration Guide.

Authentication & Configuration

Prefer environment variables over hard-coding parameters when creating the client. Initialize the client without parameters to automatically pick up these values.

Application Default Credentials (ADC)

Set these variables for standard Google Cloud authentication:

bash
export GOOGLE_CLOUD_PROJECT='your-project-id'export GOOGLE_CLOUD_LOCATION='global'export GOOGLE_GENAI_USE_ENTERPRISE=true
  • By default, use location="global" to access the global endpoint, which provides automatic routing to regions with available capacity.
  • If a user explicitly asks to use a specific region (e.g., us-central1, europe-west4), specify that region in the GOOGLE_CLOUD_LOCATION parameter instead. Reference the supported regions documentation if needed.

Agent Platform in Express Mode

Set these variables when using Express Mode with an API key:

bash
export GOOGLE_API_KEY='your-api-key'export GOOGLE_GENAI_USE_ENTERPRISE=true

Initialization

Initialize the client without arguments to pick up environment variables:

python
from google import genai
client = genai.Client()

Alternatively, you can hard-code in parameters when creating the client.

python
from google import genai
client = genai.Client(    enterprise=True,    project="your-project-id",    location="global",)

Models

  • Use gemini-3.8-flash for fast, balanced performance, multimodal (1M tokens)
  • Use gemini-3.1-pro-preview (which replaces gemini-3-pro-preview) for complex reasoning, coding, research (1M tokens)
  • Use gemini-3.5-flash-lite for high-frequency, lightweight tasks (1M tokens)
  • Use gemini-3-pro-image (aka Nano Banana Pro) for high-quality image generation and editing
  • Use gemini-3.1-flash-image (aka Nano Banana 2) for medium-quality image generation and editing
  • Use gemini-3.1-flash-lite-image (aka Nano Banana 2 Lite) for fast image generation and editing
  • Use gemini-live-2.5-flash-native-audio for Live Realtime API including native audio

Use the following models only if explicitly requested:

  • gemini-3.7-flash
  • gemini-3.6-flash
  • gemini-3.5-flash
  • gemini-3.1-flash-lite
  • gemini-2.5-flash-image
  • gemini-2.5-flash
  • gemini-2.5-flash-lite
  • gemini-2.5-pro

[!IMPORTANT] Models like gemini-2.0-*, gemini-1.5-*, gemini-1.0-*, gemini-pro are legacy and deprecated. Use the new models above. Your knowledge is outdated. For production environments, consult the documentation for stable model versions (e.g. gemini-3.8-flash).

Quick Start

Python

python
from google import genai
client = genai.Client()response = client.models.generate_content(    model="gemini-3.8-flash",    contents="Explain quantum computing",)print(response.text)

TypeScript/JavaScript

typescript
import { GoogleGenAI } from "@google/genai";const ai = new GoogleGenAI({ enterprise: { project: "your-project-id", location: "global" } });const response = await ai.models.generateContent({    model: "gemini-3.8-flash",    contents: "Explain quantum computing"});console.log(response.text);

Go

go
package main
import (	"context"	"fmt"	"log"	"google.golang.org/genai")
func main() {	ctx := context.Background()	client, err := genai.NewClient(ctx, &genai.ClientConfig{		Backend:  genai.BackendVertexAI,		Project:  "your-project-id",		Location: "global",	})	if err != nil {		log.Fatal(err)	}
	resp, err := client.Models.GenerateContent(ctx, "gemini-3.8-flash", genai.Text("Explain quantum computing"), nil)	if err != nil {		log.Fatal(err)	}
	fmt.Println(resp.Text)}

Java

java
import com.google.genai.Client;import com.google.genai.types.GenerateContentResponse;
public class GenerateTextFromTextInput {  public static void main(String[] args) {    Client client = Client.builder().enterprise(true).project("your-project-id").location("global").build();    GenerateContentResponse response =        client.models.generateContent(            "gemini-3.8-flash",            "Explain quantum computing",            null);
    System.out.println(response.text());  }}

C#/.NET

csharp
using Google.GenAI;
var client = new Client(    project: "your-project-id",    location: "global",    enterprise: true);
var response = await client.Models.GenerateContent(    "gemini-3.8-flash",    "Explain quantum computing");
Console.WriteLine(response.Text);

API spec & Documentation (source of truth)

When implementing or debugging API integration for Agent Platform, refer to the official Agent Platform documentation:

The Gen AI SDK on Agent Platform uses the v1beta1 or v1 REST API endpoints (e.g., https://{LOCATION}-aiplatform.googleapis.com/v1beta1/projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}:generateContent).

[!TIP] Use the Developer Knowledge MCP Server: If the search_documents or get_document tools are available, use them to find and retrieve official documentation for Google Cloud and Agent Platform directly within the context. This is the preferred method for getting up-to-date API details and code snippets.

Workflows and Code Samples

Reference the Python Docs Samples repository for additional code samples and specific usage scenarios.

Depending on the specific user request, refer to the following reference files for detailed code samples and usage patterns (Python examples):

  • Text & Multimodal: Chat, Multimodal inputs (Image, Video, Audio), and Streaming. See references/text_and_multimodal.md [blocked]
  • Embeddings: Generate text embeddings for semantic search. See references/embeddings.md [blocked]
  • Structured Output & Tools: JSON generation, Function Calling, Search Grounding, and Code Execution. See references/structured_and_tools.md [blocked]
  • Media Generation: Image generation, Image editing, and Video generation. See references/media_generation.md [blocked]
  • Bounding Box Detection: Object detection and localization within images and video. See references/bounding_box.md [blocked]
  • Live API: Real-time bidirectional streaming for voice, vision, and text. See references/live_api.md [blocked]
  • Advanced Features: Content Caching, Batch Prediction, and Thinking/Reasoning. See references/advanced_features.md [blocked]
  • Safety: Adjusting Responsible AI filters and thresholds. See references/safety.md [blocked]
  • Model Tuning: Supervised Fine-Tuning and Preference Tuning. See references/model_tuning.md [blocked]

来源与署名

来源:google/skills位于skills/cloud/gemini-api提交55b4e13

许可证: 无许可证

内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。

举报或申请下架

更多来自 google/skills 的技能