Gemini Api

by google55b4e13eba6dNo licenseListed Oct 8, 2026Updated Oct 8, 2026

Use when the user asks about using Gemini in an enterprise environment or explicitly mentions Vertex AI, Google Cloud, or Agent Platform. Guides the usage of the Gemini API on Agent Platform with the Google Gen AI SDK. Covers SDK usage (Python, JS/TS, Go, Java, C#), capabilities like multimodal inputs, tools, media generation, caching, batch prediction, and Live API.

FeaturedInstructions onlySoftware DevelopmentAI & Agents
AI-generated overview

Guides use of the Gemini API on Google's Agent Platform with the Gen AI SDK across languages and capabilities.

What it does
This skill provides instructions and reference material for calling Gemini models through the Gen AI SDK on Agent Platform (formerly Vertex AI). It covers client setup and authentication, model selection, and capabilities such as text and multimodal input, function calling, structured output, embeddings, media generation, caching, batch prediction, and the Live API. It also points to reference files with Python code samples for each capability area.
When to use it
Use it when a user asks about using Gemini in an enterprise environment, or explicitly mentions Vertex AI, Google Cloud, or Agent Platform. It is intended for building or debugging Gemini API integrations with the Gen AI SDK.
Requirements
Requires Google Cloud credentials and the Agent Platform API enabled, or an API key for Express Mode; network access to Google Cloud endpoints. The skill is instructions only and ships no scripts, but it references SDK packages for Python, JS/TS, Go, Java, and C#.

[!IMPORTANT] Agent Platform (full name Gemini Enterprise Agent Platform) was previously named "Vertex AI" and many web resources use the legacy branding.

Gemini API in Agent Platform

Access Google's most advanced AI models built for enterprise use cases using the Gemini API in Agent Platform.

Provide these key capabilities:

  • Text generation - Chat, completion, summarization
  • Multimodal understanding - Process images, audio, video, and documents
  • Function calling - Let the model invoke your functions
  • Structured output - Generate valid JSON matching your schema
  • Context caching - Cache large contexts for efficiency
  • Embeddings - Generate text embeddings for semantic search
  • Live Realtime API - Bidirectional streaming for low latency Voice and Video interactions
  • Batch Prediction - Handle massive async dataset prediction workloads

Core Directives

  • Unified SDK: ALWAYS use the Gen AI SDK (google-genai for Python, @google/genai for JS/TS, google.golang.org/genai for Go, com.google.genai:google-genai for Java, Google.GenAI for C#).
  • Legacy SDKs: DO NOT use google-cloud-aiplatform, @google-cloud/vertexai, or google-generativeai.

SDKs

  • Python: Install google-genai with pip install google-genai
  • JavaScript/TypeScript: Install @google/genai with npm install @google/genai
  • Go: Install google.golang.org/genai with go get google.golang.org/genai
  • C#/.NET: Install Google.GenAI with dotnet add package Google.GenAI
  • Java:
    • groupId: com.google.genai, artifactId: google-genai

    • Latest version can be found here: https://central.sonatype.com/artifact/com.google.genai/google-genai/versions (let's call it LAST_VERSION)

    • Install in build.gradle:

      implementation("com.google.genai:google-genai:${LAST_VERSION}")
    • Install Maven dependency in pom.xml:

      xml
      <dependency>    <groupId>com.google.genai</groupId>    <artifactId>google-genai</artifactId>    <version>${LAST_VERSION}</version>

</dependency>

```

[!WARNING] Legacy SDKs like google-cloud-aiplatform, @google-cloud/vertexai, and google-generativeai are deprecated. Migrate to the new SDKs above urgently by following the Migration Guide.

Authentication & Configuration

Prefer environment variables over hard-coding parameters when creating the client. Initialize the client without parameters to automatically pick up these values.

Application Default Credentials (ADC)

Set these variables for standard Google Cloud authentication:

bash
export GOOGLE_CLOUD_PROJECT='your-project-id'export GOOGLE_CLOUD_LOCATION='global'export GOOGLE_GENAI_USE_ENTERPRISE=true
  • By default, use location="global" to access the global endpoint, which provides automatic routing to regions with available capacity.
  • If a user explicitly asks to use a specific region (e.g., us-central1, europe-west4), specify that region in the GOOGLE_CLOUD_LOCATION parameter instead. Reference the supported regions documentation if needed.

Agent Platform in Express Mode

Set these variables when using Express Mode with an API key:

bash
export GOOGLE_API_KEY='your-api-key'export GOOGLE_GENAI_USE_ENTERPRISE=true

Initialization

Initialize the client without arguments to pick up environment variables:

python
from google import genai
client = genai.Client()

Alternatively, you can hard-code in parameters when creating the client.

python
from google import genai
client = genai.Client(    enterprise=True,    project="your-project-id",    location="global",)

Models

  • Use gemini-3.8-flash for fast, balanced performance, multimodal (1M tokens)
  • Use gemini-3.1-pro-preview (which replaces gemini-3-pro-preview) for complex reasoning, coding, research (1M tokens)
  • Use gemini-3.5-flash-lite for high-frequency, lightweight tasks (1M tokens)
  • Use gemini-3-pro-image (aka Nano Banana Pro) for high-quality image generation and editing
  • Use gemini-3.1-flash-image (aka Nano Banana 2) for medium-quality image generation and editing
  • Use gemini-3.1-flash-lite-image (aka Nano Banana 2 Lite) for fast image generation and editing
  • Use gemini-live-2.5-flash-native-audio for Live Realtime API including native audio

Use the following models only if explicitly requested:

  • gemini-3.7-flash
  • gemini-3.6-flash
  • gemini-3.5-flash
  • gemini-3.1-flash-lite
  • gemini-2.5-flash-image
  • gemini-2.5-flash
  • gemini-2.5-flash-lite
  • gemini-2.5-pro

[!IMPORTANT] Models like gemini-2.0-*, gemini-1.5-*, gemini-1.0-*, gemini-pro are legacy and deprecated. Use the new models above. Your knowledge is outdated. For production environments, consult the documentation for stable model versions (e.g. gemini-3.8-flash).

Quick Start

Python

python
from google import genai
client = genai.Client()response = client.models.generate_content(    model="gemini-3.8-flash",    contents="Explain quantum computing",)print(response.text)

TypeScript/JavaScript

typescript
import { GoogleGenAI } from "@google/genai";const ai = new GoogleGenAI({ enterprise: { project: "your-project-id", location: "global" } });const response = await ai.models.generateContent({    model: "gemini-3.8-flash",    contents: "Explain quantum computing"});console.log(response.text);

Go

go
package main
import (	"context"	"fmt"	"log"	"google.golang.org/genai")
func main() {	ctx := context.Background()	client, err := genai.NewClient(ctx, &genai.ClientConfig{		Backend:  genai.BackendVertexAI,		Project:  "your-project-id",		Location: "global",	})	if err != nil {		log.Fatal(err)	}
	resp, err := client.Models.GenerateContent(ctx, "gemini-3.8-flash", genai.Text("Explain quantum computing"), nil)	if err != nil {		log.Fatal(err)	}
	fmt.Println(resp.Text)}

Java

java
import com.google.genai.Client;import com.google.genai.types.GenerateContentResponse;
public class GenerateTextFromTextInput {  public static void main(String[] args) {    Client client = Client.builder().enterprise(true).project("your-project-id").location("global").build();    GenerateContentResponse response =        client.models.generateContent(            "gemini-3.8-flash",            "Explain quantum computing",            null);
    System.out.println(response.text());  }}

C#/.NET

csharp
using Google.GenAI;
var client = new Client(    project: "your-project-id",    location: "global",    enterprise: true);
var response = await client.Models.GenerateContent(    "gemini-3.8-flash",    "Explain quantum computing");
Console.WriteLine(response.Text);

API spec & Documentation (source of truth)

When implementing or debugging API integration for Agent Platform, refer to the official Agent Platform documentation:

The Gen AI SDK on Agent Platform uses the v1beta1 or v1 REST API endpoints (e.g., https://{LOCATION}-aiplatform.googleapis.com/v1beta1/projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}:generateContent).

[!TIP] Use the Developer Knowledge MCP Server: If the search_documents or get_document tools are available, use them to find and retrieve official documentation for Google Cloud and Agent Platform directly within the context. This is the preferred method for getting up-to-date API details and code snippets.

Workflows and Code Samples

Reference the Python Docs Samples repository for additional code samples and specific usage scenarios.

Depending on the specific user request, refer to the following reference files for detailed code samples and usage patterns (Python examples):

  • Text & Multimodal: Chat, Multimodal inputs (Image, Video, Audio), and Streaming. See references/text_and_multimodal.md [blocked]
  • Embeddings: Generate text embeddings for semantic search. See references/embeddings.md [blocked]
  • Structured Output & Tools: JSON generation, Function Calling, Search Grounding, and Code Execution. See references/structured_and_tools.md [blocked]
  • Media Generation: Image generation, Image editing, and Video generation. See references/media_generation.md [blocked]
  • Bounding Box Detection: Object detection and localization within images and video. See references/bounding_box.md [blocked]
  • Live API: Real-time bidirectional streaming for voice, vision, and text. See references/live_api.md [blocked]
  • Advanced Features: Content Caching, Batch Prediction, and Thinking/Reasoning. See references/advanced_features.md [blocked]
  • Safety: Adjusting Responsible AI filters and thresholds. See references/safety.md [blocked]
  • Model Tuning: Supervised Fine-Tuning and Preference Tuning. See references/model_tuning.md [blocked]

Source and attribution

Source:google/skillsinskills/cloud/gemini-apiat commit55b4e13

License: No license

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal

More from google/skills

Dpop Adoption

google

Featured

Implement and debug OAuth 2.0 DPoP (RFC 9449) refresh token sender-constraining for WebCrypto, Node.js ES6, and browser runtimes integrating with Google's OAuth platform. Use when configuring non-extractable asymmetric key pairs (P-256), generating DPoP Proof JWTs for authorization code exchange and token refresh, or handling 400 use_dpop_nonce challenge retry loops at oauth2.googleapis.com/token. Don't use for unconstrained OAuth 2.0 flows (where refresh tokens are not bound to a client key pair), or for Google Cloud IAM / service account authentication.

Awaiting classificationOct 8, 2026

Finding Google Skills

google

Featured

Google platform decision and setup guidance, loaded on demand from Google's skill catalog. Use when a developer is choosing or setting up part of their stack, such as where to run a service, a database, storage, messaging, authentication, analytics, ads, or AI model serving, and a Google product is a reasonable candidate - whether or not a vendor is named - or when a request names a Google product or API. Brings in the matching Google skill so the answer can weigh Google options, their trade-offs, and when they are not the right fit. Skip when the stack is already settled on another provider and no Google product is named, or the task involves no platform choice.

Awaiting classificationOct 8, 2026

Spanner Basics

google

Featured

Guides Google Cloud Spanner administration, schema design, querying and performance diagnosis.

Data & AnalyticsOct 8, 2026

Secops Triage

google

Featured

Guides SOC analysts through triaging Google SecOps security alerts, from investigation to closure or escalation.

SecurityOct 8, 2026

Secops Investigate

google

Featured

Guides SOC analysts through deep security incident and entity investigations in Google SecOps using UDM queries and timelines.

SecurityOct 8, 2026

Secops Hunt

google

Featured

Guides proactive threat hunting in Google SecOps using UDM queries, IoC lookback, prevalence and outlier analysis.

SecurityOct 8, 2026