Airflow State Store
by astronomercbe1141f547bNo license451 starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today
Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value stores (`task_state_store`, `asset_state_store`) and the crash-safe `ResumableJobMixin`. Use when the user asks about task state store, checkpointing in tasks, persisting state across retries, job IDs surviving worker crashes, watermarks, asset metadata, resumable tasks, crash-safe operators, or "what's new in Airflow 3.3". Also use proactively when reading a DAG that uses Variables or XCom for intra-task coordination state (flag the anti-pattern), or when reviewing any DAG that submits a job to an external system (Databricks, Snowflake, BigQuery, Redshift, Spark, dbt Cloud, EMR, AWS Batch, etc.) and waits for it to finish, whether as one submit-and-wait operator or split into submit + sensor/polling tasks; covers `wait_for_termination`, `deferrable`, `durable`, and hand-rolled polling sensors. State-persistence pieces require Airflow 3.3+; submit+poll architecture guidance applies on any version.
Add to a SourceWeft workspace
- Open the skill in your dashboard and add it to a workspace.
- Enable it for the chats that should use it.
This skill is instructions only: it ships no scripts to execute.
Add to SourceWeftYou will be asked to sign in first, then taken straight to this skill.
Ask your agent to install it
Paste this prompt into Claude Code, Codex, Cursor or another agent that can run commands — or into SourceWeft chat. The agent reads this skill's install guide, shows you its source, license and scripts, and installs it with the SourceWeft CLI once you agree.
Read https://sourceweft.com/skills/gh-astronomer-agents-airflow-state-store/install.md and install the skill it describes. Before installing, show me its source, license and whether it ships scripts, and wait for my OK. Ask me before changing anything else on my machine.Install it yourself from a terminal
For Claude Code, Codex, Cursor and other local agents. The SourceWeft CLI fetches the skill from its source repository at the commit scanned here, and verifies every file against the hashes recorded when the skill was scanned. If anything differs, nothing is written.
npx @sourceweft/cli skills install gh-astronomer-agents-airflow-state-storeAdd --agent claude-code, codex, cursor or universal to choose which agent gets it (Claude Code by default).
Upstream installer — not verified by SourceWeft
The open-source skills installer fetches the same pinned commit, but does not check the files against the hashes SourceWeft recorded.
npx skills add https://github.com/astronomer/agents/tree/cbe1141f547bcf0506babb9778a7696bf15eff66/skills/airflow-state-storeSource and attribution
Source:astronomer/agentsinskills/airflow-state-storeat commitcbe1141
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from astronomer/agents
Warehouse Init
astronomer
Discovers data warehouse schema metadata and generates a shareable .astro/warehouse.md reference file for fast concept-to-table lookups.
Tracing Upstream Lineage
astronomer
Trace upstream data lineage. Use when the user asks where data comes from, what feeds a table, upstream dependencies, data sources, or needs to understand data origins.
Tracing Downstream Lineage
astronomer
Traces downstream data lineage to assess what breaks when a table or DAG changes.
Testing Dags
astronomer
Guides iterative testing, debugging and fixing of Airflow DAGs using af CLI commands.
Setting Up Astro Project
astronomer
Initializes and configures Astro/Airflow projects with the Astro CLI, covering dependencies, connections, and variables.
Profiling Tables
astronomer
Profiles a database table with SQL statistics, cardinality, samples and a data quality assessment.
More in DevOps & Cloud
Amazon Location Service
awslabs
Guides integration of Amazon Location Service APIs for maps, geocoding, routing, places search, geofencing and tracking.
Managing Astro Local Env
astronomer
Manage a local Airflow environment with the Astro CLI: start, stop, restart, logs, API queries and troubleshooting.
Managing Astro Deployments
astronomer
Guides use of the Astro CLI to authenticate, manage workspaces, and create, update, delete, and deploy Astronomer production deployments.
Deploying Airflow
astronomer
Guides deploying Airflow DAGs and projects to production via Astro, Docker Compose, or Kubernetes Helm.
Airflow
astronomer
Operates and troubleshoots Apache Airflow instances through the af CLI, covering DAGs, runs, tasks, logs, config and health.
Monitor Reliability
amplitude
Produces a proactive product reliability health check from Amplitude error, network, and error-click data.