bash_task = BashOperator( task_id="bash_consumer", bash_command="echo 'The upstream status is ti.xcom_pull(task_ids='pusher_task') '", ) Use code with caution. 3. Advanced Patterns: Custom XCom Backends
To circumvent metadata database size limits and prevent system performance degradation, production environments use a . This architectural pattern intercepts XCom pushes, uploads the heavy data payload to an external object storage system, and writes only a reference URI string back to the Airflow database. airflow xcom
from airflow.configuration import conf conf.set('core', 'xcom_backend', 'airflow.providers.amazon.aws.xcom.s3.S3XComBackend') bash_task = BashOperator( task_id="bash_consumer"
dag = DAG( 'xcom_example', default_args=default_args, schedule_interval=timedelta(days=1), ) airflow xcom
: Ensure your data payloads match strict JSON requirements before pushing, or implement custom serialization handlers to prevent schema validation crashes.