Skip to content

Optional Packages

Status: Available in ETLantic 0.53.0 (Beta release candidate). Core etlantic does not install engines. Install only the plugins you need, pinned to the same minor line.

Maturity vs PyPI classifiers

Official engine packages declare Beta PyPI classifiers that match the ETLantic 0.49 Beta envelope (community non-SLA). Treat that envelope as authoritative for readiness claims. CP1–CP4 alone ≠ GA; Supported profiles graduated in 0.43 (isolated-deployment, dedicated-schema; shared-service Experimental). See Production readiness.

Install pins

Prefer exact pins for a controlled pilot:

pip install 'etlantic==0.53.0'
pip install 'etlantic-polars==0.53.0'
pip install 'etlantic-pandas==0.53.0'
pip install 'etlantic-sql==0.53.0'
pip install 'etlantic-pyspark==0.53.0'
pip install 'etlantic-airflow==0.53.0'
pip install 'etlantic-prefect==0.53.0'
pip install 'etlantic-keyring==0.53.0'
pip install 'etlantic-sqlmodel==0.53.0'
pip install 'medallantic==0.53.0'
# optional compatibility redirect (deprecated):
pip install 'etlantic-sparkforge==0.53.0'
# experimental connectors (fake/CI; Alpha — not Supported):
pip install 'etlantic-s3==0.53.0'
pip install 'etlantic-iceberg==0.53.0'
pip install 'etlantic-snowflake==0.53.0'
pip install 'etlantic-k8s==0.53.0'
pip install 'etlantic-spark-connect==0.53.0'
pip install 'etlantic-mcp==0.53.0'

Official first-party plugins declare etlantic>=0.53.0,<0.54. Keep core and plugins on the same patch (pin all to 0.53.0 for pilots). Cross-minor mixes are unsupported and commonly fail plugin discovery.

DataFusion: pip install 'etlantic[datafusion]==0.53.0' or etlantic-datafusion==0.53.0 — provisional portable dataframe/compiler implementation (0.50 technical qualification recorded; independent review pending).

Optional FastAPI package: pip install 'etlantic-fastapi==0.53.0' or etlantic[fastapi]==0.53.0 — dual surface: CP1 (ETLanticAPI / include_router / create_app) plus thin non-CP create_reference_app (authoring demo since 0.24). CP1–CP4 alone ≠ GA; Supported profiles graduated in 0.45 (isolated-deployment, dedicated-schema; shared-service Experimental)(plan).

Package API index

Package guide Public entry Role
etlantic-polars etlantic_polars Polars dataframe engine + portable compiler
etlantic-pandas etlantic_pandas Pandas dataframe engine + eager portable compiler
etlantic-sql etlantic_sql Native SQL engine + portable SQL lowering
etlantic-duckdb etlantic_duckdb Optional DuckDB SQL engine + portable compiler
etlantic-pyspark etlantic_pyspark PySpark engine + portable compiler
etlantic-airflow etlantic_airflow Airflow DAG compiler (etlantic compile --target airflow)
etlantic-prefect etlantic_prefect Prefect direct-execution scheduler (Profile(orchestrator="prefect"))
etlantic-keyring etlantic_keyring OS keyring secret provider
etlantic-sqlmodel etlantic_sqlmodel SQLModel ↔ contract bridge
etlantic-s3 etlantic_s3 Experimental S3 JSON connector (fake/CI; Alpha)
etlantic-kafka etlantic_kafka Experimental Kafka connector (fake/CI; Alpha)
etlantic-k8s etlantic_k8s Experimental Kubernetes resource provider (FakeKubernetes; Alpha)
etlantic-spark-connect etlantic_spark_connect Experimental Spark Connect provider (fake; Alpha)
etlantic-mcp etlantic_mcp Experimental read-only MCP extra (FakeMcpServer; Alpha)
etlantic-schemaregistry etlantic_schemaregistry Experimental schema-registry adapter (fake/CI; Alpha)
etlantic-iceberg etlantic_iceberg Experimental Iceberg connector (fake/CI; Alpha)
etlantic-snowflake etlantic_snowflake Experimental Snowflake connector (fake/CI; Alpha)
medallantic medallantic Facade — medallion vocabulary and SparkForge migration adapter
etlantic-sparkforge etlantic_sparkforge Redirect (deprecated) — re-exports medallantic
etlantic-fastapi etlantic_fastapi Dual surface: CP1 ETLanticAPI + thin create_reference_app (pin ==0.53.0; CPn alone ≠ GA)
etlantic-lsp etlantic_lsp Editor-neutral language server (etlantic[lsp] / pin ==0.53.0)
etlantic-datafusion etlantic_datafusion DataFusion dataframe engine + portable compiler

MkDocs API generation includes core src/ and first-party plugin package paths. Shallow module-level stubs for optional packages live in API — Optional packages. For plugin factories, registration, protocol versions, and failure modes, also use the linked package README and the corresponding engine tutorial.