03b Platforms and tooling
Open tools, named plainly.
What we build with, what is supported today, and what is on the roadmap. No mystery platform in the middle: Python, Dagster, dlt and dbt, in your repo.
Python
DagsterdltdbtElementaryDuckDBlocalPostgreSQLStreamlitTerraformPower BI
Logos identify the open-source projects we build with and remain trademarks of those projects.
How to read the status
Three words, used the same way everywhere on this site.
- ✓ SupportedBuilt and tested end to end on emulated services.
- PreviewImplemented and validated offline; not yet applied to a live account.
- PlannedOn the roadmap.
Azure or AWS. Snowflake or PostgreSQL.
The data model, the pipelines and the code are the same on every combination. Only the parts that touch the cloud and the warehouse change.
| Snowflake | PostgreSQL (managed) | |
|---|---|---|
| Azure | ✓ Supported | Preview |
| AWS | Preview | Preview |
Snowflake suits larger data and heavy concurrent reporting. Managed PostgreSQL suits smaller deployments where Snowflake would be the wrong cost. Databricks, Microsoft Fabric and Amazon Athena are planned warehouses.
The full picture
Cloud
Azure first; AWS is the same platform with the cloud-specific parts swapped.
- Microsoft Azure✓ Supported
- Amazon Web ServicesPreview
- Google CloudPlanned
Warehouse
Snowflake for scale and concurrent BI; managed PostgreSQL for small deployments.
- Snowflake✓ Supported
- PostgreSQL (managed)Preview
- DatabricksPlanned
- Microsoft FabricPlanned
- Amazon AthenaPlanned
Ingestion
- dlt, declared API sources✓ Supported
- Plain Python assets✓ Supported
- Tables landed by another toolPlanned
Orchestration
- Dagster✓ Supported
- PrefectPlanned
- Apache AirflowPlanned
Transformation
- dbt (Fusion engine)✓ Supported
- dbt-corePreview
BI and semantic layer
- Power BI (PBIP and TMDL)✓ Supported
- LookerPlanned
- TableauPlanned
- MetabasePlanned
Code hosting
- GitHub✓ Supported
- Azure ReposPreview
- BitbucketPreview
- GitLabPlanned
CI/CD
- GitHub Actions✓ Supported
- Azure PipelinesPreview
- Bitbucket PipelinesPreview
- GitLab CIPlanned
Secrets
- Environment variables✓ Supported
- GitHub Actions secrets✓ Supported
- Azure Key VaultPreview
- AWS Secrets ManagerPreview
- GCP Secret ManagerPreview
Infrastructure as code
- TerraformPreview
- OpenTofuPlanned
AI provider (bring your own)
- AnthropicPreview
- OpenAIPreview
- Azure OpenAIPreview
- Local model (OpenAI-compatible)Preview
- AWS BedrockPlanned
- Google Vertex AIPlanned
- Platform-managedPlanned
The roadmap
Everything marked planned above, in one list. Order depends on what customers need first.
- Google Cloud · Cloud
- Databricks · Warehouse
- Microsoft Fabric · Warehouse
- Amazon Athena · Warehouse
- Tables landed by another tool · Ingestion
- Prefect · Orchestration
- Apache Airflow · Orchestration
- Looker · BI and semantic layer
- Tableau · BI and semantic layer
- Metabase · BI and semantic layer
- GitLab · Code hosting
- GitLab CI · CI/CD
- OpenTofu · Infrastructure as code
- AWS Bedrock · AI provider (bring your own)
- Google Vertex AI · AI provider (bring your own)
- Platform-managed · AI provider (bring your own)