Lakehouse As Code
Guides, API reference and sample code are great, but sometimes you need to see the big picture before trying to setup a scalable solution. It's with that intent that a comprehensive template on how to deploy a lakehouse as code using Laktory has been created here.
In this template, 4 pulumi projects are used to:
{cloud_provider}_infra
: Deploy the required resources on your cloud providerunity-catalog
: Setup users, groups, catalogs, schemas and manage grantsworkspace
: Setup secrets, clusters and warehouses and common files/notebooksworkflows
: The data workflows to build your lakehouse