Description:
- Administering Databricks workspaces (AWS E2 architecture/Azure), managing account settings, user identities, roles, and permissions.
- Enabling and managing Unity Catalog for fine-grained access control (FGAC), managing storage credentials, external locations, and data sharing
- Creating/configuring clusters, implementing cluster policies, managing libraries, and optimizing performance/costs (DBU monitoring, Spot instances).
- Implementing network security (PrivateLink/VNet injection), SSO integrations (Okta/SAML), and conducting audits.
- Using tools like Terraform or ARM templates to automate platform provisioning and deployments.
- Setting up monitoring via AWS CloudWatch or Azure Monitor, analyzing logs, and troubleshooting production issues.
