AWS Databricks Platform Administrator

Baldwin Risk Partners
US - Florida - Tampa
January 15, 2025

This position is a remote opportunity within the firm. Central or Eastern Time Zones are strongly preferred.

The Baldwin Group is an award-winning entrepreneur-led and inspired insurance brokerage firm delivering expertly crafted Commercial Insurance and Risk Management, Private Insurance and Risk Management, Employee Benefits and Benefit Administration, Asset and Income Protection, and Risk Mitigation strategies to clients wherever their passions and businesses take them throughout the U.S. and abroad. The Baldwin Group has award-winning industry expertise, colleagues, competencies, insurers, and most importantly, a highly differentiated culture that our clients consider an invaluable expansion of their business. The Baldwin Group (NASDAQ: BWIN), takes a holistic and tailored approach to insurance and risk management.

The AWS Databricks Platform administrator is a technical role to design, implement and maintain process used to manage the organization's Databricks platform. The administrator will be responsible for facilitating the work of data analysts, data engineers and data scientists while maintaining best practices for security and compliance. Unity catalog will be used to implement access and identity policies. Infrastructure will be maintained using Terraform. The administrator will be responsible for assisting with compute issues, monitoring and alerting, and assuring the platform functions smoothly. This role requires great organization and communication skills.

Job responsibilities:

Manage and maintain role-based access to data and features in the Databricks Platform using Unity Catalog
Implement external access controls for outside teams using service principles, SQL warehouses and Delta Sharing
Work with platform users to solve problems and facilitate work
Create infrastructure for AWS and Databricks using Terraform: S3, IAM roles, Instance Profiles, KMS Keys
Improve processes and systems used to manage infrastructure, users and external access
Keep track of unused assets for pruning
Understand and implement best practices for security and compliance
Implement service principles and access tokens for external users
Understand how to utilize Databricks APIs to automate administrative tasks
Create queries and dashboards to monitor critical systems and processes
Create documentation for users and admins
Automate common admin tasks using Databricks notebooks
Manage workflow tags, cluster tags, workflow naming convention enforcement
Clusters health check and best practices implementation
Regular back up & recovery
Privilege reviews on users and resources

Required qualifications:

4 or more years of experience administering the Databricks platform
Strong understanding of data engineering needs
Experience creating AWS infrastructure with Terraform
Strong understanding of AWS infrastructure required by Databricks
Experience with compliance audits/audit documentation
Experience using Databricks APIs with tools like Postman
Understanding of the Databricks workspace and development environment
Experience using GitHub to manage source code
Strong SQL skills for creating admin related queries and dashboards
Strong debugging skills
Ability to do risk analysis for 3rd party integrations with AWS resources.
Knowledge of Python a plus
Familiarity with Datadog

• LI-JK1

for some insight into our culture!

The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.

Read the full job description and apply online on the recuiter's web-site

Related Job Postings

Outpatient Psychiatric Mental Health Nurse Practitioner

Mindpath Health

US - FL - FL - Boca Raton
January 15, 2025

Overview: • Why Mindpath Health? Join Mindpath Health as we expand access to high quality mental health care in the communities we serve. We provide a well-supported outpatient practice setting where we treat mostly commercially insured patients of all ages with a wide range of mental health...

Find Jobs Hiring Now Near You!

Get Jobilize Job Search Mobile App Now