Job Description

Databricks Platform Administrator

Primary Skill: Data Analysis

Location: Atlanta, GA

Job Type: W2

Duration: 12 Months

Job Description:

· Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support. Operational support responsibilities include platform set-up and configuration, workspace administration, resource monitoring, providing technical support to data engineering, Data Science/ML, and Application/integration teams, performing restores/recoveries, troubleshooting service issues, determining the root causes of issues, and resolving issues.

· The position will also involve the management of security and changes.

· The position will work closely with the Team Lead, other Databricks Administrators, System Administrators, and Data Engineers/Scientists/Architects/Modelers/Analysts.

· This position will involve participation in on-call rotation for 24/7 support.

Education:

· 4-year College Degree preferably in Information Systems, Computer Science, Engineering, or related field.

Responsibilities:

· Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.

· Collaborate with the data engineering team to ingest, transform, and orchestrate data.

· Manage privileges over the entire Databricks account, as well as at the workspace level, Unity Catalog level and SQL warehouse level.

· Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.

· Install, configure, and maintain Databricks clusters and workspaces. 

· Maintain Platform currency with security, compliance, and patching best practices.

· Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance. 

· Implement and manage access controls and security policies to protect sensitive data.

· Manage schema data with Unity Catalog - create, configure, catalog, external storage, and access permissions.

· Administer interfaces with Azure AD and Amazon AWS.

· Hadoop admin skills are preferred 

· Knowledge about Apache Kafka is desirable

Required Skills:

· 3+ years of production support of the Databricks platform

Preferred:

· 2+ years of AWS/Azure PaaS

· 2+ years of automation frameworks such as Terraform

· 2+ years of Hadoop administration (Cloudera/Hortonworks)

· 2+ years of Apache Kafka streaming platform administration

Kindly please share your resumes with [email protected] or 707-435-3471

Job Tags

Similar Jobs