Desarrollador/a Python Databricks

Capitole
ES - españa
January 13, 2025

Capitole Consulting keeps growing and we want to do it with you!

Are you a passionate Senior Python Developer (3+ years) with experience in Databricks? We have an exciting opportunity to lead and empower a multicultural team!

We are seeking a Python Developer with Databricks to work on a critical project involving the migration of calculation logic into Databricks using Python.

This role requires expertise in Python development, to adapt and extend existing Python code, experience with distributed data processing frameworks, knowledge of the Databricks environment and a close collaboration with a number of stakeholders.

KEY RESPONSABILITIES

1. Code Adaptation and Development:

a) Refactor and adapt existing Python code to handle the new data schema and transformations. Part of the code is already available in Python, however however it would need to be adjusted and/or extended (new data fields, new data sources,…)

b) Develop new modules to process, transform, and load data using PySpark or Python-based frameworks.

c) Implement data validation and error handling mechanisms.

2. Databricks Platform Support (would be nice):

a) Support in initial configuration of Databricks (including library installations and resource optimization)

b) Integrate Databricks with cloud storage and data sources (on Azure and/or Databricks)

c) Automatisation of Jobs in Databricks or Azure Data Factory

3. CI/CD, Testing and Quality Assurance:

a) Set up CI/CD pipelines for code and configuration deployment

b) Write and execute unit tests, integration tests, and performance tests for data pipelines.

c) Debug and troubleshoot issues in a distributed environment.

4. Collaboration and Documentation:

a) Work closely with data engineers, analysts, and cloud architects to ensure seamless integration and operation.

b) Document code, workflows, and platform configurations for transparency and future reference

TECHNICAL SKILLS:

1. Strong programming skills in Python

2. Hands-on experience with Databricks, including cluster setup, Jobs, Workflows, and Delta Lake.

3. Experience with Azure

4. Nice to have: SAS know how or at least familiarity with financial processes

We're great, but with you we'll be even better!

For this you will have:

- Budget of 1.200€ in individual training for you to use it in whatever you want (technological events, books, trainings, certifications, etc.).

- Follow-up with your team every month for continuous feedback.

- Teleworking.

- Flexible working hours to help you reconcile your professional / family life.

- Private medical insurance paid in full by Capitole.

- Flexible remuneration (restaurant tickets, transport and/or childcare).

- Andjoy (Gymforless).

- Discounts on major brands for employees (Club Capitole).

Get to know the whole family:

- Team Buildings every two months - don't miss the summer party or the Christmas dinner!

- Football team sponsored by Capitole.

- Technological communities for you to share your knowledge and ideas with the other teams, sharing internal knowledge is essential!!!!

- Last but not least, a TEAM! Don't you know us yet? Discover us!!! ***/

See what people are saying about us /glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.html

Don't hesitate to send us your profile, we are looking forward to meeting you!

Read the full job description and apply online on the recuiter's web-site

Related Job Postings

Project Engineer - Industrial Refrigeration

Johnson Controls

ES - Sant Boi
January 11, 2025

Project Engineer - Frío Industrial Los sistemas de Refrigeración Industrial de Johnson Controls trabajan detrás de sus clientes para satisfacer las demandas resultantes de procesos críticos. • Nuestros innovadores equipos de refrigeración y la tecnología de compresión de gas ayudan a mantener las...

Find Jobs Hiring Now Near You!

Get Jobilize Job Search Mobile App Now