Job role and responsibilities:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure databricks, optimizing data workflows, and collaborating with internal teams on various aspects.
Requirements:
1. Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
2. 7+ years of experience in data engineering or related roles.
3. 5+ years of experience in Azure Databricks, Azure Data Lake, and Azure Cosmos DB proven track record of building data engineering solutions
4. Proficient in programming languages such as Python, SQL, and Scala.
5. Experience with big data technologies including Apache Spark, Hadoop, and Hive.
6. Hands-on experience with cloud platforms, particularly Microsoft Azure.
7. Proficiency in ETL processes, data warehousing, and data modeling.
8. Proficient in using Azure Cosmos DB for graph-based data analysis.
9. Knowledge of tools and technologies such as Azure Data Factory, Azure Synapse Analytics, and Apache Kafka.
10. Solid understanding of CICD pipelines and hands-on experience with DevOps tools such as Git for continuous integration and deployment.
11. Excellent problem-solving skills and the ability to troubleshoot complex data issues.
12. Strong coaching abilities, Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Must to have
Hands on programming Python and pyspark
Big dataTech Worked on Big Data Technology
Databricks and notebooks scripting
Experienced in ADF
Data analysis and modelling
Nice to Have
Data Architecting
Power BI Reporting
Mentoring team and coaching adhering to best practices
CI/CD Pipelines
Preferred Qualifications:
Microsoft Certified: Azure Data Engineer Associate.
Databricks Certified Associate Developer for Apache Spark.
Experience with data governance and data security practices.
Knowledge of Docker and Kubernetes for containerization and orchestration. Please find the below points to cover in addition to the job spec for senior data engineer contract role
Receive real-time job alerts and never miss the right job again
US - PA - PA - Lansford
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Brodheadsville
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Mc Clellandtown
November 15, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Abington
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Rehrersburg
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Philadelphia
November 16, 2024
Do you want to know that what you do each day positively influences the lives of individuals and families in your community? • • Looking for an experienced Executive Director with extensive experience in membership and program growth to join our team. The Executive Director at the Columbia NorthYMCA...
US - PA - PA - Southeastern
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Philadelphia
November 16, 2024
Are you considering a career in automotive? Transfer your management and sales experience to an industry that will really get your career moving! Premium Velocity Auto/Jiffy Lube (PVA) is hiring now! • We are seeking an Assistant General Manager with prior Retail Service Management experience...
US - PA - PA - Birdsboro
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Bala Cynwyd
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Southampton
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
Globe Life Liberty National Division The Keller Agencies
US - PA - PA - Pittsburgh
November 12, 2024
With over 124 years of experience, after four consecutive record years, Globe Life Liberty National Division is just getting started! We are seeking candidates to join our record-breaking team as we provide life-changing financial services to our clientele in Pennsylvania, West Virginia, and Ohio....
US - PA - PA - Kresgeville
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Merion Station
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Orwigsburg
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Philadelphia
November 16, 2024
Responsibilities • Located on a 27-acre wooded campus, Fairmount Behavioral Health System is a peaceful, therapeutic environment for patients and families. • Fairmount is a major regional resource for children, adolescents and adults who have psychiatric and behavioral problems as well as alcohol...
US - PA - PA - Analomink
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Strausstown
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Pittsburgh
November 16, 2024
Overview ~Vice President, Enterprise Risk~ (Hybrid) At BNY, our culture empowers you to grow and succeed. As a leading global financial services company at the center of the world's financial system we touch nearly 20% of the world's investible assets. Every day around the globe, our 50,000+...
US - PA - PA - Washington Crossing
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Flicksville
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Philadelphia
November 16, 2024
We are seeking a self-motivated and hard-working Insurance, Annuity and Financial Planning Professional to join our team and make a significant impact on our clients' financial well-being. • If you are dedicated to providing exceptional financial planning services and have a proactive approach to...
US - PA - PA - Bridgeville
November 15, 2024
Bridgeville • 1025 Washington Pike, Bridgeville, PA 15017-2702, United States of America • Pay : $15.00 - $16.00 • It's fun to work in a company where people truly BELIEVE in what they're doing! • We're committed to bringing passion and customer focus to the business. • Job Summary • As an integral...
US - PA - PA - Stroudsburg
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Wallingford
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Bangor
November 14, 2024
About the Job: • Providing great patient care. • Answering patient calls and determining how best to help them. • Providing physical support for patients or residents with daily activities and personal hygiene, including bathing, dressing, getting out of bed, - using the toilet,...
US - PA - PA - Allentown
November 16, 2024
We are seeking a self-motivated and hard-working Insurance, Annuity and Financial Planning Professional to join our team and make a significant impact on our clients' financial well-being. • If you are dedicated to providing exceptional financial planning services and have a proactive approach to...