Senior Data Engineer

Company Description

We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.



Join our Enterprise Data Management team as a Sr. Data Engineer. Preferably, role will be located in our Jersey City, NJ global headquarters which has a flexible hybrid work model.

Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate solutions.
Use tools like Databricks, Python, Spark, and other tools to build cutting-edge data pipelines and dynamic data solutions.
Develop high-quality optimized code to process vast amount of data.
Implement data improvements and optimization techniques to enhance the data products.
Continuously evaluate and adopt new technologies and tools to enhance data engineering capabilities and efficiency.
Build and maintain data pipelines to integrate data from various source systems.
Optimize data pipelines for performance, reliability and cost-effectiveness.
Perform data analysis required to troubleshoot and assist in resolving data issues.
Handle production workload and resolve issues in timely manner.
Work with enterprise cloud operations teams to implement best practices for performance monitoring, cloud resource management, including scaling, cost control and security.
Stay up-to-date with the latest technologies and trends in data engineering, data warehousing, ETL, data quality, and modern ETL operations.
Mentor and support junior data engineers as and when needed.

Qualifications

Bachelor's or Master's degree in Computer Science, Information Systems or a related STEM field.
8+ years of experience with data engineering, data warehousing, data architecture with substantial experience in managing large-scale data projects.
Proven experience in implementing data quality, data management, data analysis and root cause analysis.
Strong communication skills, a solid work ethic, and attention to detail.
Must have 7+ years of experience with data platform services like Databricks, Spark, Python, SQL, NoSQL, Athena.
Must have 5+ years of experience with Python and the Python ecosystem (PySpark, Pandas, DataFrames, etc.), showcasing the ability to write clean, maintainable, and robust code.
7+ years of experience with data solutions implementations in AWS Cloud platform technology.
Familiarity with data pipeline orchestration tools like Step Functions, AirFlow or similar.
AWS Certifications are plus.
Passion for innovation and a commitment to delivering high-quality data solutions.
5+ years of experience with CI/CD, CloudFormation, Changeset execution and rollback.
Experience with entity resolution or similar technology is plus.
Provide afterhours or weekend support for ETL processes and troubleshoot any issues that may arise to ensure data integrity and timely completion of ETL tasks.

Additional Information

For over 50 years, Verisk has been the leading data analytics and technology partner to the global insurance industry by delivering value to our clients through expertise and scale. We empower communities and businesses to make better decisions on risk, faster.

At Verisk, you'll have the chance to use your voice and build a rewarding career that's as unique as you are, with work flexibility and the support, coaching, and training you need to succeed.

For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work for outstanding workplace culture in the US, fourth consecutive year in the UK, Spain, and India, and second consecutive year in Poland. We value learning, caring and results and make inclusivity and diversity a top priority. In addition to our Great Place to Work Certification, we've been recognized by The Wall Street Journal as one of the Best-Managed Companiesand by Forbesas a World's Best Employer and Best Employer for Women, testaments to the value we place on workplace culture.

We're 7,000 people strong. We relentlessly and ethically pursue innovation. And we are looking for people like you to help us translate big data into big ideas. Join us and create an exceptional experience for yourself and a better tomorrow for future generations.

Verisk Businesses

Underwriting Solutions- provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision

Claims Solutions- supports end-to-end claims handling with analytic and automation tools that streamline workflow, improve claims management, and support better customer experiences

Property Estimating Solutions- offers property estimation software and tools for professionals in estimating all phases of building and repair to make day-to-day workflows the most efficient

Extreme Event Solutions- provides risk modeling solutions to help individuals, businesses, and society become more resilient to extreme events.

Specialty Business Solutions- provides an integrated suite of software for full end-to-end management of insurance and reinsurance business, helping companies manage their businesses through efficiency, flexibility, and data governance

Marketing Solutions- delivers data and insights to improve the reach, timing, relevance, and compliance of every consumer engagement

Life Insurance Solutions- offers end-to-end, data insight-driven core capabilities for carriers, distribution, and direct customers across the entire policy lifecycle of life and annuities for both individual and group.

Verisk Maplecroft- provides intelligence on sustainability, resilience, and ESG, helping people, business, and societies become stronger

Verisk Analytics is an equal opportunity employer. Verisk's minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.

***/company/careers/

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

***/privacy-policies/data-privacy-notice-for-employees-applicants-and-independent-contractors/

Videos To WatchYH30jlQ1yVo

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.