Data Engineer

The Data Engineer will work cross-functionally with application development, data science, and product management to support growth, strategy, and development of innovative solutions internally and for our external clients. This position will work with operational and business leaders to deliver business intelligence and analytical procedures to address business needs. This position will support the data science team by automating processes and enabling deployment of predictive models; the application development team by creating procedural gateways to access specific data components from the underlying database schema, then present them in a mutually agreed upon format; and the client data teams to ingest client files and generate client deliverables.

Duties/Responsibilities:

Partner with data scientists to create data products that will serve analysis, ML and reporting needs intuitively.

Collaborate with database and application development team to capture requirements and determine data-driven solutions to support ongoing projects.

Coordinate with client services to automate client data ingestion and client deliverable workflows using Azure Data Factory.

Implement and maintain data ingestion, transformation, and loading processes using ETL/ELT tools and techniques.

Review/remediate any identified issues/cases in the system, including root cause analysis to determine if issues require development to address a systematic problem.

Work with the Data Architect to develop and maintain high-level enterprise data models and conceptual views of related data sub-architectures (e.g., database, data integration, data warehouse/business intelligence, reporting, metadata, and content management architectures).

Identify and implement service standards in conjunction with stakeholder-specific requirements (e.g., transaction processing speed, data mining, and reporting capabilities, data security, scalability, etc.).

Collaborative Leadership: Act as a trusted advisor to IT analytics and application teams and business partners, providing expert consultation and through communicating sophisticated data-driven insights.

Required Skills/Abilities/Attributes:

5 years of experience in data engineering, procedure/function development, business system designs, and support.

3 years of hands-on experience designing data management systems on Microsoft SQL Server.

3 years of hands-on experience in ETL development using Data Factory.

Strong understanding of SQL and NoSQL technologies and query language

Hands-on experience developing and managing deployments using CI/CD industry standard practices.

Strong analytical skills and enjoyment solving complex technical problems.

Ability to manage and make decisions about competing priorities and resources.

Demonstrated exceptional oral, written, presentation, and interpersonal skills.

The ability to work both autonomously and with other team members in an appropriate collaboration amount to apply Data Management concepts to a variety of 'real life' business scenarios.

Must possess strong organizational, facilitation, and critical thinking abilities, to assess complex problems, analyze options, navigate diverse perspectives and objectives, and develop acceptable Data Management solutions.

Preferred Skills/Experience

Previous knowledge of building pipelines for ML models.

1+ years of Azure Data Factory experience, with git repository and pipeline deployment.

Extensive experience with NoSQL datatypes in MS SQL Server (Json/XML). Creation, extraction and management of data in NoSQL formats.

Extensive experience creating/managing stored procedures and functions in MS SQL Server

2+ years of experience in cloud architecture (Azure, AWS, etc)

Experience with 'code management' systems (Azure Devops)

2+ years of reporting design and management (PowerBI Preferred)

Ability to influence others through the articulation of ideas, concepts, benefits, etc.

Education and Experience:

Bachelor's degree in a computer science field or applicable business experience.

Minimum 3 years of experience in a Data Engineering role

Healthcare experience preferred.

Physical Requirements:

Prolonged periods sitting at a desk and working on a computer.

Ability to lift 20 lbs.

This position may require travel up to 10% of the time