Senior Data Integration Engineer- Telecom

This Remote Position Cannot be Performed in New York City.

We are hiring a

Senior Data Integration Engineer

, who will support a critical digital transformation project for one of EPAM's top clients.

This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!

Req. #671805849

Responsibilities:

We are seeking an experienced Data Engineer to join our team and work on developing, implementing, and maintaining big data solutions. Our Client's Cloud Platform supports multiple deployed routers (BHR4, BHRx1, K2, CHR) and collects data from those. The ideal candidate will have a strong background in data processing, AWS cloud services, and various ETL tools. The candidate will be responsible for optimizing performance, managing data pipelines, and working with distributed systems. The tasks will include acceptance testing, end-to-end testing of API parameters from the routers to the cloud API, and end-to-end testing of TR-069 parameters from the routers.
• LI-DNI


Creating and integrating tables from different data sources on cloud for data acquisition, integration, and analysis

Collecting router logs, storing them in AWS S3, and analyzing them with Athena to generate statistics

Performing transformations & actions on RDDs that can be used as data stage for ETL

Developing automation frameworks by connecting to multiple clusters and databases on the cloud like HBase, Mongo DB, Oracle, Teradata, and SQL Server for achieving simultaneous dataflow

Configuring Glue crawlers, tables, and Athena external tables from the S3 data source to run SQL queries

Querying different data sets with Boto3, Pandas, and Python to connect to AWS S3, HBase, and Athena for querying a large set of data and scheduling multiple jobs on EMR

Using Python, pandas, boto3, and spark to write a reusable code module to handle a large number of datasets

Developing APIs using Lambda and API Gateway to achieve an abstraction layer to integrate with on-prem systems

Building end-to-end test cases to validate the data flow of the APIs. Performing testing on router for the API's sent from cloud to router and verify E-E functionality. Testing end-to-end API parameters from the routers to the cloud API, and end-to-end testing of TR-69 parameters from the routers

Requirements

Critical: Self-driven with the ability to work independently, get a deep understanding of the domain and context, identify risks and issues, and develop solutions without close supervision

Hands-on experience with AWS services

Very good understanding of big data pipeline and common database like relational (MySQL & PostgreSQL), MongoDB, HBase

Extensive experience with SQL, including modifying and writing complex queries, particularly using window functions

Experience performing batch/real time processing using Spark

Experience designing and developing appropriate test automation frameworks and data validation techniques to ensure optimized product performance

Understanding of networking stack and any wireless protocol - preferably 802. 11

Experience working with routers & embedded consumer products, preferably knowledge of TR-69 CPE WAN Management Protocol

Experience with Cloud testing tools

Very strong scripting experience using Spark and Python is a must

Experience in the Telecommunications Industry is preferred

We offer

Medical, Dental and Vision Insurance (Subsidized)

Health Savings Account

Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)

Short-Term and Long-Term Disability (Company Provided)

Life and AD&D Insurance (Company Provided)

Employee Assistance Program

Unlimited access to LinkedIn learning solutions

Matched 401(k) Retirement Savings Plan

Paid Time Off - the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)

Paid Holidays - nine (9) total per year

Legal Plan and Identity Theft Protection

Accident Insurance

Employee Discounts

Pet Insurance

Employee Stock Purchase Program

If otherwise eligible, participation in the discretionary annual bonus program

If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

Applications will be accepted on a rolling basis.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

YouTube video player (/ youtube. com/embed/NU_mnNITn2o?si=IiCxyQ4sr1YJWxDG)

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $90K - $150K. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance's key provisions here: Concept FCO Posting 8 27 24 (lacounty. gov)

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital .