Senior Data Engineer

When you join Verizon You want more out of a career. A place to share your ideas freely - even if they're daring or different. Where the true you can learn, grow, and thrive. At Verizon, we power and empower how people live, work and play by connecting them to what brings them joy. We do what we love - driving innovation, creativity, and impact in the world. Our V Team is a community of people who anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together - lifting our communities and building trust in how we show up, everywhere & always. Want in? Join the V Team Life.
What you'll be doing. As a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating Big data products and applications which runs on the large Hadoop cluster and Cloud. The qualified engineer will be developing and testing ETL process, Migrating different applications to cloud , developing Data validation tools used for performing quality assessments and measurements on different data sets that feed data & AI products.
Building big data and batch/real-time analytical solutions that leverage emerging technologies.
Performing data migration and conversion activities on different applications and platforms.

Designing, developing and testing of data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

Performing data profiling/analysis, discovery, analysis, suitability and coverage of data, and identifying the various data types, formats, and data quality issues which exist within a given data source.

Developing transformation logic, interfaces and reports as needed to meet project requirements.

Participating in discussion for technical architecture, data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework (e. g. libraries, modules, execution environments).

Improving and performance-tuning the optimization of data pipelines.

Developing unit and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity.

Developing tools to measure the data quality and visualize the anomaly pattern in source and processed data.

Integrating automated processes into continuous integration workflows.

Contributing to data quality assurance standards and procedures.

What we're looking for. You're curious about new technologies and the game-changing possibilities it creates. You like to stay up-to-date with the latest trends and apply your technical expertise to solve business problems. You thrive in a fast-paced, innovative environment working as a phenomenal teammate to drive the best results and business outcomes.
You'll need to have:

Bachelor's degree or four or more years of work experience.

Four or more years of relevant work experience.

Programming experience in Scala, Java or Python

Experience in data engineering, preferably in Google Cloud Platform with BigQuery

Hands-on experience in designing, building, testing and deploying data pipelines in Teradata and Hadoop platform with experience in, HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie etc.

Good organizational skills and strong written and verbal communication skills.

Even better if you have one or more of the following:

Bachelor's degree in Computer Science or equivalent education/training

Five or more years of Software development and Testing experience.

Experience with development and automated testing in a CI/CD environment.

Hands on experience in dashboard development using Looker/Tableau

Knowledge of GIT/Jenkins and pipeline automation is a must.

Experience with developing and testing real-time data-processing and Analytics Application Systems.

Strong knowledge in SQL development on Database and/or BI/DW

Strong knowledge in shell scripting Experience in Web Services - API development and testing.

A solid understanding of common software development practices and tools.

Strong analytical skills with a methodical approach to problem solving applied to the Big Data/AI domain.

Experience with incident management tools (Opsgenie, PagerDuty etc) is a plus

If Verizon and this role sound like a fit for you, we encourage you to apply even if you don't meet every "even better" qualification listed above.
This role is eligible to be considered for the Department of Defense SkillBridge Program.
Where you'll be working In this hybrid role, you'll have a defined work location that includes work from home and a minimum eight assigned office days per month that will be set by your manager. Scheduled Weekly Hours 40 Equal Employment Opportunity We're proud to be an equal opportunity employer - and celebrate our employees' differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.
Our benefits are designed to help you move forward in your career, and in areas of your life outside of Verizon. From health and wellness benefits, short term incentives, 401(k) Savings Plan, stock incentive programs, paid time off, parental leave, adoption assistance and tuition assistance, plus other incentives, we've got you covered with our award-winning total rewards package. For part-timers, your coverage will vary as you may be eligible for some of these benefits depending on your individual circumstances. If you are hired into a California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Minnesota, Nevada, New York, Rhode Island, Washington or Washington, D. C. work location, the compensation range for this position is between $104,000. 00 and $194,000. 00 annually based on a full-time schedule. The salary will vary depending on your location and confirmed job-related skills and experience. This is an incentive based position with the potential to earn more. For part time roles, your compensation will be adjusted to reflect your hours.