Big Data Developer

Company: LTI - Larsen & Toubro Infotech
Location: Irving
Posted on: November 22, 2021

Job Description:

Job Title: Big Data Developer (Pyspark)

JOB DESCRIPTION: -
5+ years working experience in data integration and pipeline development.
2+ years of experience with Cloud on data integration with Apache Spark, EMR, Glue or similar Data-lake technologies.
Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
Design, develop test, deploy, maintain and improve data integration pipeline.
Experience in Python and common python libraries.
Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and integration tools.
Strong debugging skills required in Java Spark/Python/API Spark-Integration/Hadoop.
Databricks or Apache Spark using Scala Experience is appreciated. -Knowledge of analytical data processing and basic statistics is desirable.
Programming Languages: Java, Python, Shell (Bash) script.
Data-tools: Apache Spark, Impala, Hive, Hadoop.

Responsibilities
Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform.
Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities.
Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts.
Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements.

How will you grow?
- - - - - - - - -Role-based Training programs
- - - - - - - - -Continuing Education Programs (CEP) to enhance your knowledge, skills, and attitude as a professional
- - - - - - - - -We encourage you to acquire various beneficial international certifications, with costs s reimbursed
- - - - - - - - -Our role-based workshop helps us groom future leaders for LTI

What's in it for you?
- - - - - - - - -Excellent benefits plan: medical, dental, vision, life, FSA, & PTO
- - - - - - - - -Roll over vacation days
- - - - - - - - -Commuter benefits
- - - - - - - - -Excellent growth and advancement opportunities
- - - - - - - - -Certification reimbursement
- - - - - - - - -Rewards and recognition programs
- - - - - - - - -Innovative and collaborative company culture

We are an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, sexual orientation, disability status, protected veteran status, or any other characteristic protected by law.

Keywords: LTI - Larsen & Toubro Infotech, Irving , Big Data Developer, IT / Software / Systems , Irving, Texas