IrvingRecruiter Since 2001
the smart solution for Irving jobs

Big Data Engineer

Company: PriceSenz
Location: Irving
Posted on: May 17, 2020

Job Description:

The Big Data Engineer I is responsible for designing, developing, testing, tuning and building a large-scale data processing system for data products that allow HMS to improve quality, velocity and monetization of our data assets for both Operational Applications and Analytical needs. Responsibilities bull Responsible for design, development and delivery of data from operational systems and files into ODS, downstream Data Marts and files.bull Works with BA's, end users and architects to define and process requirements, build code efficiently and work in collaboration with the rest of the team for effective solutions. bull Research, develop and modify ETL processes and job according to the requirements.bull Develop Spark Jobs, Custom UDF using Spark RDDs, Data frames, and Spark SQL. bull Strong analytical SQL experience working with dimensional modeling.bull Troubleshoot and develop on Hadoop technologies including HDFS, Hive, NiFi, Hue, Pig, Flume, HBase, Spark, Kafka, Impala and Hadoop ETL development via tools such as Informatica, Talend.bull Build a service structure on AWS or AZURE capable of being deployed and scaled to runa variety of platform components dynamicallybull Knowledge of and experience with any Azure Data Platform components ndash Azure Data Lake, Data Factory, Data Management Gateway, Azure Storage Options, DocumentDB, Data Lake Analytics, Stream Analytics, EventHubs, Azure SQLbull Translate, load and present disparate data sets in multiple formats and multiple sources including JSON, Avro, text files, Kafka queues, and log data.bull Implement quality logical and physical ETL designs that have been optimized to meet the operational performance requirements for our multiple solutions and products. bull Experience to design the optimal performance strategy, and manage the technical metadata across all ETL jobs.bull Responsible for building solutions involving large data sets using SQL methodologies, Data Integration Tools like Informatica in any database.bull Deliver projects on-time and to specification with quality. Qualifications bull 8+ years of experience in managing data lineage and performing impact analysis.bull 5+ years of experience with any ETL tool development and relational DB with strong SQL skills.bull 4+ years of experience with Hadoop Eco System.bull Experience working in cloud services on Azure or AWS.bull Experience working in Data Management projects.bull Experience working in Hive or related tools on Hadoop, Performance tuning, File Format, executing designing complex hive HQL's, data migration conversion.bull Experience working with programing language like JavaScala or python. Python preferred.bull Experience working in agile environment. bull Experience working with Spark for data manipulation, preparation, cleansing. bull Experience working with ETL Tools (InformaticaDSSSIS) for data Integration. bull Experience designing and developing automated analytic software, techniques, and algorithms.bull Ability to handle multiple tasks and adapt to a constantly changing environment.bull Self-starter with the ability to work independently and take initiatives.bull Ability to translate ideas and business requirements into fully functioning ETL workflows. bull Ability to apply mastery knowledge in one of the relational database (DB2, MSSQL, Teradata, Oracle 8i9i10g11i)bull Expert ability and hands-on experience in SQL is a must.bull Experience with UnixLinux and shell scripting.bull Strong analytical and problem-solving skills.bull Excellent written and oral communication skills, with the ability to articulate and document processes and workflows for use by various individuals of varying technical abilities.bull Knowledge of HealthCare is a plus. Minimum Education bull MSBS in Computer Science, Information Systems, or related field preferred andor equivalent experience. Additional Skills bull Ability to work both independently and in a collaborative environment.bull Excellent problem-solving skills, communication skills and interpersonal skills.bull Ability to analyze information and use logic to address work-related issues and problems.bull Ability to demonstrate proficiency in Microsoft Access, Excel, Word, PowerPoint and Visio.bull Experience working in DevOps environment is a plus.bull Experience or knowledge of web architecture, (Javascript, SOAPXML, Weblogic, Tomcat) is a plus.bull Experience with an ORM framework, SOA Architecture, Microservices is a plus.bull Experience with Middleware components (ESB, API Gateway) is a plus.

Keywords: PriceSenz, Irving , Big Data Engineer, Engineering , Irving, Texas

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Intermediate Remote Sensing Scientist / Engineer
Description: OVERVIEW br br Frontier Technology, Inc. is seeking a Physical Scientist to support existing contracts in the Beverly, MA area. Frontier Technology, Inc. s Sensor and Data Services group is a collaborative (more...)
Company: Frontier Technology Inc.
Location: Fort Worth
Posted on: 06/3/2020

Controls Engineer
Description: Aerotek is currently supporting multiple controls engineering positions for a company that is in the electrical equipment, wiring supplies, and construction materials industry Major Job Duties and Responsibilities: (more...)
Company: Aerotek
Location: Arlington
Posted on: 06/3/2020

URGENT: Mechanic Wanted - I'm A Marine
Description: Compressor br Acura tsx
Company: MeetA USD
Location: Dallas
Posted on: 06/3/2020


Senior Avionics Engineer - Top Secret clearance
Description: Description: br WANTED: a Senior Avionics Engineer for a Navy project, br with experience supporting P-3 and P-8 avionics systems. br As a Senior Avionics Engineer, you will: br Join a well-established (more...)
Company: AMERICAN SYSTEMS
Location: Dallas
Posted on: 06/3/2020

91B Light-Wheel Vehicle Mechanic
Description: As a Light-Wheel Vehicle Mechanic for the Army National Guard you'll ensure that anything that moves on wheels is ready to hit the road. In this role, you will primarily be responsible for supervising (more...)
Company: Army National Guard
Location: Arlington
Posted on: 06/3/2020

IBX Facility Engineer IV
Description: IBX Facility Engineer IV br br Equinix is one of the fastest growing data center companies, growing connectivity between clients worldwide. That s why we're always looking for creative and forward-thinking (more...)
Company: Equinix
Location: Dallas
Posted on: 06/3/2020

Diesel Technician/Mechanic - All Skill Levels
Description: Due to the current Coronavirus COVID-19 pandemic and its impact on business operations, Penske is temporarily delaying our hiring for most positions within our organization. We expect to have positions (more...)
Company: Penske
Location: Arlington
Posted on: 06/3/2020

Sr. Cloud DevOps Engineer
Description: JOB TITLE: SR. CLOUD DEVOPS ENGINEER br br LOCATION: DALLAS, TX br br SUMMARY: br br The Infor Cloud team is looking for DevOps Engineer, under the general direction from the Manager of Operations, (more...)
Company: Infor
Location: Dallas
Posted on: 06/3/2020

Tech Risk - SIRT - Sensor Grid Engineering - ERA Copy - Security Incident Response Team
Description: MORE ABOUT THIS JOB br br Business Unit Overview br br Led by the Chief Information Security Officer CISO , Technology Risk secures Goldman Sachs against hackers and other cyber threats. We are (more...)
Company: The Goldman Sachs Group
Location: Dallas
Posted on: 06/3/2020

Sr Test Engineer Lead
Description: NTT DATA's Client is currently seeking a Sr Test Engineer Lead with 7 years of experience in IT and 5 years of Test Management and strategy to join their team in Plano, Texas US-TX , United States (more...)
Company: NTT DATA Corporation
Location: Plano
Posted on: 06/3/2020

Log In or Create An Account

Get the latest Texas jobs by following @recnetTX on Twitter!

Irving RSS job feeds