IrvingRecruiter Since 2001
the smart solution for Irving jobs

GCP Senior Big Data Engineer/Architect

Company: eTeam Inc.
Location: Irving
Posted on: January 15, 2022

Job Description:

Job DescriptionJob Title: GCP Senior Big Data Engineer/ArchitectLocation: Irving, TXDuration: 12 MonthsDescriptionBigData Architect with a minimum of 6+ years of experience to join our Datalake team. They will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure Data Platform runs 24/7.Possess extensive analysis, design and development experience in Hadoop and AWS Big Data platformsAble to critically inspect and analyze large, complex, multi-dimensional data sets in Big Data platformsExperience with Big Data technologies, distributed file systems, Hadoop, HDFS, Hive, and HbaseDefine and execute appropriate steps to validate various data feeds to and from the organizationCollaborate with business partners to gain in-depth understanding of data requirements and desired business outcomesCreate scripts to extract, transfer, transform, load, and analyze data residing in Hadoop and RDBMS including Oracle and TeradataDesign, implement, and load table structures in Hadoop and RDBMS including Oracle and Teradata to facilitate detailed data analysisParticipate in user acceptance testing in a fast-paced Agile development environmentTroubleshoot data issues and work creatively and analytically to solve problems and design solutionsCreate documentation to clearly articulate designs, use cases, test results, and deliverables to varied audiencesCreate executive-level presentations and status reportsUnder general supervision, manage priorities for multiple projects simultaneously while meeting published deadlinesBachelor's degree or Master's degree in Computer Science or equivalent work experienceHighly proficient and extensive experience working with relational databases, particularly Oracle and TeradataExcellent working knowledge of UNIX-based systemsExcellent Interpersonal, written, and verbal communication skillsVery proficient in the use of Microsoft Office or G Suite productivity toolsExperience with designing solutions and implementing IT projectsExposure to DevOps, Agile Methodology, CI/CD methods and tools, e.g. JIRA, Jenkins, is a huge plusPrior work experience in a telecommunications environment is a huge plusExperience with Spark, Scala, R, and Python is a huge plusExperience with BI visualization tools such as Tableau and Qlik is a plusBackground in financial reporting, financial planning, budgeting, ERP (Enterprise Resource Planning) is a plusExposure to advanced analytics tools and techniques e.g. machine learning, predictive modeling is a plus.MUST HAVE SKILLS (Most Important):Experience with Hadoop Data Platforms Experience with Relational databases like OracleSQL/PLSQLUnix Shell ScriptCRONJOBHIVEDESIRED SKILLS:PythonJavaHive and Spark cluster environmentsQlik SenseJOB DUTIES:Install and configure Hadoop clusters, Sqoop,Python & Spark packages Expertise in administration of Hive, Kafka, Python, Hbase, Spark, Sqoop Manage Hadoop,Kafka,hbase, Sqoop,Hive and Spark cluster environments Apply proper architecture guidelines to ensure highly available services Plan and execute major platform software and operating system upgrades and maintenance across physical environments Develop and automate processes for maintenance of the environment Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access) Ensure proper resource utilization between the different development teams and processes Design and implement a toolset that simplifies provisioning and support of alarge cluster environment Review performance stats and query execution/explain plans; recommend changes for tuning Create and maintain detailed, up-to-date technical documentation Ability to shell script with Linux Integration to other Hadoop platformsEDUCATION/CERTIFICATIONS:Bachelors or Masters degree in Computer Science, Information Systems, Engineering, or Mathematics preferred.

Keywords: eTeam Inc., Irving , GCP Senior Big Data Engineer/Architect, Engineering , Irving, Texas

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Texas jobs by following @recnetTX on Twitter!

Irving RSS job feeds