Job Details: Data Engineer


Job Title : Data Engineer
Job Ref No : 26125-0002
Job Posted Date : 1/17/2019
Job State : North Carolina
Job City : Raleigh
Who Can Apply : US Citizens, GC, EAD, TN, H1B
No of Openings : 2
Skills Required : Other Skills,Hadoop AWS

Job Description :


5+ years of experience owning and building data pipelines.
Extensive knowledge of data engineering tools, technologies and approaches
Ability to absorb business problems and understand how to service required data needs
Design and operation of robust distributed systems
Proven experience building data platforms from scratch for data consumption across a wide variety of use cases (e.g data science, ML, scalability etc)
Demonstrated ability to build complex, scalable systems with high quality Experience with specific AWS technologies (such as S3, Redshift, EMR, and Kinesis)
Experience with multiple data technologies and concepts such as Airflow, Kafka, Hadoop, Hive, Spark, MapReduce, SQL, NoSQL, and Columnar databases. a plus
Experience in one or more of Java, Scala, python and bash.

Expected Outcomes:
Design and implement data infrastructure and processing workflows required to build a data lake in AWS to support data science, machine learning, BI and reporting also in AWS Build robust, efficient and reliable data pipelines consisting of diverse data sources
Design and develop real time streaming and batch processing pipeline solutions
Own the data expertise and data quality for the pipelines
Drive the collection of new data and refinement of existing data sources
Identify shared data needs across Advanced Auto Parts, understand their specific requirements, and build efficient and scalable pipelines to meet various needs
Build data stores for feature variables required for machine learning

Are you Looking for a IT Training or IT Job?

Quick Apply this Job!

(doc, docx, rtf, pdf, txt were Acceptible)

quick Apply this job - It takes < 1 min to Apply!

Related Jobs

Senior Hadoop Data Engineer Hartford..

3 or more years of complex related experience.Has strong knowledge of large-scale search applications and building h..

pega LSA

Hi, Hope you are doing great, Please review the job description and suggest your interest for the opening. Please..

Agile Coach

We are having urgent requirement from our direct clients.Location: Boston,MADuration: 6+ monthsE..

Oracle SOA developer

Hi,Hope you are doing great!!Role: Oracle SOA developerLocation: Brea, CADuration:: 12+ Months<b..

Java Backend Developer

Position: Java Developer Location: Pleasanton, CA Duration: Contract Job Responsibilities: • Experienced in usin..

Lead Software Engineer

Position: Lead Software Engineer Location : Redmond :Washington Duration: 6+ Months Mode: C2C Rate: DOE ..

Helpdesk Analyst

Helpdesk Analyst Raleigh, NC Duration: 1+ years F2F interview The position will act as a member of the operatio..

Data Engineer

• 5+ years of experience owning and building data pipelines. • Extensive knowledge of data engineering tools, techno..

Big Data Engineer

4+years of experience - Java or Scala expertize - SQL, SparkQL and HiveQL expertize -Kafka - Shell Scripting Knowled..

Warehouse Director

Title: Warehouse Director Location: Irvine, CAType: Contract – Full time Job description : SUMMA..