Apply to this job

Back to search

Posted July 31st

Data Engineer III, Technology

Bentonville, Arkansas

Employer

Walmart

Industry

Retailer

View Full Profile

Posted July 31st

Data Engineer III, Technology

Bentonville, Arkansas

Function

Other

Experience

Other

Type

Full Time

What you'll do

Design, develop and build database and architecture to power Big Data analytical systems. Experience in using HDFS, Hive, Hive UDF's, MapReduce, Druid, Spark, Python, Hue, Shell Scripting, Unix. Design data integration pipeline architecture and ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark ,SQL ,HQL and other technologies. Build robust and scalable applications using SQL, Scala/Python and Spark. Create real time data streaming and processing using Open source technologies using Kafka and/or Spark streaming. Work on creating data ingestion processes to maintain Global Data lake on the GCP cloud and Big Query. Engage with architects and senior technical leads to create and enhance complex software components Design, configure and implement systems that can scale to manipulate, understand, process gigabytes of data between heterogeneous on-premise and cloud stores. Work with business customers, product managers and engineers to design feature-based solutions and implement them in an agile fashion Develop proof-of-concept prototype with fast iteration and experimentation Develop and maintain design documentation, test cases, performance and monitoring and performance evaluation using Git, Crontab, Putty, Jenkins, Maven, Confluence, ETL, Automic , Zookeeper, Cluster Manager. Performed Continuous Integration and deployment using Jenkins and Git. Minimum Qualifications...Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications. Option 1: Bachelor's degree in Computer Science and 2 years' experience in software engineering or related field. Option 2: 4 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science. Preferred Qualifications...Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications. Data engineering, database engineering, business intelligence, or business analytics, Master's degree in Computer Science or related field and 2 years' experience in software engineering or related field

Minimum Qualifications

Option 1: Bachelor's degree in Computer Science and 2 years' experience in software engineering or related field. Option 2: 4 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science.

About Walmart

At Walmart, we help people save money so they can live better. This mission serves as the foundation for every decision we make, from responsible sourcing to sustainability-and everything in between. As a Walmart associate, you will play an integral role in shaping the future of retail, tech, merchandising, finance and hundreds of other industries-all while affecting the lives of millions of customers all over the world. Here, your work makes an impact every day. What are you waiting for?
Location
Bentonville, Arkansas