What's your preference?
Job Description
- Req#: R-2104569
- Develop data pipelines/data frameworks/applications/apis using industry best practices. Make adjustments to adapt to new methodologies that provide the business with increased flexibility and agility.
- Troubleshoot and resolve issues related to data quality and execution.
- Lead the design, creation, and deployment of large datasets to be used for statistical modeling and data mining.
- Ensure data security and compliance with all regulatory requirements.
- Regularly test system for vulnerabilities and develop solutions for any potential data breaches.
- Drive Proof of Concept (POC) and Proof of Technology(POT) evaluations.
- Build data system and data quality monitoring process and ensure health of the big data system.
- Review KPIs, Monitoring and Alarms for successful production system.
- Work with the stakeholders to understand the business & reporting needs – Propose, design and develop creative data solutions that provides required insight, improve/automate processes and adds value.
- Influence and educate the team with your experience, idea and learning.
- Stay current with the latest development tools, technology ideas, patterns and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.
- Publish and update technical architecture and user/process documentation.
- Provide technical direction, architecture leadership and expertise to the team.
- Bachelor’s degree in Computer Science or related technical field.
- 7+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc.
- A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving.
- Professional hand-on experience in Sql and Query Optimization.
- Experience in building frameworks for data ingestions and consumptions patterns.
- Experience with Orchestration tools like Airflow ( perfered) , Automic , Autosys etc.
- Hand-on experience in Data processing and Data manipulation.
- Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc.
- Experience with Streaming data via Kafka or structured streaming etc.
- Exposure to lambda Architecture.
- Exposure to visualization tools for data reporting such as Tableau, PowerBI, Looker etc.
- Excellent communication skills for collaborating with teams.
- Appreciate productivity and care deeply about helping others work more effectively and efficiently.
Position Summary...
What you'll do...
About Team:
International Technology: Focusing on customer, associate and business needs, this team works with Walmart International, which includes more than 5,900 retail units, operating outside the United States with 55 banners in 26 countries such as Africa, Argentina, Canada, Central America, Chile, China, India, Japan, Mexico and United Kingdom to name a few. Our focus is to build a continuous, seamless, omni-channel customer experience across physical stores, eCommerce, and mobile commerce, that is unique to Walmart and sets us apart from our competition. We are building grounds up platforms & products using cutting edge technology and also modernizing existing platforms & products.
This role is for Data Engineering team within International Search & Personalization team. The group focuses on collection, organisation, governence, and access management of data to support data operations and enable training, evaluation, serving of machine learning models.
What You’ll Do:
What you'll bring :
Mandatory Skills
Scala/Python (Pyspark), Big Data Knowledge, Scripting (Shell/Python), GCP Data Tech Stack, Airflow, CICD, Kafka, Distributed Database, SQL/NoSQL
About Walmart Global Tech
From entry-level to executive positions, Walmart provides limitless opportunities for growth, and career development. Walmart started small, with a single discount store and the simple philosophy of selling more for less. Today, we are a growing technology-enabled company founded on the same values as our first store. We establish clear expectations, empower associates to manage their work, and hold ourselves and one another to a high standard. Walmart's scale enables us to have an. No other company has the reach of Walmart, with 2.3 million associates worldwide and over 230 million weekly customers. Walmart is reshaping retail by investing in an expanding workforce. While technology is at the heart of our digital transformation, people are the reason we succeed and the force behind our innovations. We train our team in the skillsets of the future and bring in experts like you to help us grow.
Flexible, Hybrid Work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
Minimum Qualifications...
Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field. Option 2: 5 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 1 year's experience in software engineering or related field. 2 years' experience in data engineering, database engineering, business intelligence, or business analytics.Preferred Qualifications...
Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Primary Location...
Pardhanani Wilshire Ii, Cessna Business Park, Kadubeesanahalli Village, Varthur Hobli , IndiaAbout the company