This job is now closed
Job Description
- Req#: 00062924241
- Ingestion configuration
- Wring python/pyspark and spark SQL code for validation/curation in notebook
- Create data integration test cases
- Implement or amend worker pipelines
- Implement Data validation /curation rules
- Convert data model data mapping the technical data mapping
- Implement Integrations
- Data migration implementation and execution
- Data analysis (profiling etc)
- Azure devops/github configurations for ADF and data bricks code
- Strong experience in Designing and delivering Azure based data platform solutions ,technologies including
- Azure ADF and Data bricks, Azure Functions,App Service ,Logic app,AKS,Azure app servie,Webapp
- Good knowledge in real time streaming applications preferably with experience Kafka Real time messaging or Azure function ,Azure service bus.
- Spark processing and performance tuning
- File formats partitioning for e.g. Parquet,JSON,XML,CSV
- Azure Devops/git hub
- Hands on experience in at least one of Python with knowledge of the others
- Experience of synchronous and asynchronous interface approaches
- Knowledge in data modeling (3NF/Dimensional modeling/Data Vault2)
- Work experience in agile delivery
- Able to provide comprehensive documentation
- Able to set and manage realistic expectations for timescales, costs, benefits and measures for success
- Experience with integration and implementation of data cataloging tool like Azure Purview/Collabra
- Experience in implementing and integrating visualizations tools like Power BI/Tableau etc
- Experience C# application development (ASP.net MVP)
Tasks and Responsibilities
Engineering:
Our ideal candidate:
Nice to Have:
About the company
Cognizant is a multinational technology company that provides business consulting, information technology and outsourcing services.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.