岗位职责:
-负责大型数据生态系统的需求收集,设计,开发和测试,包括数据管理,治理以及结构化和非结构化数据的集成
-定义并建立大规模的流数据处理管道。
-研究数据,识别模式并将其转换为算法
-与团队成员和业务部门有效合作,并根据需要担任SME和指导者
-在混合了onshore 和 offshore的敏捷环境中工作
Key Objective of the role:
- Responsible for requirement gathering, design, development, and testing of large-scale data ecosystem including data management, governance and the integration of structured and unstructured data
- Define and build large-scale streaming data processing pipelines.
- Study data, identify patterns, and convert it to algorithms
- Effectively collaborates with team members and business units and acts as a SME and mentor as needed
- Works in an Agile environment with a mix of onshore and offshore resources
要求:
-计算机科学,信息系统,信息管理,商业统计学位或同等学历;
-在数据管理项目(包括Informatica PowerCenter,Informatica DEI等工具)方面具有至少4年的丰富实践经验。
-2年使用大数据生态系统的经验,包括Hadoop,Spark,HBase,Hive和Kafka等工具
-精通Python,Scala或类似语言
-数据湖,数据集线器实施方面的经验
-具有AWS或Azure平台知识者优先
-出色的数据集成方案分析和问题解决能力,可以快速识别,隔离和解决技术问题
-良好的分析和沟通能力
-经验较少的候选人也将被考虑
Requirement:
- Degree in Computer Science, Information Systems, Information Management, Business Statistics or equivalent;
- At least 4 years of strong hands-on experience in data management project including tools such as Informatica PowerCenter, Informatica DEI.
- 2 years’ experience working with Big Data ecosystem including tools such as Hadoop, Spark, HBase, Hive and Kafka
- Proficiency in Python, Scala or similar languages
- Experience on data lakes, datahub implementation
- Knowledge on AWS or Azure platforms is a plus
- Excellent analytical and problem-solving skills to data integration scenarios and quickly recognize, isolate, and resolve technical problems
- Good analytical and communication skills
- Candidate with less experience will also be considered


Copyright C 2019-2024 All Rights Reserved 版权所有 怀才当遇人才科技集团 赣ICP备20001974号-1
地址:江西运营中心:江西省南昌市红谷滩区VR产业基地4A写字楼6楼 EMAIL:admin@hcdyhr.cn