COMPLETE 数据工程师Data Engineer - Shanghai, China

Job Posting Title:

数据工程师Data Engineer

Req ID:

10054889

Job Description:

数据工程师

业务部门:  信息技术

工作地点-国家/地区: 中国，上海

职位介绍：

作为数据工程师您将代表信息技术部门 参与数据项目，了解业务数据需求，了解业务流程，设计数据应用抓取，存储，分析展示的技术方案，并处理商业智能平台的日常故障排除和修复。您需要熟悉数据应用架构，商业智能组件，数据安全，按工作的优先级管理工作内容。您的职业机会包括设计数据分析系统解决方案，优化业务运营，设计数据模型和算法，或者发挥您的好奇心发掘任何数据分析中有趣的领域。

工作内容：

• 您将设计开发数据集成批处理任务，ETL 脚本，满足数据输入和输出的需求
• 您将维护支持现有的BI 工具平台日常运行，包括Tableau，BO，SAS 等
• 您将数据可视化开发，进行报表和仪表盘的设计开发
• 您将配置部署项目数据库，并支持数据库相关故障排除任务
• 您将负责数据库日常管理以及运维工作

我们希望您：

• 具备计算机/信息技术学士学位或同等学历，具有五年以上相关工作经验
• 5年以上数据库管理经验，或者3年以上数据工程相关经验

• 能够设计数据类应用技术方案，熟悉数据抓取，存储，分析展示的方案细节
• 熟悉维度建模技术概念，(事实, 维度, Kimball 或者Inmon方法论）
• 能够开发程序语言或者脚本用以处理数据（例如：SQL, PL/SQL, Bash, Python 等）
• 能在Oracle或SQL Server 中高效查询修改TB级数据集，并根据需求优化查询以及批处理作业
• 熟悉至少一种数据库产品的管理和维护，如Oracle, MySQL, SQL Server, MongoDB等等
• 熟悉至少一种商业智能产品，如Tableau, Business Objects, SAS, Qlik等等
• 能够在截止时间内独立完成工作，处理多项任务并准确地履行工作职责
• 突出的沟通能力，团队成员注重交流，与内部和外部各层级组织的成员合作
• 英语读写熟练，能够熟练阅读技术文档，书写商业邮件
• 了解Hive，Spark，Kafka，HDFS 等技术，具有Apache Hadoop/Spark技术的数据处理经验为佳

Data Engineer

Line of Business: Technology

Location: China, Shanghai

Job Summary:

You will be the data engineer participating in data projects to understand business data requirements, understand business process flows, develop data collection, storage, and analytics solutions, as well as managing daily operations, incidents, troubleshooting for existing Business Intelligence platforms.  You will be familiar with data application architecture, business intelligence products, data security, and comfortable prioritizing multiple varied workstreams.  Opportunities will include designing data solutions, optimizing business operations, developing data models & algorithms, and any exciting areas in the data analytics domain with your curiosity.

Key Responsibilities:

• You will design and develop data integration jobs, ETL scripts for inbound and outbound data pipes
• You will maintain daily operation for Business Intelligence platforms including Tableau, BO, SAS &, etc.
• You will develop data visualization layers such as reporting and dashboard
• You will deliver project database and support all DB related troubleshooting tasks
• You will perform day-to-day database administration and maintenance activities

Desired Qualifications:

• Bachelor's degree in CS/MIS or equivalent plus a minimum of 5 years of relevant professional experience in related fields
• 5+ years DBA experience, or 3+ years data engineering related experience
• Ability to design data solutions, familiar with solution details about data collection, storage, and analytics/visualization
• Familiar with Dimensional Modelling concepts, (fact, dimension, Kimball or Inmon approach)
• Ability to develop code/scripts for data processing with at least one of SQL, PL/SQL, Bash, Python, etc.
• Ability to query and manipulate large dataset (TB) in Oracle or SQL Server effectively, and improve performance of SQL and batch job according to requirements
• Familiar with at least one database product administration & maintenance (i.e.: Oracle, MySQL SQL Server, MongoDB, etc.)
• Familiar with at least one Business Intelligence products (i.e.: Tableau, Business Objects, SAS, Qlik, etc.)
• Ability to work with minimal supervision to meet deadlines, handle multiple priorities, and perform job responsibilities accurately
• Strong interpersonal skills to interact in a team environment and collaborate with team members internally and externally
• Proficient in spoken and written English. Able to read technical documents and write business communication emails
• Preferable with experience in Big Data processing using Apache Hadoop/Spark ecosystem applications like Hive, Spark, Kafka and HDFS

Job Posting Segment:

Technology & Digital

Job Posting Primary Business:

T&D - Information Technology (SHDR)

Primary Job Posting Category:

Data Engineering

Employment Type:

Full time

Primary City, State, Region, Postal Code:

Shanghai, China

Alternate City, State, Region, Postal Code:

Date Posted:

2023-10-12