Skill: Data Engineer
- Must have Python, AWS skills.
- As a Lead Software Engineer specializing in modern data engineering, you will play a crucial role in our data ecosystem, leveraging your expertise in AWS tools, scripting, data analytics, and software development.
- Collaborating with cross-functional teams, you will be responsible for designing, implementing, and maintaining data pipelines, ensuring seamless integration between on-premises and cloud-based environments.
- Your role will involve working closely with data analysts, QA engineers, architects, and DevOps teams to meet project goals efficiently and effectively.
- The Software Engineer works under the guidance of senior team members, operating under a clear framework of accountability with substantial autonomy.
- The successful candidate will develop a strong domain knowledge of the relevant business area/s, managing key.
Responsibilities:
- Develop and maintain data pipelines between on-prem relational databases and AWS cloud environment using AWS tools such as DMS, Glue, Redshift, and cloud databases.
- Utilize strong scripting skills in Python for automation and data manipulation tasks.
- Collaborate with CICD DevOps teams using tools like GitLab for continuous integration and deployment.
- Participate in Agile framework practices, assisting with project planning, estimation, and design.
- Evaluate business needs, translate them into technical requirements, and document artifacts accordingly.
- Monitor, maintain, and enhance data and application processes, ensuring adherence to SLAs and process compliance.
- Proactively identify and implement process improvements to optimize data workflows and enhance efficiency.
- Participate in end-to-end implementation of large-scale software development projects, ensuring high-quality deliverables.
- Interpret and analyze data sets using statistical techniques, providing valuable insights to support business decision-making.
- Build dashboards and reports using BI solutions like Tableau to visualize data trends and patterns.
- Demonstrate strong expertise in cloud core technologies and stay updated with emerging trends in data engineering.
You Have:
- 10 + years of experience in software engineering with a focus on data engineering.
- 3-5 yrs experience in scripting languages such as Python for automation and data manipulation tasks.
- Experience with AWS tools including DMS, Glue, Redshift, and cloud databases.
- Strong data analytics skills with experience in interpreting and profiling data sets.
- Experience building dashboards and reports using BI solutions like Tableau.
- Familiarity with CICD practices and tools like GitLab for version control and deployment.
- Hands-on experience working in Agile framework environments.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
- Strong problem-solving skills and attention to detail.
- Proven ability to manage multiple projects and priorities simultaneously.
#LI-NR3
More Information
Application Details
-
Organization Details
TCS / Tata Consultancy Services