Roles & Responsibilities
• Automate and optimize batch workflows using robust Shell scripting and file-processing techniques.
• Manage secure file transfers using NDM (Connect: Direct) and SFTP, including monitoring, troubleshooting, and operational support.
• Develop scalable PySpark ETL pipelines, ensuring high performance and reliability for large-scale data processing.
• Implement automation and configuration management using Ansible, following Infrastructure as best practices.
• Collaborate with cross-functional teams to ensure secure, reliable, and compliant data-movement operations.
Required Skills:
Shell Scripting: Strong scripting and file-processing expertise for batch automation and workflow optimization.
PySpark: Hands-on experience developing scalable, high-performance, and reliable ETL pipelines for large-scale datasets.
NDM (Connect: Direct): Experience managing secure enterprise file transfers, monitoring transfer jobs, and troubleshooting failures.
SFTP: Strong knowledge of secure file-transfer operations, controls, monitoring, and issue resolution, Experience implementing automation and configuration management using Infrastructure as Code practices.
Operational Excellence: Ability to support secure, reliable, and compliant data movement in collaboration with cross-functional teams.
Salary Range: $100,000 to $135,000 per year
More Information
Application Details
- Organization DetailsTCS / Tata Consultancy Services
Recommended Comments
There are no comments to display.
Join the conversation
You are posting as a guest. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.