Python/Spark Developer
Must Have Technical/Functional Skills
- Strong hands-on experience with Apache Spark and PySpark.
- Experience with Big Data ecosystems such as Hadoop, Hive, HDFS, and Kafka.
- Proficiency in SQL and relational databases.
- Strong understanding of distributed computing and performance tuning.
- Experience with version control tools such as Git.
- Knowledge of Linux/Unix environments.
- Strong problem-solving and analytical skills.
Additional Requirement:
•Good understanding of GenAI concepts and applications
•Ability to identify opportunities to leverage AI and implement AI-driven solutions where appropriate
•Exposure to Data Products, Metadata Management, Knowledge Graphs, Ontology, or Semantic Technologies will be an added advantage
Roles & Responsibilities:
- Develop and maintain data processing applications using Python and Apache Spark (PySpark).
- Design, build, and optimize ETL/ELT pipelines for large-scale datasets.
- Process and analyze structured, semi-structured, and unstructured data from multiple sources.
- Implement data transformation, cleansing, and validation frameworks.
- Collaborate with Data Engineers, Data Scientists, Business Analysts, and stakeholders to understand business requirements.
- Optimize Spark jobs for performance, scalability, and reliability.
- Develop reusable components and data processing frameworks.
- Monitor and troubleshoot production issues related to Spark applications.
Salary Range - $100,000-$120,000 a year
TCS Employee Benefits Summary:
1. Discretionary Annual Incentive.
2. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
3. Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
4. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
5. Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
More Information
Application Details
- Organization DetailsTCS / Tata Consultancy Services
Recommended Comments
There are no comments to display.
Join the conversation
You are posting as a guest. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.