Senior ETL & AI/ML Test Automation Engineer
Must Have Technical/Functional Skills
ETL & Data Testing
•Validate end-to-end ETL/ELT pipelines across enterprise data platforms.
•Perform Source-to-Target validation and reconciliation testing.
•Validate data transformations, aggregations, business rules, and lineage.
•Execute data quality checks on large-scale structured and semi-structured datasets.
•Perform schema, metadata, and Delta Lake validations.
•Write complex SQL queries for backend validation and data integrity testing.
•Validate CDC (Change Data Capture) and incremental data loading processes.
•Test batch and streaming data pipelines.
Databricks Testing
•Validate Databricks notebooks, Workflows, Jobs, Delta Live Tables, and Unity Catalog implementations.
•Test Bronze, Silver, and Gold layer data transformations.
•Verify workflow orchestration and dependency handling across Databricks jobs.
•Perform performance validation of Spark and PySpark transformations.
•Validate data quality frameworks implemented in Databricks.
AI/ML Testing
•Validate AI/ML model integrations within enterprise applications.
•Verify model scoring results and prediction outputs.
•Perform data drift, schema drift, and feature validation testing.
•Validate feature engineering pipelines and training datasets.
•Execute model input/output verification against expected business outcomes.
•Validate explainability, traceability, and auditability requirements.
•Test model deployment workflows integrated through MLflow, Databricks ML, Azure ML, or similar platforms.
•Validate GenAI/RAG workflows, prompt-response accuracy, and grounding mechanisms where applicable.
Integration Testing
•Perform end-to-end integration testing across:
oDatabricks
oData warehouses
oAPIs
oAI/ML services
oCloud platforms
oDownstream reporting systems
•Validate data flow between source systems, data lakes, ML models, and consuming applications.
•Perform contract testing and API validation.
Test Automation
•Design and develop automation frameworks for:
oETL testing
oAPI testing
oData validation
oML model validation
•Build reusable test utilities using Python.
•Integrate automated tests into CI/CD pipelines.
•Develop automated quality gates for deployment validation.
•Generate automated execution reports and test metrics.
required
6+ years of experience in ETL/Data Testing.
3+ years of experience testing Databricks or Spark-based platforms.
Hands-on experience in AI/ML Model Testing or MLOps validation.
Strong coding experience in Python and SQL. Education
Bachelor's degree
TCS Employee Benefits Summary
•Discretionary Annual Incentive.
•Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
•Family Support: Maternal & Parental Leaves.
•Insurance Options: Auto & Home Insurance, Identity Theft Protection.
•Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
•Time Off: Vacation, Time Off, Sick Leave & Holidays.
•Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $120000 - $130000 a year
#LI-JH1
More Information
Application Details
- Organization DetailsTCS / Tata Consultancy Services
Recommended Comments
There are no comments to display.
Join the conversation
You are posting as a guest. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.