AWS Data Engineer with Python Pyspark - Bloomfield, CT

Job Description

·         Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.

·         Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL

·         Should have CICD experience using tools like GIT, Jenkins etc

·         Should have extensive handson exp erience with SPARK and real time analytic frameworks, data streaming & Structured streaming.

·         Knowledge in Databricks reporting.

·         They need to be experienced in programming language (Python, Pyspark)

·         Hands-on experience integrating open-source components into data-analytic solutions

·         Working with vendors to enhance tool capabilities to meet enterprise needs

·         Willingness to continuously learn & share learnings with others

·         Strong troubleshooting and performance tuning skills.

·         Experience building multi-tenant, virtualized infrastructure a strong plus