Job Description
Greetings from Accion Labs, Our direct Client is looking for Sr. AWS Data Engineer-6+ Months Contract-Remote opportunity-Direct Customer. Primary Skills : Snowflake , Python ,AWS Glue , Lamda using Pyspark , SQL. Job Description: Collaborate with cross-functional teams including Data Scientists, Analysts, and Engineers to gather data requirements and build scalable data solutions, including processing unstructured data for AI initiatives . Design, develop, and maintain complex ETL pipelines using AWS Glue, PySpark, and Databricks , ensuring efficient data processing across batch and streaming workloads. Integrate and manage data storage and retrieval using AWS DynamoDB and Snowflake, optimizing for performance and scalability. Ensure data integrity, quality, and security across data pipelines, applying best practices for encryption, IAM, compliance, and data governance (e.g., Atlan) . Monitor and troubleshoot pipeline issues, manage production incidents (P1-P4) with thorough RCA , and continuously optimize for cost and performance across AWS services. Stay current with advancements in AWS Glue, PySpark, Databricks , and data infrastructure tools (including AI assistants like GitHub Copilot) , and recommend improvements where applicable. Experience / Minimum Requirements: 10+ years of experience as a Data Engineer, with strong hands-on expertise in AWS Glue, PySpark, AWS DynamoDB, Snowflake, and Databricks . Deep understanding of Spark architecture, distributed processing, and performance tuning techniques. Strong grasp of data modeling, schema design, and data warehouse concepts. Experience with AWS data ecosystem including S3, Lambda and Glue Catalog. Proficiency in Python (PySpark) for data transformation and automation tasks. Familiarity with CI/CD practices, infrastructure-as-code tools such as Terraform, data cataloging (Atlan), and legacy platform migration is a plus. Excellent communication and problem-solving skills, with the ability to work independently and in a team environment. Education: Bachelor s degree in computer science, information Systems, or related discipline. This role is open to W2 or those seeking Corp-Corp employment. The salary range for this role is 100-120 k/annum or Corp-Corp rates please contact the recruiter. In addition to other benefits, Accion Labs offers a comprehensive benefits package, with Accion covering 65% of the medical, dental, and Vision Premiums for employees, their spouses, and dependent children enrolling in the Accion-provided plans.