Loading, please wait...

data engineer

Title posted on indeed.com - AWS Data Engineer

Posted on November 29, 2024 by Employer details Princeton IT Services

Job details

*Job Title:* Data Engineer *Location:* Remote within Canada *Type:* Full-time *Job Summary* Seeking a skilled Data Engineer with expertise in SQL, Python, and AWS to design and maintain scalable data frameworks and pipelines. Ideal candidates will have strong problem-solving skills, hands-on experience with AWS S3 *Mandatory Skills* * Strong SQL Skills: Expertise in writing complex queries and working with databases like Oracle, PostgreSQL, Redshift, and MySQL. * Python Skills: Proficiency in Python for ETL development and data processing. * AWS Data Engineering: Extensive experience with AWS services, including Redshift, S3, DynamoDB, EMR Serverless, Lambdas, and Step Functions. * AWS S3 Bucket Management: Hands-on experience in optimizing and managing AWS S3 buckets for efficient data storage and retrieval. *Requirements* * 5-6 years of proven experience in data engineering. * Experience building data pipelines using AWS and Azure. * Advanced SQL Skills * Proficiency in ETL development using Python, PySpark, and Big Data technologies (Hadoop, Spark). * In-depth knowledge of data warehousing concepts, data modeling, and ETL processes. * Excellent communication skills to explain complex technical concepts to non-technical stakeholders. * Experience working with Agile methodologies and Scrum processes. * Strong problem-solving skills with the ability to work independently and mentor junior developers. * 2-3 years of experience in the financial or other highly regulated industries. * Familiarity with JIRA, DevOps, and CI/CD best practices. * Experience with emerging technologies like AWS QuickSight, Amazon Co-Pilot, or similar tools. *Additional Requirements* * Candidates must be willing to take a Python coding test as part of the selection process. Job Type: Full-time Pay: $90,000.00-$100,000.00 per year Experience: * Data engineering: 8 years (required) * AWS Data Engineer: 8 years (required) * AWS S3 Bucket: 3 years (required) * Python: 6 years (required) * strong sql skills: 8 years (required) * Oracle: 6 years (required)