Loading, please wait...

data engineer

Posted on December 03, 2024 by Employer details Sri Technosoft Solutions

Job details

*Overview* We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our analytics and business intelligence initiatives. This role requires a strong foundation in programming, database design, and big data technologies. The Data Engineer will work closely with data scientists and analysts to ensure that our data infrastructure meets the evolving needs of the organization. *Duties* * Design and implement robust data pipelines to ingest, process, and store large volumes of data from various sources. * Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications. * Utilize programming languages such as Python and Java for data manipulation and analysis. * Work with big data technologies like Hadoop to manage large datasets efficiently. * Develop shell scripts for automation of data processing tasks. * Ensure the integrity, quality, and security of data throughout its lifecycle. * Optimize database performance through effective database design and management practices. * Monitor system performance and troubleshoot issues related to data processing or storage. * Stay updated with industry trends in analytics, big data technologies, and cloud services such as AWS. *Requirements* * Proficiency in programming languages including Python and Java. * Experience with big data frameworks such as Hadoop. * Strong skills in shell scripting for task automation. * 3+ yrs of hands-on experience is must. * Familiarity with database design principles and experience with relational databases. * Knowledge of server management and cloud services (AWS preferred). * Ability to analyze complex datasets and provide actionable insights. * Excellent problem-solving skills with a focus on detail-oriented work. * Strong communication skills to collaborate effectively with technical and non-technical stakeholders. * A degree in Computer Science, Information Technology, or a related field is preferred. Job Type: Full-time Pay: $99,977.00-$117,463.00 per year Additional pay: * Signing bonus Benefits: * Life insurance * Work from home Schedule: * 8 hour shift * Monday to Friday