Summary

Appen is seeking a highly skilled and motivated Data Engineer to join our dynamic team. In this role, you will use your extensive knowledge of software development to build and enhance complex systems and applications, contributing to the evolution of AI and machine learning.  

Key Responsibilities:

• Create and maintain optimal data pipeline architecture.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
• Build analytics tools that utilizes the data pipeline to provide actionable insights into customer delivered data, operational efficiency and other key business performance metrics.
• Optimize and improve our existing data products.

Qualifications :

• Bachelor's degree in computer science, Software Engineering, or a related field. A master's degree is a plus. 
• 2-5 years of experience in data engineering background.
• Strong programming skills in Python/Java, excellent SQL skills.
• Experience with relational SQL and NoSQL databases.
• Expertise in AWS services EMR, RDS, Glue, Athena, S3, Data Pipeline, Redshift, Lambda, API Gateway.
• Experience with big data tools: Spark, Kafka.
• Experience with data streaming systems like spark-streaming, storm.
• Experience with data pipeline and workflow management tools: Airflow
• Experience with shell scripting.
• Ability to quickly understand and appreciate underlying business context, problems and objectives of analytical projects.
• Excellent time management skills
• Clear communication skills to run well defined analysis and produce reports.

Skills

• Communications Skills
• Data Security
• Data Structures
• Python
• Software Engineering
• SQL