Senior Data Engineer

What you bring

We are looking for world class talent that brings the following key skills and experience to this role:

• Bachelor’s degree or higher or Combination of relevant education, experience and training.
• 5+ years of relevant experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools.
• MS/BS in Computer Science, or related technical subject area
• 3+ years’ experience in Big Data stack environments (Hadoop, SPARK, Hive & Delta Lake)
• 3+ year’s working with multiple file formats (Parque, Avro, Delta Lake) & API
• 3+ year’s experience in cloud environments like AWS (Serverless technologies like AWS Lambda, API Gateway, NoSQL like Dynamo, EMR & S3)
• Experience with relational and non relational SQL
• Strong experience in coding languages like Python, Scala & Java
• Have experience in building realtime streaming data pipelines
• Experience in pub/sub modes like Kafka
• Strong understanding of data structures and algorithms
• Experience in building lambda, kappa, microservice and batch architecture
• Experience working on CI/CD processes and source control tools such as GitHub and related dev processes.
• Has a passion for data solutions and willing to pick up new programming languages, technologies, and frameworks
• Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions
• Effective communication skills (with team members, the business, and in code)