Data Engineer (Terraform/AWS/Pyspark) - Education

Project Description

Created to help higher education institutions take on the issues that matter most. Whether it’s sexual assault and harassment, alcohol and substance misuse, wellness and mental health, or diversity and inclusion. Here advance their safety, well-being, and inclusion initiatives and elevate their impact on student and institutional success.

Responsibilities

• Building Data pipeline, data modeling and familiatiry with data architecture
• ML related programming
• BI reporting and dashboards
• Mapping from existing platforms to canonical models and piping the models to Datawarehouse

Requirements

• Have AWS Glue Pyspark development experience. Just having Python isn't sufficient
• Should have AWS pipeline/warehouse experience
• Should have experience in python programming
• Should be aware of data processing architecture like Lambda
• Amazon S3 and Terraform
• SQL expertise with PostgreSQL, MySQL

Rewards

• Payment in USD.
• Free credentials for e-learning platforms.
• Remote workshops & activities.