Senior Data Engineer

Are you a Data engineer who likes to look at the bigger architectural picture? 
Does the idea of systemizing insights that historically have been manual sound exciting to you?
Do you want to make an impact in the worlds leading Human Intelligence platform; and their stable of household name clients. 
If so, Read On! 


Who you are

- Fluent in Python (Pyspark, Pandas and Numpy are essential)
- Knowledgeable on deployment in a cloud environment (AWS preferable) and cloud services eg: AWS glue/REdshift/Athena
- Experienced managing infrastructure-as-code (ideally with Terraform) 
- Experienced with relational databases (ideally Aurora Postgres) 
- Familiar with containers and scheduling tools (we use Docker on ECS)
- Familiar working with CI/CD pipeline tools such as CircleCI, Jenkins etc


What you'll do

- Develop and maintain data pipelines for production client dashboards, ML training loops and data operations workflows
- Work closely with Client Strategists to support their activities with data transformations and new data sources
- Playing an integral role in implementing our Data Architecture Strategy
- Work closely with developers and product managers to ensure that data engineering requirements are implemented correctly and efficiently
- Hands-on design, development and support of applications and infrastructure in collaboration with the rest of the platform engineering team. Active pull request participation, branch management, code reviews etc
- Working on production deployment of Machine Learning AI solutions (DataOps for machine learning is a new area for the industry, with little current conventional best practice, our clients expertise in ML creates a real opportunity to do leading-edge DataOps work production-ising that)


What you'll get

- Flexible working hours, fully remote or hybrid, dependent on your location
- A budget to foster your own personal learning and development
- Paid Volunteer days for any charity of your choice
- Competitive, regularly reviewed salary
- 24 days holiday, with the option to rollover unused days.