The Data Engineer will work closely with the data excellence team, reporting analysts, and business analysts, to build information pipelines. They will review and deliver on data source integration, data sets used for analysis, report layouts, and delivery processes. This will involve requirement analysis, data staging, ETL, data quality and archiving, in order to bring data from internal and external data sources to the intended users. We use Data Virtuality now and are moving towards Azure Data Factory.

The candidate should possess the technical skills to

• Understand relational and conceptual information modelling techniques, especially Data Vault and dimensional modelling. 
• Build data pipelines using SQL and scripting languages
• Deliver and test data sets and reports to agreed levels of accuracy and completeness
• Design and build data warehouse components and quality monitoring solutions
• Maintain code bases and tools that make up the data analytics environment
• Understand processes that ensure structured and quality delivery

Responsibilities: 

• Develop, maintain and improve the pipelines into the data analytics platform using procedural SQL, ETL, data virtualization, and databases
• Develop, maintain and improve the data connections between data sources and the data analytics platform, using Terraform and Azure tools, together with the data platform engineer
• Follow processes and maintain version control over the code assets within the data analytics platform
• Be an active participant in the sprint planning and goal definition activities within the Data Excellence team
• Review process, architectural, information and data models in collaboration with the Data Architect, Data Engineers, and the rest of the Data Excellence team

Qualifications: 

• 5 years of relevant data engineering work experience;
• Ability to program in procedural SQL, and automation using scripting languages
• Working experience with business intelligence platforms, data models, and test case design
• Working experience with Azure server infrastructure and Microsoft databases
• Working experience with Data Vault and dimensional modelling
• Experience with Scrum/Agile methodologies and working independently as a member of a virtual team
• Good communication skills with the ability to work with both technical and business minded colleagues;
• Pro-active attitude and an ability to remain organised under deadlines and see projects to completion.
• Experience of environments where improvements led to increased data flow and a reduction of lead times and errors
• English fluency

Desirable Experience

• Familiarity with topics relevant to the work of Rainforest Alliance and certification is a strong plus
• Experience with Data Virtuality software and ANSI SQL
• Experience with Azure SQL Data Warehouse (Synapse)
• Experience with Azure Data Factory
• Experience with infrastructure as code, especially Terraform
• Ability to build reports and datasets using Power BI, Power Query and DAX
• Experience with designing and consuming Rest API’s for loading data changes from source systems
• Experience with automated Business Intelligence test tools
• Ability to program in .net or Java and work with JSON and REST api’s
• Working experience of source code repositories such as GIT