Our client, is currently recruiting for a Data Engineer on a 6 month basis to design and implement data ingestion pipelines. The Data Engineers must have solid experience of Azure Databricks and have worked within a regulated environment previously.
This is looking to pay £450-£500 per day outside of IR35. This is hybrid based with 2-3 days in the office in Basingstoke.
Key responsibilities and Experience for the Data Engineer
Supporting our stakeholders in ensuring the implementation of Data products for insights and informed decisions
Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark (ideally in Azure Databricks).
Delivering and presenting proofs of concept of key technology components to the wider data team and project stakeholders.
Integrating the end-to-end data pipelines to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
Working with other members of the data team and wider business to support delivery of additional project components (API interfaces, Data Models, Data Sharing, ML Endpoints).
Excellent level of proficiency in writing SQL.
Strong SQL and Python experience.
Strong knowledge of Data Management principles in a Lakehouse Architecture.
Please apply as directed!