Senior Data Engineer

 

 

Role Overview

 

To support our ambitious growth agenda, Perch Group is expanding its development team and seeks a Senior Data Engineer. This permanent role will lead a squad focused on delivering robust data solutions across our five businesses. You will leverage your deep expertise in traditional data engineering (database design, T-SQL) and Microsoft Azure’s data services (Data Factory, Power BI, and pipelines) to address complex business challenges. We are looking for a candidate who can effectively translate business requirements into technical specifications and guide a team to successful implementation.

 

 

Accountabilities:

 

Technical Leadership & Mentorship:

  • Provide technical leadership and guidance to the data engineering team, fostering a culture of technical excellence and innovation.
  • Mentor junior engineers, sharing technical expertise and best practices to enhance their skills and knowledge.
  • Oversee team members, ensuring that work is managed and delivered according to agreed deadlines in line with business priorities.

Data Architecture & Design:

  • Architect and implement robust designs, ensuring optimal performance, scalability, and security.
  • Translate high-level solution designs into detailed technical specifications, including data models, ETL processes, and database schemas.
  • Establish and enforce data modelling best practices, promoting data integrity and consistency across all platforms.

ETL Development & Optimization:

  • Develop and optimize complex ETL pipelines for diverse data sources (on-premise and cloud-based), utilizing best practices for data extraction, transformation, and loading.
  • Implement data quality checks and validation processes within ETL pipelines, ensuring data accuracy and reliability.
  • Optimize ETL performance for speed and efficiency, addressing bottlenecks and improving data processing times.

Data Platform Management & Governance:

  • Maintain and enhance the company’s data platforms, ensuring high availability, performance, and security.
  • Implement data governance policies and procedures, ensuring compliance with data quality standards and regulatory requirements.
  • Design and implement data observability and data quality monitoring solutions, enabling proactive identification and resolution of data issues.

 

 

Behaviours:

 

Technical Passion & Innovation:

  • Demonstrates a strong passion for data technologies and a commitment to staying up-to-date with the latest trends and best practices.
  • Proactively seeks out opportunities to improve data processes and leverage new technologies.

Problem-Solving & Best Practices:

  • Possesses a strong problem-solving mindset, with the ability to identify and resolve complex technical challenges.
  • Adheres to and promotes data engineering best practices, ensuring code quality, performance, and maintainability.

Continuous Learning & Growth:

  • Embraces a growth mindset, with a strong desire for continuous learning and professional development.
  • Actively seeks out opportunities to expand technical skills and knowledge.

Technical Communication & Collaboration:

  • Communicates technical concepts clearly and effectively to both technical and non-technical audiences.
  • Collaborates effectively with cross-functional teams, fostering a positive and productive work environment.
  • Confident communicator, who can articulate problems and solutions just as clearly to the executive team as to engineering teams.

Team and Work Management:

  • Experience with Agile methodologies (Scrum, Kanban) for managing multiple data engineering projects simultaneously. Skilled at task prioritization and delivering on deadlines.
  • Ability to work closely with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders to align data engineering efforts with business goals.
  • Track the performance of team members, provide constructive feedback, and promote continuous improvement.
  • Ability to efficiently allocate resources to ensure that projects are adequately staffed and scalable as demands grow.
  • Clear and concise communicator, particularly in presenting technical information to non-technical stakeholders, and ensuring alignment with business objectives.

 

 

Experience:

 

Essential:

  • Minimum 5+ years of experience in designing and implementing data ETL processes and design.
  • Expert-level proficiency in T-SQL, SSIS, and the Microsoft data stack (SQL Server, Azure SQL Database).
  • Proven proficiency in Azure Data Factory
  • Proven experience in designing and implementing data models and database schemas for complex data environments.
  • Strong understanding of data quality principles and best practices, with experience implementing data governance policies.
  • Demonstrated ability to troubleshoot and resolve complex data-related issues.
  • Strong analytical and problem-solving skills.
  • Strong teamwork, interpersonal and collaboration skills with colleagues and clients.

Desirable:

  • Experience with Cloud ETL tools such as Databricks/Snowflake, Spark and Kafka
  • Experience using source control tools such as GitHub or Azure Devops
  • Experience with Azure DevOps for CI/CD pipeline development and data operations (DataOps).
  • Experience with Python or other relevant coding languages.
  • Experience with Data Observability tools.
  • Exposure to Agile Project Methodology, i.e. Scrum.

 

 

We are an equal opportunities employer

 

We’re an equal opportunity employer. All applicants will be considered for employment without attention to age, ethnicity, religion, sex, sexual orientation, gender identity, family or parental status, national origin, or veteran, neurodiversity or disability status. At Perch, our strength lies in our team, their enthusiasm, and their passion for the business. Whether you’re looking to gain foundational skills in financial services, have a knack for customer service, or seek to expand your horizons, we likely have the perfect opportunity for you.

 

 

Please email your CV to: recruitment@perchgroup.co.uk

 

 

Back to Careers page