NCF Category: Data Engineering

Derive an overall strategy of master data management that supports data exploitation for analysis, including linking/matching across diverse datasets.

Align organisational and individual objectives, measures and rewards with innovation.

Lead the selection and development of data engineering methods, tools and techniques. Ensure adherence to technical strategies and architectures.

You initiate novel data flows and their data sharing agreements ensuring Information Governance legislation is adhered to and data security standards are built-in at source. 

You investigate emerging trends in data-related approaches, perform horizon scanning for the wider technical community and maintain the currency of your own skills.

You predict and advise on future technologies that present opportunities for products or programmes.

You take technical responsibility for all stages and/or iterations in a development project, providing method-specific technical advice and guidance to project stakeholders.

You apply stringent test conditions, ensuring action is taken to counter all identified issues and risks.

You advise on the application of standards and methods and ensure compliance.

You set local standards for programming tools and techniques and nominate appropriate development methods.

You establish robust governance processes to ensure repositories are secure, up to date and conforming to best ethical practices.

You promote and communicate the value of metadata repositories.

Co-ordinate the application of data design and modelling techniques, to establish, modify or maintain data pipelines, data structures, datasets, and metadata for diverse datatypes.

Monitors application of data standards and architectures including security and compliance.

You pro-actively explore new tools and technologies, set direction for modernising data architecture, software and facilities and build business cases for technical investment that supports demands for onward uses.

You manage the iteration, review and maintenance of data requirements and data models.

You engage with the wider technical professions to ensure the data models and data engineering processes conform to best practice and data modelling principles.

You establish sustainable enterprise-scale data integration procedures and ensure the team adheres to them.

Align business strategies, enterprise transformation, and technology strategies.

Direct the identification, evaluation and adoption of new or existing data technologies to improve business processes.

Take strategic view identifying long term opportunities and ensuring organisation is well placed to take advantage of cutting-edge developments.

Engage at a strategic level with external stakeholders/suppliers to identify opportunity, influencing direction of travel in partner organisations for mutual benefit.

Embed innovation processes throughout business units and link strategy execution with innovation.

Lead development of a culture that encourages innovation, risk taking and collaboration.

You take responsibility for the lifecycle of the whole code library sponsoring continuous code reviews and refactoring.

Take account of departmental and cross government best practice / guidance, adopting where relevant and influencing direction of these.

Assess risk and opportunity of emerging technology and practices.

Set long term strategy, identifying opportunities to build and improve suite of developed products.

Take accountability for overall quality and performance of coding developed in area of responsibility.

Plan and lead data engineering activities for strategic, large and complex programmes.

You understand how metadata and their repositories support different areas of the business.

You determine technical strategy, organisational policy, standards and guidelines and ensure alignment with enterprise goals and functional and non-functional requirements.

Coordinate work to construct data pipelines & datasets for onward uses drawing on data engineering best practices.

Develop organisational policies, standards, and guidelines for data engineering.

Plans and leads data engineering activities for strategic, large and complex programmes.

Develops organisational policies, standards, and guidelines for the development and secure operation of data services and products.

Leads the selection and development of data engineering methods, tools and techniques. Ensures adherence to technical strategies and architectures.

Maintain excellent knowledge of database and data warehouse concepts, design principles and technologies and work with data engineers to implement database / data warehouse designs that support demands of users.

You manage resources to ensure data services work effectively at enterprise level.

Derive an overall strategy of master data management that supports data exploitation for analysis, including linking/matching across diverse datasets.

You exemplify best practice with methods and tools and guide others to a high standard.

You have advanced expertise in the relevant applications, systems and platforms in the organisation and share your knowledge with others.

You have advanced expertise across a range of techniques or you may have a recognised deep expertise in a narrower range of specialisms.

Use strong influencing skills to represent data engineering interests with colleagues at all levels within this organisation and with senior external colleagues.

Own the definition of documentation standards, working with cross-government groups to drive the definition of and adherence to industry wide standards.

Define the communication strategy for data engineering, ensuring that corporate messages are cascaded in a straightforward and engaging manner.

Create an open environment for communication, fostering an honest inclusive approach to communication.

Ensure that communication has clear purpose, takes into account people’s individual needs and provides the opportunity for open dialogue.

You know how to work across organisational boundaries and recognise opportunities to align with or re-use the data models in different organisations.

You understand the concepts and principles of data modelling and can produce relevant data models.

Derive an overall strategy of master data management that supports data exploitation for analysis, including linking/matching across diverse datasets.

You exemplify best practice with methods and tools and guide others to a high standard.

You have advanced expertise in the relevant applications, systems and platforms in the organisation and share your knowledge with others.

You have advanced expertise across a range of techniques or you may have a recognised deep expertise in a narrower range of specialisms.

You can mediate between people and mend relationships, communicating with stakeholders at all levels.

You can speak for and positively represent the technical community to large audiences inside and outside heathcare

You manage stakeholders’ expectations and facilitate discussions ainvolving high risk or complex issues or under constrained timescales.

You understand a range of tools for storing and working with metadata.

You enable the team by ensuring they have access to relevant tools and the appropriate levels of training.

You review metadata processes and their documentation to ensure their efficiency and accuracy.

You utilise a variety of tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations.

You advise colleagues on industry standards and monitor adherance to local standards.

You collaborate with others to review specifications where appropriate and define test conditions and procedures.

You analyse test and performance analysis results and identify and act upon any risks, issues or opportunities.

You direct code reviews and promote the application of a full range of refactoring techniques to enhance the lifespan of the code library.

You apply detailed knowledge of the techniques and concepts required for the role and maintain currency of your own skills.

You research and identify areas for impactful innovation in data tools and techniques.

You collaborate with other technical teams to ensure seamless service to the organisation.

You understand the concepts and principles of data modelling and can produce relevant data models.

You know how to work across organisational boundaries and recognise opportunities to align with or re-use the data models in different organisations

You establish sustainable enterprise-scale data integration procedures and ensure the team adheres to them.

You build appropriately skilled teams and manage resources to ensure data services work effectively at enterprise level.

You provide advice and guidance to others using the data structures and associated components.

You manage the iteration, review and maintenance of data requirements and data models.

You can establish complex enterprise-scale data ingestion processes using standard development techniques.

You build appropriately skilled teams to support current and proposed data pipelines.

You can manage people and technical resources to ensure that data services work effectively at scale.

You oversee the operational implementation of new technologies and contribute to the modernisation of the business data architecture.

You ensure business processes build-in Information.

Governance requirements and develop ethical and effective data sharing agreements for data sources.

Support processes for complex data quality checking and remediation.

Contribute to organisational policies, standards, and guidelines for data engineering.

You create metadata, design appropriate metadata repositories and manage changes to existing metadata repositories.

3

You understand the needs of technical and business stakeholders and interpret them into technical requirements which can be implemented.

You manage stakeholder expectations.

You are flexible and capable of proactive and reactive communication.

You know how to facilitate difficult discussions within the team or with diverse senior stakeholders.

You develop advanced expertise in data profiling, applications, systems, platforms and reporting tools and pro-actively share your knowledge with others.

You convert the results of source system analysis into insight to support the business.

Maintain knowledge of the breadth of techniques available for exploring, manipulating and creating new data sources through linking or matching multiple datasets.

Develop and maintain knowledge of database and data warehouse concepts, design principles and technologies to implement database / data warehouse designs that support demands of data analytics and improve the quality and flow of data used in organisational business intelligence tools.

Investigate data requirements where there is some complexity and ambiguity.

Provide advice on the transformation of data from one format or medium to another.

You manage stakeholder expectations.