NCF Category: Data Engineering (Analytics Engineering)

You ensure data is modelled appropriately, and modelling standards exist and are complied with.

You build and test scalable data pipelines from multiple data sources enabling monitoring and reporting for data governance and ensuring an efficient data analytics workload throughout the systems.

You set the operational framework for reverse engineering activities .

You understand a number of data integration tools and patterns and ensure your teams have the support and training needed to use the most appropriate methods.

You adopt frameworks, tools, data and quality standards that ensure data engineering activity satisfies the organisational strategic aims. You promote a culture that values data quality, efficient maintenance, automation and sustainability.

You enable the implementation of new tools and practices, understand the emerging data needs of the enterprise and translate those requirements into team workplans ensuring skills acquisition and collaboration with other enterprise data teams.

You set strategic direction determining the systems or processes requiring reverse engineering and mitigate the requirement for reverse engineering.

You determine and advocate for the tools to adopt which will deliver the organisational strategic aims in consultation with senior stakeholders and private sector providers.

You can understand different ways to model data to maximise its use and value. You build relationships with other senior data professionals e.g. data architects, data scientists and data engineers, to share best practice and continually improve data modelling, integration processes and standards.

You ensure data for analysis meets data quality standards and is interoperable with other data sets, enabling reuse.

You reverse engineer more complex data models and mentor less experienced staff.

You use data integration tools and languages to integrate and store data, and advise teams on best practice.

You can build and review complex data models, ensuring adherence to standards. You work with other data professionals to improve modelling, integration patterns and standards.

You review and maintain existing data pipelines to accommodate any necessary changes.

You build and test data pipelines ensuring valid, high-quality data is available.

You can reverse engineer a data model from a live system with guidance from more senior staff.

You understand the uses of different tools and can compare different data models.

You can produce data models and understand where to use different types of data models. You understand industry-recognised data modelling patterns and standards .