Summary
An associate data engineer supports delivery of the designs set by more senior members of the data engineering community.
At this role level, you will:
implement straight forward data flows to connect operational systems, data for analytics and business intelligence (BI) systems
document source-to-target mappings
re-engineer simple manual data flows to enable scaling and repeatable use
support the build of data streaming systems
write simple ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally
develop straight forward business intelligence reports that can be reused
build accessible data for analysis
Work Activity Components
| Title | Details |
|---|---|
| Data pipelines and stores (Level 2)(DENG) | Assists in developing and implementing data pipelines and data stores. |
Technical Skills
| Title | Details | Depth |
|---|---|---|
| Database Software | Software that enables the user to capture, create, populate and manipulate data structures and where appropriate unstructured data. | Familiar with |
| Middleware | Software which forms part of the operating platform infrastructure. | Familiar with |
| Cloud/Virtualisation | The principles and application of cloud/ virtualisation (including ownership, responsibilities and security implications). Use of tools and systems to manage virtualised environments. | Familiar with |
Professional Development Activity (PDA)
| Title | Details | PDA Group |
|---|---|---|
| Participation in Group Activities | Participating in group activities inside or outside of the working environment that can assist with the development of interpersonal skills. | Broadening Activities |
| Job Shadowing and Special Assignments | Undertaking temporary periods or secondments in other roles, particularly those that offer a new perspective on own function or exposure to other environments and cultures. | Broadening Activities |
| Gaining Knowledge of Employing Organisation | Gaining basic knowledge of the employing organisation, its business, structure, culture, policies, products/services, operations and terminology. | Increasing Knowledge |
| Gaining Knowledge of the Technical Environment | Gaining knowledge of IT activities in the employing organisation. | Increasing Knowledge |
| Involvement in Professional Body Activities | Attending meetings, seminars and workshops organised by professional body and reading published material, such as journals and web content. | Participation in Professional Activities |
| Team Working | Undertaking learning and practice in the techniques of team and collaborative working. Gaining an understanding of the underlying concepts. | Developing Professional Skills |
| Communications | Undertaking learning and practice in oral and written communications, including report writing and presentation. | Developing Professional Skills |
Qualification Components
| Title | Awarding Bodies |
|---|---|
| FEDIP Associate Practitioner | The Federation for Informatics Professionals |
Additional Frameworks
National Competency Framework for Data Professionals in Health and Care
Behaviours
| Title | Details |
|---|---|
| Delivering outcomes (B1.1) (Level One) | You work with others in your team in order to bring about a generally agreed outcome. |
| Communicating within a hierarchy (B1.2) (Level One) | You understand the importance of following hierarchical instruction. |
| Generating consensus (B1.3) (Level One) | You are able to add value to the consensus of opinion by contributing your ideas. |
| Logical arguments (B1.4) (Level One) | You are able to see the rationale in the arguments of colleagues when suggesting ways of working. |
| Negotiation (B1.5) (Level One) | You understand the need to negotiate in a busy working environment. |
| Generating support (B1.6) (Level One) | You understand the importance of being helpful for its own sake and look to promote good values in the team. |
| Influence (B1.7) (Level One) | You understand the general principles of influence. |
| Equality (B2.1) (Level One) | You welcome the input and feedback from all representatives of the workforce and public, ensuring representation across the protected characteristics as per the Equality Act 2010: age, disability, gender reassignment, pregnancy and maternity, race, religion or belief, sex and sexual orientation. |
| Challenging discrimination (B2.2) (Level One) | You know that discrimination of any kind will not be tolerated by your organisation and know that you should report all transgressions to your manager. |
| NHS Constitution (B2.3) (Level One) | You are aware of the importance of following the behaviours and values listed in the NHS Constitution. |
| Supporting others (B2.4) (Level One) | You understand the importance of supporting others and being kind to yourself. You know where to turn if things become difficult. |
| Open environment (B2.5) (Level One) | You have read your organisation's local and the NHS National Equality, Diversity and Inclusion policies and take time to actively listen to the lived experiences of underrepresented and marginalised groups. |
| Written communication (B3.1) (Level One) | You are able to convey written ideas and insights in a clear and concise manner. |
| Discussing complex ideas (B3.2) (Level One) | You are able to discuss ideas and insights in a clear manner. |
| Delivering complex ideas (B3.3) (Level One) | You are able to appear confident when conveying ideas and insights. |
| Understanding new ideas (B3.4) (Level One) | You are able to understand the subjects discussed in most conversations, even when the subject matter is new. |
| Reading audiences (B3.5) (Level One) | You are able to tell whether someone has been listening to you when discussing information in conversation. |
| Problem sharing (B4.1) (Level One) | You understand the benefits of collaborating with others. |
| Seeking opinions (B4.2) (Level One) | You understand what other people can bring to a potential solution. |
| Sharing best practice (B4.3) (Level One) | You make a note of your successes for future opportunities to use them. |
| Embedding best practice (B4.4) (Level One) | You note other people's successes and learn from their experience. |
| Patient impact (B5.1) (Level One) | You consider the impact of your activities on patients. |
| Understanding the customer (B5.2) (Level One) | You work with the customer to understand their requirements. |
| Customer service (B5.3) (Level One) | You consider if there are better ways to service the customer. |
| Customer solutions (B5.4) (Level One) | You look for new learnings to increase your offering to the customer / patient. |
Data Skills
| Title | Details |
|---|---|
| Non-technical audiences (Level One) | You understand the need to translate technical concepts into non-technical language and can maintain establish communication channels from the data engineering staff to internal and external stakeholders. |
| Data visualisation (Data Engineer) (Level One) | You can adopt the most appropriate tool for analytical tasks and communicate results visually and verbally. |
| Tools and techniques (Level One) | You have knowledge of reporting tools, applications and systems used in your organisation and of standard statistical techniques. |
| Data Modelling (Level One) | You understand what a data model is and how data items are stored. You are able to explain the potential relational nature of data and can express conceptual models. You understand how conceptual, logical and physical data models relate to each other. |
| Reverse engineering (Level One) | You have knowledge of how to reverse-engineer data models from systems. You have knowledge of how to reverse-engineer data models from systems. |
| Data integration (Level One) | You design, build and test repeatable and reusable data products based on data feeds from multiple systems. |
| Ingestion (Level One) | You assist in the design, build and testing of data pipelines and products based on feeds from multiple systems using a range of different storage technologies and/or access methods. |
| Modernisation tools (Level One) | You know how to create repeatable and reusable products and you understand how your tools fit into the business data architecture. |
| Information Governance (Data) (Level One) | You know the key data protection principles. You understand when data can be accessed and shared and know who in the organisation to approach for advice/approval. |
| Metadata repositories (Level One) | You maintain a repository to ensure information remains accurate and up to date. |
| Metadata processes (Level One) | You work with metadata to complete tasks such as data and systems integration impact analysis. |
| Programming (Data Engineer) (Level One) | You design, code, test, correct and document simple programs or scripts under the direction of others. |
| Development standards (Data Engineer) (Level One) | You contribute to code reviews and use refactoring techniques to enhance the sustainability of the code library. |
| Testing (Level One) | You peer review and test the work of a similar complexity by other team members. |
| Technologies (Level One) | You understand core technical concepts related to the role and can apply them with guidance. |
| Emerging trends (Level One) | You seek out opportunities to experiment and innovate with new tools. |
| Geographical Data Mapping (Level One) | You understand how geographical data can be displayed to show geographical features such as simple chloropleth mapping using appropriate tools. |
| Data modelling (Level One) | You understand the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. |
| Information governance (Data Engineering) (Level One) | You understand the Information Governance requirements for the data you handle and ensure its storage meets current legislation. |
| Technological Specialisms (R, Python, SQL, Tableau etc.) (Level One) | You can use a chosen technology/tool to create or manipulate data sets and create basic visualisations. |
| Data Automation (Level One) | You understand timeliness of data and the need for data to flow with minimal interaction. You can identify where automation would improve processes. |
Project Skills
| Title | Details |
|---|---|
| Business cases (WP1.1) (Level One) | You understand the time-bound nature of projects and the business requirement for any project you contribute to. |
| Scope (WP1.2) (Level One) | You ensure your work adheres to the project scope and meets with any necessary or desirable quality benchmarks. |
| Reviews (WP1.3) (Level One) | You seek advice should any regulatory, legal or ethical questions arise around the implementation or final product of a project. |
| Advice and monitoring (WP2.1)(Level One) | You understand the position of your work within the sequence of events in the project plan together with any immediate dependencies. |
| Complexity (WP2.2)(Level One) | You schedule your own time to achieve the project outputs alongside any business as usual activities. |
| Scheduling (WP2.3)(Level One) | You monitor your own performance against schedule and escalate any risks in timescale, quality or resource availability that you identify to the project plan. |
| Resource identification (WP3.1)(Level One) | You utilise the tools allocated for project work appropriately, escalating any shortfalls or issues and engage in any skills development activities provided to support project success. |
| Skill acquisition and management (WP3.2)(Level One) | You seek information about resource interdependencies to improve planning and utilisation. |
| Project management (WP4.1)(Level One) | You co-ordinate your project-related activities to conform to cost, time and quality limitations, escalating any risks and issues. |
| Pilots and testing (WP4.2)(Level One) | You engage with any pilot and testing programs and report on progress, findings and lessons learned. |
| Implementation (WP4.3)(Level One) | You engage with project co-ordinators and change agents to facilitate the implentation of the project. |
| Communications (WP4.4)(Level One) | You use appropiate, effective and timely methods to communicate with project co-ordinators and change agents throughout the lifecycle of the project with a solution focused approach to issue management. |
| Business change (WP5.1)(Level One) | You understand the 'to be' state and your part in achieving that change and how its benefits are intended to impact on stakeholders. |
| Assurance (WP5.2)(Level One) | You are aware of the possibiliy of disbenefits and interdependencies of the project with business as usual. |
The Professional Body Responsible for this job family is AphA. This job role profile was created in collaboration with BCS, using Role Model Plus.