
Data Engineer
Job Category
- Information Technology
Minimum Qualification
- Bachelor's Degree
Our client is looking for a data engineer to work in the cybersecurity industry. The successful candidate will design, develop, optimise and manage robust data analytics infrastructure, reports and models that support data ingestion, storage and analysis, enabling actionable insights for clients.
The Role
Core responsibilities will include but are not limited to the following:
- Develop and maintain scalable data pipelines
- Build and automate ETL processes
- Manage SQL and NoSQL databases
- Ensure data quality and integrity
- Collaborate with data scientists, analysts and engineers
- Document data workflows and architectures
- Optimise performance of queries and databases
- Support cloud platforms (AWS, Azure, GCP)
Qualifications and Experience
- Bachelor’s or honours’ degree in engineering, data science, computer science or IS
- Three to five years’ experience in data engineering or analytics
- Experience in cybersecurity and agile delivery
- Familiar with Databricks, Python Notebooks, Power BI, DAX, Excel, SQL
- Certifications in AWS, Microsoft BI preferred
Skills
- Strong analytical, time-management and presentation skills
- Ability to multitask and deliver under pressure
- High integrity and ability to handle confidential data
- Strong team player, self-starter and proactive attitude
Key Performance Indicators
- Pipeline efficiency and ETL performance
- Data accuracy and query performance
- Code quality and documentation
- Effective collaboration
Performance Measurement Tools
- Azure DevOps (cycle times)
- Databricks (job durations)
- Sonarqube (code quality)
- Wiki JS (contributions)
- 360° feedback and demo days
Note
The role is based in Melrose Arch.