IT Data Engineer

The IT Data Engineer plays a critical role in enabling data-driven decision-making across the organization by designing, building, and maintaining robust data infrastructure. This position is responsible for developing scalable data pipelines, managing databases and data warehouses, and ensuring the integrity, accessibility, and quality of enterprise data. Through thoughtful architecture and efficient processing systems, the Data Engineer supports analytical initiatives and empowers teams with reliable, well-organized data assets.

Key Responsibilities

·         Design, build, and maintain scalable data pipelines to extract, transform, and load data from diverse sources into centralized repositories (e.g., data warehouses, data lakes)

·         Develop and manage databases, data warehouses, and data lakes to support analytics and reporting needs

·         Write and maintain efficient code and scripts for data processing, transformation, and manipulation

·         Ensure data quality, consistency, and reliability across all systems and pipelines

·         Implement and uphold data security, privacy, and access controls in compliance with governance standards

·         Collaborate with cross-functional teams to deliver data solutions aligned with business objectives

·         Monitor and optimize the performance, scalability, and cost-efficiency of data infrastructure

·         Create and maintain clear documentation for data architecture, processes, and workflows

·         Stay current with emerging data engineering technologies and recommend improvements to existing systems

·         Design and implement data models and schemas to support analytical and machine learning use cases

·         Build curated datasets and data marts to enable self-service analytics for business users

·         Establish monitoring and alerting systems to proactively detect and resolve data pipeline issues

·         Support machine learning operations by collaborating with data scientists on feature engineering and model deployment

·         Leverage cloud platforms (e.g., AWS, Azure, GCP) to build and maintain modern, scalable data infrastructure

·         Contribute to data governance initiatives by ensuring compliance with internal policies and external regulations

·         Proficiency in designing, building, and supporting large-scale data warehouses using cloud platforms such as Azure, AWS, or Google Cloud

·         Strong experience with Big Data technologies (e.g., Snowflake, Hadoop, Spark), data modeling (OLTP/OLAP), and database design and management

·         Skilled in writing and debugging complex SQL scripts and Python-based data processing using libraries such as Pandas and PySpark

·         Hands-on experience with ETL/ELT processes, orchestration tools (e.g., Apache Airflow, Azure Data Factory), and CI/CD practices

·         Familiarity with containerization and deployment tools like Docker and Kubernetes

·         Experience with version control systems such as Git

·         Knowledge of streaming data technologies (e.g., Kafka, Spark Streaming) for real-time data processing

·         Understanding of data governance, privacy practices, and compliance regulations

·         Existing technical knowledge of modern systems software, protocols, and standards, including SQL Server, Snowflake/Databricks/Fabric, and Power BI

·         Experience with data visualization tools such as Power BI or Tableau

·         Ability to translate business requirements into scalable technical solutions

·         Strong analytical, problem-solving, and troubleshooting skills

·         Excellent communication and collaboration abilities across technical and non-technical teams

·         Detail-oriented with a strong focus on data quality, consistency, and reliability

·         Comfortable working independently and in a fast-paced, team-oriented environment

·         Familiarity with Agile or Scrum methodologies is a plus

·         Bachelor’s degree in Computer Science, Software Engineering or related field.

·         5+ years of experience in data engineering or BI/reporting roles with a strong back-end focus