Technology Consultant – Data Engineer
Job Purpose
The Technology Consultant – Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and integration solutions that enable reliable, high-quality, and business-ready data across the organisation. The role supports data migration, transformation, governance, and performance optimisation initiatives, while collaborating with cross-functional teams to deliver secure, efficient, and enterprise-scale data platforms that support SIL’s digital transformation objectives.
KEY RESPONSIBILITIES
Design, develop, and maintain scalable ETL/ELT data pipelines supporting both batch and real-time processing.
Integrate data from multiple heterogeneous sources, including databases, APIs, flat files, and unstructured data (text, images, audio).
Implement and manage data cleansing processes, including deduplication, standardisation, and handling of missing or inconsistent data.
Ensure data quality and integrity through automated validation, profiling, and monitoring mechanisms.
Execute and support data migration activities from legacy systems, including full load, incremental, and real-time data migration.
Develop and maintain data transformation and mapping logic to produce structured, business-ready datasets (Raw, Trusted, Refined layers).
Perform data reconciliation and validation between source and target systems to ensure accuracy and completeness.
Monitor, troubleshoot, and optimize data pipeline performance, reliability, and availability.
Implement logging, alerting, and incident management processes for data workflows.
Support data governance initiatives, including metadata management, data lineage, and documentation.
Collaborate with Data Architects, BI/Analytics teams, and application teams to deliver high-quality data solutions.
Maintain comprehensive technical documentation of data pipelines, transformations, and processes.
Carry out such acts as shall be required for the proper fulfilling of duties listed above.
QUALIFICATIONS & EXPERIENCE
Bachelor’s degree in Computer Science, Software Engineering, Data Science, or equivalent.
3 to 6 years of experience in Data Engineering or related roles.
Experience in data migration or system integration projects is a strong advantage.
Exposure to enterprise-scale data platforms preferred
TECHNICAL SKILLS
Strong proficiency in SQL or Python (Pandas, PySpark); knowledge of Java/Scala is an advantage.
Experience with ETL/ELT tools and frameworks such as Apache Airflow, dbt, Talend, or Informatica.
Hands-on experience with data processing frameworks (Apache Spark) and streaming technologies (Kafka, Kinesis, or Pub/Sub).
Familiarity with cloud data platforms:
AWS (S3, Glue, Redshift, EMR, DMS).
GCP (BigQuery, Dataflow, Dataproc, Datastream).
Oracle OCI (ADW, Object Storage, Data Integration, GoldenGate).
Strong knowledge of relational databases (Oracle, PostgreSQL, SQL Server) and data warehouses/lakes.
Experience with data migration and integration tools (AWS DMS, GoldenGate, APIs).
Understanding of data quality, validation, and governance practices.
Experience with orchestration, monitoring, and DevOps tools (Airflow, Cloud monitoring tools, Git, CI/CD).
COMPETENCIES
Strong engineering mindset focused on robustness and reliability.
Strong analytical and problem-solving skills.
Ability to work in complex and evolving environments.
Strong collaboration in cross-functional teams.
High level of autonomy and ownership.
Good communication skills (English required).
Share now
The SIL Team is a group of IT professionals with expertise in delivering high-quality software solutions to clients worldwide. They specialize in working with businesses in Mauritius, India, and Africa, and have a deep understanding of the unique needs of these regions.