Data Engineer at Interswitch

Interswitch is a digital payment and commerce company operating across Africa. Since 2002, we have grown from a transaction switching service into a fully integrated payments solutions provider. We design and manage payment infrastructure, offer digital products, and support businesses and individuals with secure, fast, and innovative payment solutions.

Position: Data Engineer
Location: Lagos
Employment Type: Full-time

Role Overview
We are hiring a skilled Data Engineer to design and build data pipelines, transform and clean large datasets, and support data scientists and analysts with high-quality, reliable data. This role involves working with tools like Spark and ETL platforms to enable accurate, fast, and scalable data operations across the business.

Key Responsibilities

Data Ingestion and Extraction

• Build and manage data ingestion pipelines for both structured and unstructured data
• Ensure consistent data quality and integrity during extraction
• Integrate multiple data sources into a centralized ecosystem

Data Processing and Transformation

• Clean, organize, and enrich raw data for usability
• Implement scalable data transformation workflows
• Optimize data pipelines for efficiency and performance

Data Storage and Management

• Design and maintain data storage solutions tailored for big data applications
• Implement best practices in data partitioning, indexing, and compression
• Uphold security, privacy, and regulatory standards

Data Analysis Support

• Work closely with data scientists and analysts to create data models
• Assist in data visualization to support business insights

Performance Optimization

• Improve speed and efficiency of data systems
• Conduct tuning and capacity planning
• Monitor system health and troubleshoot issues

Data Governance and Compliance

• Apply data governance policies and practices
• Ensure compliance with data protection laws like GDPR
• Perform audits and implement quality controls

Collaboration and Communication

• Partner with technical and non-technical teams to understand data needs
• Clearly explain data processes and findings to various stakeholders
• Contribute to improving data engineering processes

Documentation

• Keep detailed records of workflows, system design, and data processes
• Document data dictionaries, lineage, compliance, and security practices

Requirements

Educational Background

• BSc in Computer Science, Computer Engineering, or related field

Certifications (Preferred)

• Azure Data Engineer Associate
• Google Professional Data Engineer
• AWS Certified Data Analytics – Specialty
• Databricks Certified Data Engineer (Associate or Professional)
• DASCA Big Data Engineer (Associate or Senior)
• IBM or Cloudera relevant certifications

Experience

• Minimum of 3 years in data engineering or ETL/ELT pipeline development
• Experience within a Financial Institution or FinTech is an advantage

Application Deadline
Not Specified