Talent.com
Data Engineer (Fintech)

Data Engineer (Fintech)

Black Pen RecruitmentLagos, Nigeria
30+ days ago
Job description

Our client is a technology company solving payments problems for businesses. Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to help businesses accept payments online and offline, manage their operations, and grow their business. Our client is driven by a commitment to excellence, innovation, and customer satisfaction.

Role Overview

Data engineering with our client focuses on building and extending platforms for managing data at scale. This involves data ingestion, processing, storage and egress. Data engineers are also responsible for creating and maintaining the infrastructure our data platforms run on.

Data engineers operate across a diverse tech stack. They are expected to be adaptable and drawn to learning new skills and technologies.

The role requires a proactive individual who can work independently and collaboratively within a remote-first environment, has a strong software engineering background with good experience building and maintaining data pipelines, expertise in Python and experience in streaming technologies.

Job Type : Permanent / Full time

Location : Lagos, Nigeria

Workplace : Hybrid

Department : Data Engineering

Reports To : Data Engineering Lead

Requirements

  • Educational Background : Bachelor's degree in Computer Science, Engineering or a related field.
  • Programming Skills : Proficiency in Python is essential. Knowledge of JavaScript and Scala is advantageous.
  • Data Engineering Experience : Minimum of 3 years of experience in data engineering roles, with a focus on building and managing data pipelines.
  • Software Engineering Experience : Minimum of 2 years experience in software and / or application development roles (can be concurrent with data engineering experience)
  • Streaming Technologies : Hands-on experience with Kafka, Debezium, and Kafka Connect.
  • Data pipeline orchestration tools : Proficiency in a data pipeline orchestration tool or suitable workflow orchestration tool like Apache Airflow (preferred), Databricks, Dagster or Airbyte.
  • Database Expertise : Strong understanding and hands-on experience working with various database technologies, including MySQL, PostgreSQL, MongoDB and Redshift (BigQuery and SingleStore advantageous)
  • Infrastructure Tools : Experience with Terraform, Kubernetes, and Helm for infrastructure management.
  • Cloud Computing : Solid knowledge of cloud computing concepts, with experience in AWS services being advantageous.
  • SQL Proficiency : Ability to write complex SQL queries across different dialects.
  • Testing Practices : Familiarity with unit and integration testing methodologies.
  • CI / CD Pipelines : Experience in setting up and maintaining CI / CD pipelines.
  • Data Science Tools : Exposure to analytical systems and basic data science tooling.
  • Familiarity with basic machine learning and analytical modelling concepts is advantageous.
  • BI Reporting Platforms : Exposure to self-service reporting tools like Tableau, Looker and DOMO.
  • Communication : Good verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Team Collaboration : Demonstrated ability to work collaboratively within a team and across departments.
  • Adaptability : Comfortable working in a fast-paced environment with changing priorities, technologies and tooling. Life-long learners will do well here.
  • Problem-Solving : Strong analytical and problem-solving skills.

Responsibilities

  • Data Pipeline Development : Design, develop, and maintain robust data pipelines using ETL and ELT methodologies to process and integrate data from various sources into a data lake, a central data warehouse, operational data stores, analytical data marts and various application interfaces.
  • Streaming Data Processing : Implement and manage real-time data streaming solutions utilising Kafka, Debezium, Kafka Connect.
  • Workflow Orchestration : Build, schedule and maintain custom workflows using Apache Airflow to ensure timely and accurate data processing and delivery.
  • Database Management : Work with a variety of database technologies, including relational databases (MySQL, PostgreSQL), NoSQL databases (MongoDB) and analytical / big data systems (Redshift, BigQuery, SingleStore).
  • Infrastructure as Code : Employ tools like Terraform, Kubernetes, and Helm to manage and provision infrastructure efficiently.
  • CI / CD Implementation : Develop and maintain continuous integration and deployment pipelines to streamline development processes.
  • Testing and Quality Assurance : Conduct unit and integration testing to ensure high code quality, data integrity and system reliability.
  • Collaboration : Engage with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver solutions.
  • Documentation : Maintain clear and comprehensive documentation of data processes, workflows and systems.
  • Monitoring and Support : Monitoring system performance and addressing faults and failures in production systems as part of an on-call rotation
  • Company Core Values

  • Transparency : They encourage open sharing of work, seeking feedback and having honest conversations promptly.
  • Clear Communication : They simplify ideas, communicate directly and confirm understanding to ensure clarity.
  • Kindness : They value positive vibes, generosity and empathy, both within the team and with customers.
  • High Standards : They insist on delivering consistent excellence, taking ownership and striving to be domain experts.
  • Pursue Growth and Learning : They view every situation as a learning opportunity, encouraging experimentation and continuous improvement.
  • Embrace the Mission : They find joy in their work and recognise the company's broader impact.
  • Create a job alert for this search

    Data Engineer • Lagos, Nigeria

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    HugoLagos, Lagos, Nigeria
    Data Infrastructure & Ingestion : Architect and maintain robust, scalable data pipelines that automate ingestion from both structured and unstructured sources. Leverage Python and SQL to ensure relia...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Helium HealthLagos, LA, NG
    Quick Apply
    A full-service Healthtech company on a journey to digitize healthcare across Africa.We have been doing this since 2016, and our pioneering approach has helped to transform healthcare delivery syste...Show moreLast updated: 19 days ago
    • New!
    Data Engineer

    Data Engineer

    NombaLagos, LA, ng
    Quick Apply
    Nomba has evolved into one of Nigeria’s leading financial technology platforms.We began by empowering everyday people to serve as neighbourhood banks—offering essential services like withdrawals, t...Show moreLast updated: 17 hours ago
    • Promoted
    Data Analyst

    Data Analyst

    Marbleclear limitedLagos, Lagos, NG
    HND in Data Analytics, Statistics, Computer Science, Business, Economics, or related field.Strong proficiency in data analysis tools and software (e. SQL, Python, R, Microsoft Excel, Tableau).Excell...Show moreLast updated: 16 days ago
    • Promoted
    Relocate to Malta Data Solution Architect (Consulting / Big 4)

    Relocate to Malta Data Solution Architect (Consulting / Big 4)

    Black Pen RecruitmentLagos, Nigeria
    Our client’s Microsoft Business Solutions team is a Microsoft Gold Partner and leader in Microsoft software implementations for medium to large organisations, providing their clients with the abili...Show moreLast updated: 30+ days ago
    Fullstack Engineer

    Fullstack Engineer

    T.O.N Corporate ServicesLagos, LA, ng
    Quick Apply
    We are seeking an experienced Fullstack Engineer to build world-class APIs and tools that power insurance transactions.The ideal candidate will have strong problem-solving skills, a passion for bui...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HRD solutionsLagos, Lagos, NG
    JOB OBJECTIVE / SUMMARY To design, build, and maintain robust, scalable, and high-performance ETL / ELT data pipelines for reporting, business intelligence, and machine learning initiatives2.The role i...Show moreLast updated: 12 days ago
    • Promoted
    Lead ERP (MS Dynamics Navision)

    Lead ERP (MS Dynamics Navision)

    WorkNigeriaOgun State, Nigeria
    Job Title : Lead ERP (MS Dynamics Navision).We're seeking an experienced Lead ERP professional to provide technical support and expertise in MS Dynamics Navision. The ideal candidate will have a stro...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Backend Engineer (Fintech)

    Senior Backend Engineer (Fintech)

    Black Pen RecruitmentLagos, Nigeria
    Our client is a technology company solving payments problems for businesses.Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to he...Show moreLast updated: 30+ days ago
    SAP Data Engineer

    SAP Data Engineer

    Dangote GroupIkoyi, LA, NG
    Quick Apply
    As a SAP Data Engineer, your role involves extracting, integrating, and transforming data from diverse sources to meet business requirements. You will work collaboratively with SAP developers, data ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior iOS Engineer (Fintech)

    Senior iOS Engineer (Fintech)

    Black Pen RecruitmentLagos, Nigeria
    Our clients mission is to accelerate digital payments on the continent of Africa.Over 200K of some of the most renowned businesses in Nigeria, as well as a growing number of merchants in South Afri...Show moreLast updated: 30+ days ago
    • Promoted
    Distributed Systems Engineer – Vector Database (Prototype)

    Distributed Systems Engineer – Vector Database (Prototype)

    HI Technology & InnovationLagos, Nigeria
    HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Fintech)

    Data Engineer (Fintech)

    Black Pen RecruitmentLagos, Nigeria
    Our client is a technology company solving payments problems for businesses.Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to he...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Dangote GroupIkoyi, LA, NG
    Quick Apply
    The ideal candidate will have a strong background in data engineering, with proficiency in ETL / ELT processes, big data technologies, and cloud platforms. You will play a critical role in ensuring da...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate Backend Engineer (Fintech)

    Intermediate Backend Engineer (Fintech)

    Black Pen RecruitmentLagos, Nigeria
    Our client is a technology company solving payments problems for businesses.Their mission is to help businesses in Africa become profitable, envied, and loved. They provide a suite of products to he...Show moreLast updated: 30+ days ago
    • Promoted
    Automation Engineer

    Automation Engineer

    WorkNigeriaOgun State, Nigeria
    Job Title : Automation Engineer.We are seeking an experienced Automation Engineer to support our plant's process automation and minimize losses due to process malfunctions.The ideal candidate will h...Show moreLast updated: 30+ days ago
    HR Data Analyst (Dangote Cement Transport)

    HR Data Analyst (Dangote Cement Transport)

    Dangote GroupIbese, OG, NG
    Quick Apply
    The HR Data Analyst will be responsible for collecting, analyzing, and reporting HR data to support decision-making processes within the HR department. This role requires a keen eye for detail, stro...Show moreLast updated: 30+ days ago
    • Promoted
    Relocate to Malta Data Solution Architect (Consulting / Big4)

    Relocate to Malta Data Solution Architect (Consulting / Big4)

    Black Pen RecruitmentLagos, Nigeria
    Our client’s Microsoft Business Solutions team is a Microsoft Gold Partner and leader in Microsoft software implementations for medium to large organisations, providing their clients with the abili...Show moreLast updated: 30+ days ago
    • Promoted
    Distributed Systems Engineer – Vector Database(Prototype)

    Distributed Systems Engineer – Vector Database(Prototype)

    HI Technology & InnovationLagos, Nigeria
    HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstra...Show moreLast updated: 30+ days ago
    • Promoted
    Tendering Engineer-Oil & Gas

    Tendering Engineer-Oil & Gas

    WorkNigeriaLekki, Lagos, Nigeria
    Our client, an international EPC in the oil and gas industry is seeking to hire qualified candidates to fill the below positions#. Minimum of 12 years experience in a similar industry field (estimat...Show moreLast updated: 30+ days ago