Job Title: Data Engineer
Location: Lagos, Nigeria
Company Overview:
Dot.ai is an AI-led neobank with a mission to revolutionize financial services in Africa. We provide innovative and inclusive financial solutions that enable people and businesses to thrive. We believe in leveraging technology to deliver affordable, convenient, and reliable financial services to underserved communities in Africa.
Job Overview:
DOT is a financial institution that is leveraging top-tier technology to create digital products designed to ensure that accessible and affordable financial solutions are available to the underserved in Africa.
We’re looking for an experienced Data Engineer to complement our Engineering and Business operation team.
Responsibilities:
- Data Pipeline Development: Design, develop, and maintain scalable data pipelines using dbt (Data Build Tool) and Airflow to process and transform large datasets.
- ETL/ELT Processes: Implement and optimize ETL/ELT processes, ensuring data is accurately and efficiently loaded from various sources into our data warehouse.
- AWS Data Technologies: Work with AWS data technologies such as S3, Redshift, Athena, Glue, DMS, and RDS to store, manage, and analyze data.
- Data/API Integration: Experience with integrating data from multiple sources. Additionally, knowledge of Rest APIs
- Data Modeling: Design and maintain data models that support analytical and reporting requirements, ensuring consistency and integrity across all datasets.
- Automation and Orchestration: Utilize Airflow and GitOps to schedule and orchestrate complex workflows, ensuring reliable and timely data delivery.
- Code Development: Write clean, efficient, and well-documented Python code for data processing tasks, ensuring reusability and scalability.
- Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand data needs and deliver high-quality data solutions.
- Performance Tuning: Optimize data pipelines and queries to improve performance and reduce costs, ensuring efficient use of resources.
- Monitoring and Troubleshooting: Implement monitoring solutions to ensure data pipelines are running smoothly and troubleshoot any issues that arise.
Requirements:
- Experience: 3+ years of experience as a Data Engineer or in a similar role, with a strong focus on building data pipelines and working with cloud data technologies.