“Senior Data Engineer Job at Andela” If you are passionate about the creation and development of a world-class engineering culture, then you should submit your application to Andela for the post of Senior Data Engineer.
| Job | Senior Data Engineer |
| Location | Lagos (Nigeria), Nairobi (Kenya) |
| Application Closing Date | Not Specified. |
Primary qualifications:
- You are passionate about building and developing a world-class engineering culture
- You are humble and drive positivity
- You value and respect diversity and inclusion
- You are capable of effectively communicating in a data-driven manner
What you get to do:
- Create innovative on-demand and subscription data products using information collected by partner’s worldwide network of contributors
- Model data and process flows for both live and offline data in a way that maps storage systems to business requirements
- Collaborate with data scientists to productize algorithmic prototypes for statistical analysis and machine learning for prediction and clustering
- Implement data pipelines for data transformation and integration (streaming and batch)
- Develop and improve the current data architecture with an emphasis on data quality, improved monitoring, and high availability
- Analyze trade-offs involving latency, throughput, and transactions for distributed systems
- Champion data governance, security, privacy, quality and retention policies
Your background likely includes:
- Expertise designing and maintaining databases (object, columnar, in-memory, relational)
- Proven track record of successful communication of data infrastructure, data models, and data engineering solutions
- Experience with relational data stores as well as one or more NoSQL data stores (e.g. Mongo, Cassandra)
- Prior experience in data warehouse modernization building complete data warehouse solutions, star/snowflake schema designs, infrastructure components, ETL/ELT pipelines, and reporting/analytic tools
- Experience building production-grade data backup/restore, and disaster recovery solutions
- Hands-on experience with batch and streaming data (e.g., Cloud Dataflow, Beam, Spark, Cloud Pub/Sub, Apache Kafka)
- Advanced SQL skills, and proficient in one or more programming languages such as Python
- Familiarity with python data science tooling (pandas, scipy, sklearn)
- Demonstrated proficiency with data structures, algorithms, distributed computing, storage systems
- BS or MS in Computer Science or equivalent work experience & analytical skills
- 5+ years’ of overall programming/data engineering experience
Bonus Points:
- Knowledge of geospatial processing with PostgreSQL and PostGIS
- Experience designing and maintaining data warehouses
- Developing for Google Cloud Platform/Google Professional Data Engineer Certified
- Experience with Python, Java, Scala
- Experience using ArcGIS or other similar GIS systems
What You’ll Get*
- Full-time compensation
- Full medical coverage
- Beautiful working environment
- Opportunity to work with the brightest minds inside and outside of your field
- A chance to change the world for the better