I've been programming in some form since my early teens. After high school, I went on to get an Honors degree in electrical engineering from the university of the Witwatersrand, South Africa. I've always been drawn to software development and to teaching. I worked for a string of startups and gained a lot of experience in all aspects of software development, from requirements gathering and UX design to implementation, deployment, and monitoring.

I am currently the CTO of Umuzi. Our purpose is to reduce social inequality in Africa through digital education.

My role at Umuzi is many-fold:

- I create syllabuses to teach critical tech skills
- I mentor learners and staff in technical and "soft" skills
- I help design and set up human/management systems (we have a LOT of people we need to keep on track)
- I write code so we can improve, automate and modularise our interventions so we can impact on more people in meaningful ways

I spend my free time on rock climbing, Brazilian Jiu Jitsu, hiking and guitar.

Accepted Talks:

Airflow - beyond the basics (and also some basics)

Apache Airflow is a platform that allows Pythonistas to programmatically author, schedule and monitor workflows. It was originally created by the nice folks at Airbnb because they had a lot of problems.

xkcd comic

Now Airflow is open source and pretty well documented. But it has a few gotchas and unexpected behaviors.

In this tutorial we'll cover:

  • a setup tutorial and tour for those who are new to Airflow
  • using Airflow command line utilities for efficient dag authoring
  • how to create custom operators that don't break Airflow's magic. We'll do this by creating a Django operator (airflow tasks are instances of operators)
  • strategies for passing non-trivial data between tasks
  • how to generate Dags and tasks based on data instead of authoring everything by hand ( a dag is like a workflow, a collection of tasks and configuration)

The examples that will be covered in the tutorial are available from this github repo.

Python Software Foundation
Thinkst Canary Afrolabs