Skip to content
All writing
A reading path

Data & backend systems.

3 posts · Read or watch

Follow a data pipeline from discovery to its activities, parameters, and datasets. Then look at the queues and workers that keep slow operations from holding up the people using your application.

Start here, then go deeper

  1. 3 min read

    Azure Data Factory with Azure CLI - Part 1: Discovering Pipelines & Datasets

    Read-only Azure CLI walkthrough for Azure Data Factory: list factories, pipelines, datasets, and learn how to inspect pipeline definitions.

    YouTube
  2. 8 min read

    Azure Data Factory with Azure CLI - Part 2: Inspecting Pipelines & JSON

    Deeper dive into Azure Data Factory pipeline JSON: activities, parameters, variables, and datasets via the Azure CLI.

    YouTube
  3. 12 min read

    Stop Making Users Wait: Async Queues Explained

    Async processing as a handoff: Django accepts the request, Redis holds the job, and a Celery worker finishes the slow work after the response is already back. Queues, workers, backlogs, retries, and when not to bother.

    YouTube

Pick a thread

Michael JamiesonOpen to opportunities

Software engineer building data pipelines, developer tooling, and cross-platform apps.