I'm a data engineer and Microsoft Data Platform MVP. I specialise in building and automating analytics platforms using Microsoft technologies from the SQL Server stack to the Azure cloud. I’m a fervent advocate of DataOps, with a technical focus on bringing automation to both analytics development and operations. An active member of the data community and keen knowledge-sharer, I'm a volunteer, organiser, speaker, blogger, open-source contributor and author – my book Azure Data Factory by Example will be published by Apress in September 2021. I hold a PhD in Computer Science and participate enthusiastically in choral singing, craft ale and cocktails, most successfully in that order.

Contact me at:

A six-part series on test automation for Azure Data Factory pipelines. Automated testing is a key component of CI/CD development pipelines: it allows you to run more tests, more often, more quickly, with guaranteed repeatability. In the series I build up an approach to writing tests for ADF and triggering them automatically.

Sprockit is a powerful but lightweight ETL process controller for managing SSIS package and T-SQL stored procedure execution. It's free, open-source and written purely in T-SQL. You can download it here.