Software Engineering

Something that comes up quite frequently when people start using Spark is "How can I filter my DataFrame using the contents of another DataFrame?". People with SQL experience will immediately look to

Documentation is not something people often spend time reading, or if they do then its to quickly find the one thing their after and then get out as quickly as possible, very similar to how I do my Ch

I recently posted a tweet in which I briefly mentioned that I'd been writing a simple Azure Function using Kotlin . I thought I'd put together something a bit more in-depth, and which did something

I've posted about Azure Data Studio before (then called SQL Ops Studio) but wanted to just bring it up again, specifically where it's helped me in a specific use case. We have a scenario where a mod

A while ago I wrote a post about extracting data from SQL and into Parquet . This was aimed mainly at on-premise systems where Data Gateway or others are not an option but you still want to get you

One of the things I often find myself doing is collecting data from external sources to get at feeds of data such as weather, pricing, scheduling etc... Often these sources have been around for a whil

Frequently we get requirements for UTC times in Azure SQL databases to be converted into various world time zones. Whilst scripting within the table builds and adding columns, or relying on sever set

There's still one thing we encounter all to frequently when working with, manipulating or simply extracting data. We can book tickets over our mobile phones, check the news, integrate AI into our webs

You might have read a post from me once-or-twice where I've advocated using Python for quickly prototyping solutions, exploring data etc... But regardless of whether you're using it for building a q