Software Engineering

Everything Engineering coming out of Elastacloud right now.

Darren Fuller

Filtering DataFrames with other DataFrames in Spark

Discussion 
Something that comes up quite frequently when people start using Spark is "How can I filter my DataFrame using the contents of another DataFrame?". People with SQL experience will immediately look to
Views 
0 comments0
0
Darren Fuller

Read the documentation for better performance

Discussion 
Documentation is not something people often spend time reading, or if they do then its to quickly find the one thing their after and then get out as quickly as possible, very similar to how I do my Ch
Views 
0 comments0
0
Darren Fuller

Kotlin and Azure Functions - Part 1

Discussion 
I recently posted a tweet in which I briefly mentioned that I'd been writing a simple Azure Function using Kotlin . I thought I'd put together something a bit more in-depth, and which did something
Views 
0 comments0
0
Darren Fuller

Comparing results in Azure Data Studio

Discussion 
I've posted about Azure Data Studio before (then called SQL Ops Studio) but wanted to just bring it up again, specifically where it's helped me in a specific use case. We have a scenario where a mod
Views 
0 comments0
0
Darren Fuller

Saving a DataTable to Parquet with Parquet.NET 3

Discussion 
A while ago I wrote a post about extracting data from SQL and into Parquet . This was aimed mainly at on-premise systems where Data Gateway or others are not an option but you still want to get you
Views 
0 comments0
0
Darren Fuller

You've gotta comprehend

Discussion 
One of the things I often find myself doing is collecting data from external sources to get at feeds of data such as weather, pricing, scheduling etc... Often these sources have been around for a whil
Views 
0 comments0
0
merv

What's the Time Please

Discussion 
Frequently we get requirements for UTC times in Azure SQL databases to be converted into various world time zones. Whilst scripting within the table builds and adding columns, or relying on sever set
Views 
0 comments0
1
Darren Fuller

Save the date

Discussion 
There's still one thing we encounter all to frequently when working with, manipulating or simply extracting data. We can book tickets over our mobile phones, check the news, integrate AI into our webs
Views 
0 comments0
0
Darren Fuller

Unit testing and Python

Discussion 
You might have read a post from me once-or-twice where I've advocated using Python for quickly prototyping solutions, exploring data etc... But regardless of whether you're using it for building a q
Views 
0 comments0
2
Darren Fuller

An eye on the bank balance

Discussion 
We don't all have a bottomless pit of money and I think most of us have learnt by now that it certainly doesn't grow on trees, so in our home lives we keep an eye on how much we're spending otherwise
Views 
0 comments0
1
Darren Fuller

ARM and ARM Functions

Discussion 
Recently I needed to deploy an Azure Data Lake Store - Gen 2 instance and thought I'd take the opportunity to use some custom ARM template functions . These aren't something you often see in the ex
Views 
0 comments0
0
richardp

Azure Durable Functions Fan In/Out Example

Discussion 
Durable Functions is an Azure Functions SDK extension which enables the Azure Function server-less environment to run "stateful" applications. The following example below briefly demonstrates t
Views 
0 comments0
1
Richard Conway

Don't turn your back on Big Compute! (part 1)

Discussion 
We started Elastacloud eight years ago by focussing on High Performance Computing on Microsoft Azure. HPC is normally in the purview of Researchers, Engineers and Risk Calculators in finance but it is
Views 
0 comments0
2
Darren Fuller

When 1am is not 1am!

Discussion 
Dates, you either hate them or you're not paying close enough attention. Recently I've needed to break a day down into buckets of time for a project, for most days of the year this is fine and the 24
Views 
0 comments0
0
Darren Fuller

Azure Active Directory authentication with Azure Functions

Discussion 
So you've been given access to an API which is an HTTP triggered Azure Function which is secured using Azure Active Directory, it needs to be called programmatically so you've been given a few things
Views 
0 comments0
0
Darren Fuller

DotNetCore and Azure Storage

Discussion 
I was busy scanning through various news feeds and came across a link to a post talking about how to use Azure Storage in a DotNetCore application. Curious as always at seeing how others do things I
Views 
0 comments0
0
Divyesh B Chudasama

Azure Data Factory v2.0 - What's New?

Discussion 
Microsoft have now released a v2 of Data Factory. Though this is still in preview, it has the handy ‘Author and Deploy’ tool; this includes the copy activity wizard to assist creating a copy data p
Views 
0 comments0
0
Darren Fuller

Integrating Machine Learning into your .NET applications

Discussion 
There were a lot of great announcements from Build this year, from Visual Studio Live Share to Azure Sphere and everything in between. One thing that I was particularly excited by was the announceme
#thetramway 
Views 
0 comments0
1
Admin

React TypeScript Tab Component

Discussion 
Whilst looking for an example of some Tab components online for a react project I came across exactly what I needed on a github repo by Diego Castillo. However, I was using a Typescript project and,
Views 
0 comments0
0
Darren Fuller

Import Time_Savers

Discussion 
Pandas is a great library, I probably don't need to spend much or any time telling people that, but it's a great library for a number of reasons and not just for data science work. I've been needing
Views 
0 comments0
0