Using concurrent-ruby for a 1.5x real-world speedup
Posted on March 8, 2026
Onboarding our biggest customer brought on 10x the data, pushing our Lambda outside of the 15 minute timeout. Using ruby-concurrency got us back down to 10 minutes, leaving plenty of headroom for further expansion.
Recently we fully onboarded a new customer that strained our our current architectural approach of doing all batch processing within an AWS Lambda by pushing up against the 15 minute hard limit. The fully managed aspect of AWS Lambda is very appealing to a company of our size so I’m loathe to switch to a different runner to bypass this limitation.
Serveless SvelteKit in AWS Lambda (and all of my frustrations about the process)
I saw an opportunity to keep our OpEx low by running our containerized SvekteKit application in AWS Lambda instead of ECS or K8N and a great vibe coding opportunity. It turned out to be an exercise in frustration. In this post I provide both the solution and the optional color commentary on how I got there. full post »
DuckDB: The database Swiss Army Knife
I initially used DuckDB to prototype a few features for a dashboard app with plans to change it out for a "real database." Instead it became a central component of our application and a useful do-it-all dataprocessing system. full post »
Want more Email?
Screenshot of Layoff Bingo
In the process of getting laid off? Compete with your friends to see who matches the most layoff jargon on Layoff Bingo!
SDR Value Calculator: How to determine if a Sales Development Rep will bring value to your company
Does your organization generate enough leads and close enough deals to benefit from an SDR? This calculator can help you estimate the numbers you'll need.
Equity Calculator: Is it even possible for this startup deal to make me rich?
Looking at an early stage deal? Find out how much that early equity stake grows with the business.
My thoughts on The Economist's: Dawn of the Solar Age
I'm a co-founder of a solar energy data company, so the recent edition of The Economist was of special interest. Their coverage was comprehensive and raised possibilities that I had not yet thought about. full post »
Introducing Layoff Bingo
The last few years have been tough in the tech industry after the hiring binge of the early 2020's. Not only did did everyone start laying off at once, but they all seemed to be using the same language. This seemed like the perfect opportunity to make a bingo board. full post »
Cobbled together data engineering with Ruby, SQLite3, and reveal.js
I needed to understand a sizeable amount of data. I decided to leverage the tools I already new instead of learning a full data processing framework. This was my approach. full post »
SvelteKit testing with Vitest
When looking to write some tests for my new SvelteKit project I first turned to my old standby Jest. But it turns out that Vitest is a better alternative. full post »
Spotlight Series: Enterprise Viral
Playing around with CSS Variables
Since the last time I looked, CSS added support for variables and it's nice for keeping colors consistent. full post »