use cases
Cache Stampede Protection With TaskFused, One Rebuild When a Busy Page Expires
A news site’s front page is built from a dozen slow queries, so it’s cached for five minutes. At the moment the cache entry expires, three hundred readers are …
Version 0.1, free and open source
Run duplicate requests once, even when workers crash
TaskFused gives each piece of work a name. When the same request comes in again, from the same program or another one, it joins the operation already under way and gets the same result. Operations live in one local SQLite file, so a job whose worker died is picked up again under the same ID.
1 run
For 100 identical requests: one created the operation, 99 joined it, and it ran once
1.1 s
From killing a worker mid-job to the same operation finishing on a new one, with a one-second lease
26
Storage failures forced across 13 kinds of write; each one rolled back with nothing half-saved
Apache 2.0
License for all of the code
Measured on a two-core Linux cloud machine with SQLite flushing every change to disk. The test logs are on GitHub.
Guides and notes
All posts →
use cases
Client Retries After a Timeout With TaskFused, the Second Request Joins the First
A phone app sends “import my contacts” to your server. The import takes twelve seconds, but the app gives up after ten, because that’s what its HTTP …
releases
First TaskFused Release Runs Duplicate Requests Once and Survives Worker Crashes
Some work gets asked for more than once. Someone double-clicks Export. A client times out and sends the request again while the first one is still running. Ten dashboards …
the name
How TaskFused Got Its Name From Fusing Duplicate Tasks Into One
To fuse is to join two things so completely that they become one. Metal fuses when it melts together. Two bones fuse as they heal. Nothing is stacked or queued; …
testing
How TaskFused Was Tested With Killed Workers and Injected Storage Faults
TaskFused makes one promise above the others: work that two requests share is done once and kept safe, even when the process doing it dies. That’s easy to claim and …
use cases
Monthly Report Exports With TaskFused, Built Once When Ten Managers Click at 9am
On the first working day of the month, every regional manager opens the dashboard and clicks Export on last month’s sales report. The report is the same for all of …
use cases
Paid AI Calls With TaskFused, One Model Call Billed When Three Parts of an App Ask
A user uploads a 40-page contract and the app wants a summary. The browser asks for it when the page opens. The search indexer asks for it a few seconds later, because …
use cases
Payments and Emails With TaskFused, Using the Operation ID as the Idempotency Key
A shop charges a customer’s card when they confirm an order, then sends the receipt. The confirm button gets double-clicked, the request gets retried, and a worker …
use cases
Video Rendering Through a Deploy With TaskFused, the Job Moves to a New Worker
A video app turns each upload into a 1080p preview. A render takes about four minutes of CPU. Deploys happen several times a day, and every deploy restarts the render …
Questions or ideas?
If TaskFused nearly fits your project, or you'd like it to do something it doesn't yet, write in.