Forget Gang of Four, here are the 7 architectural patterns real programmers use:
- Big Ball of Mud
- Throwaway Code
- Piecemeal Growth
- Keep It Working
- Shearing Layers
- Sweeping It Under The Rug
- Reconstruction
So says perhaps the best software engineering paper ever written – Big Ball of Mud by Foote and Yoder. I agree and have seen, written, maintained, or created all of them.
If you deal with production software written in the real world, this is the paper for you. Every paragraph had me violently nodding along. And it's an easy approachable read. Here it is with my scribbles and annotations, if that helps.
Key insight
The key insight is that none of this is bad. It may even be desirable!
In the beginning, architecture slows you down
— Swizec Teller (@Swizec) November 4, 2024
As you grow, lack of architecture slows you down
recognizing that line is the job
In the beginning of a project, architecture slows you down. You're figuring out the domain, grasping to learn the right abstractions and figure out how things fit together. If you add strict architecture too early, you'll make the wrong abstractions and they'll slow you down. Forever.
You can't fix the wrong abstraction. You have to sit back and let abstractions develop naturally, like a path in the woods. It's okay to get mud on your shoes. That's how new things get built!
Architectural insight is not the product of master plans, but hard won experience. It's how we distill experience into wisdom and disseminate it. Pre-designed top-down architecture never works – working software first, good architecture second.
The bitter lesson in software engineering is that messy fast iteration cycles beat careful upfront design.
— Swizec Teller (@Swizec) March 25, 2024
The 7 real world patterns
Foote and Yoder describe 7 architectural patterns as they exist in the real world. None of these are beautiful or elegant, but they work. That's why we keep using them.
You may have used many of these patterns without knowing they have a name. That's a big part of their beauty – you don't need to be a genius to invent or understand their approach. These are patterns for working people getting shit done.
Big Ball of Mud
Big Ball of Mud is the pattern all software trends toward. Entropy wins and all your code depends on all your other code. There is little to no structure and anything you change could break something unexpected.
Coding turns into trench warfare and every task takes forever. Changes become scary and your software ossifies. You are wading through muck to get anything done.
Detangling this mess is hard but doable. It will take time and effort. If you don't make this investment, eventually you will drown and the business will fail. But if you invest too much too early, the business will also fail.
Throwaway Code
Throwaway Code is code you wrote that one time to quickly solve a problem. It doesn't have good structure or much in the way of engineering, but it gets the job done.
It gets the job done so well that 3 years later it's still sitting there doing its job. Except now your throwaway code is part of the load bearing structure of your system.
The throwaway code keeps getting updates and fixes, but it never quite hurts enough to throw away and write properly.
Piecemeal Growth
Piecemeal growth is a good pattern when done right.
You can't hide in a cave for 3 months, anticipate every eventuality, design the perfect system, and give birth to perfection all at once. You can try but it's going to lead to a lot of wasted effort and software that doesn't do what users need.
Instead the authors suggest iteration cycles, frequent feedback from your users, and adding functionality piece by piece. I think they were trying to say "agile", but the word didn't exist yet. This paper is from June 1999, agile manifesto is February 2001.
These piecemeal additions can lead to a big ball of mud. You lose sight of the architectural vision when you work on the little details.
You need to regularly zoom out and look at your route. Like kicking a can.
Keep It Working
Keep it working is the idea that no matter what, your software's first job is always to stay working. When deadlines get tight or requirements change quickly, architecture always takes a back seat.
When you're pulling your hair out at 4:55pm (or during an outage at 2am) you'll throw your hands in the air, make that ugly cross-cutting import, and flick your thumb at architecture. The code must work and you've got places to be!
That import then becomes throwaway code. You'll come back and fix it eventually won't you.
Shearing Layers
Shearing layers develop between different balls of mud. You have one piece of the system that works and wants to talk to another piece that also works.
But their interfaces don't match.
Since they're both balls of mud, you don't want to change the interface. Who knows what's going to break!?
So you build a translation layer between them. This lets both pieces move independently while staying in touch and working together. Like a shear layer between tectonic plates. Or that thin layer of lube (not wd-40) on a door hinge.
Sweeping It Under The Rug
Sweeping it under the rug is what you do when there's an ugly piece of code that works and resists change.
Time and again experience and studies have shown that your gnarliest code is least likely to change. Nobody wants to touch that.
So you build a nice API on top of the ugly code, hide that thing behind a veneer of respectability, and build isolate the mess under a rug somewhere. Or in a black box.
You know it works, stop touching it, and isolate the rest of your code from that mess spreading like a virus. This is a good thing! The whole point of abstractions is to hide the mess.
Sometimes the mess is because that's the best you can do. Other times it's because the problem it solves is hard and inherently complex. Both are good reasons to add a nice API :)
Reconstruction
When all else fails reconstruction lets you throw the ugly code away and start from scratch. You lose the code and keep the lessons and experience. Your next system will be better.
Done right this is a normal part of the process. Especially as your company grows and requirements change a lot.
First you sweep it under the rug, add shearing layers, and make stable interfaces, then you can start rewriting those boxes.
This is your code as a dependency graph
— Swizec Teller (@Swizec) October 31, 2024
the beginner focuses on boxes (code)
the senior focuses on lines (interfaces)
the ??? focuses on team dynamics that create the lines pic.twitter.com/920JIs2zuH
Can you avoid a ball of mud?
The best way to avoid a big ball of mud is to build small balls of mud. Focus on the interfaces, use contract driven development, and don't worry too much about the mess inside each box.
It's fine. Get your shoes dirty. Ship that thing
Cheers,
~Swizec
Continue reading about Big Ball of Mud – the world's most popular software architecture
Semantically similar articles hand-picked by GPT-4
- You can't stop the business, or why rewrites fail
- Architecture is like a path in the woods
- My favorite lessons from Pragmatic Programmer
- The best engineering books get good 5 years into your career
- You can't fix the wrong abstraction
Learned something new?
Read more Software Engineering Lessons from Production
I write articles with real insight into the career and skills of a modern software engineer. "Raw and honest from the heart!" as one reader described them. Fueled by lessons learned over 20 years of building production code for side-projects, small businesses, and hyper growth startups. Both successful and not.
Subscribe below 👇
Software Engineering Lessons from Production
Join Swizec's Newsletter and get insightful emails 💌 on mindsets, tactics, and technical skills for your career. Real lessons from building production software. No bullshit.
"Man, love your simple writing! Yours is the only newsletter I open and only blog that I give a fuck to read & scroll till the end. And wow always take away lessons with me. Inspiring! And very relatable. 👌"
Have a burning question that you think I can answer? Hit me up on twitter and I'll do my best.
Who am I and who do I help? I'm Swizec Teller and I turn coders into engineers with "Raw and honest from the heart!" writing. No bullshit. Real insights into the career and skills of a modern software engineer.
Want to become a true senior engineer? Take ownership, have autonomy, and be a force multiplier on your team. The Senior Engineer Mindset ebook can help 👉 swizec.com/senior-mindset. These are the shifts in mindset that unlocked my career.
Curious about Serverless and the modern backend? Check out Serverless Handbook, for frontend engineers 👉 ServerlessHandbook.dev
Want to Stop copy pasting D3 examples and create data visualizations of your own? Learn how to build scalable dataviz React components your whole team can understand with React for Data Visualization
Want to get my best emails on JavaScript, React, Serverless, Fullstack Web, or Indie Hacking? Check out swizec.com/collections
Did someone amazing share this letter with you? Wonderful! You can sign up for my weekly letters for software engineers on their path to greatness, here: swizec.com/blog
Want to brush up on your modern JavaScript syntax? Check out my interactive cheatsheet: es6cheatsheet.com
By the way, just in case no one has told you it yet today: I love and appreciate you for who you are ❤️