This is a Livecoding Recap - an almost-weekly post about interesting things discovered while livecoding. It is shorter than 500 words. There are pictures. You can follow my channel, here. New stuff shows up almost every Sunday at 2pm PDT. There’s live chat ;)
Welcome to the first Livecoding Recap. This recap is for the 12th live coding. I don’t have an excuse for not recapping before now. It just took me this long to realize “These are fun, and I learn a lot. I should turn them into short blogposts.”
This Sunday, I started a new quest: To find the definitive answer to "How do you smoothly animate 10,000 elements in React?”.
Many people have asked me about this recently, and I realized I couldn’t give them a good answer. The best I could come up with was, “Try to render fewer nodes?”. The issue is that sometimes you really do need that many nodes because you don’t want to sacrifice fidelity.
So I took my old particle generator experiment and started playing around. It doesn’t use a lot of d3, but it does rely heavily on React and Redux.
It works like this:
- React renders
<circle>elements in a loop
- Redux holds an array of
- Trigger a
move particlesaction 60-times per second
- Add new particles if mousedown
If you change
N particles per loop from 5 to 1,000, all hell breaks loose. Animation grinds to a halt.
To get to the bottom of why this happens, we fired up the profiler. There are two suspects:
- Creating new instances of the particles array 60-times per second
- Rendering those DOM nodes
The profiler wasn’t happy with us:
It seems that “scripting” is the culprit, not rendering. In a 21 second experiment, 18 seconds were spent “scripting”, and less than 2 were spent rendering. Curious.
This implies that copying the array is our big timesink. If this is true, then the fix is simple – use immutable.js. Immutable.js promises to be smart about implementing proper immutable data structures efficiently.
We turned off rendering and kept the array copying. Things became silky smooth.
Curiouser and curiouser.
Looking deeper into the profiler reveals that the problem isn’t data management after all; it’s updating children, either in React or in the DOM.
The next thing to try is finding the bottleneck in updating children. Is it React, or is it the DOM? We can figure that out by replacing React rendering with raw d3 rendering.
This had funny results. Particles didn’t update properly, the animation was glitchy, and there were staleness artifacts galore.
Looks like React does make our lives easier, despite how great d3 is on its own.
But it is faster.
React-motion did give us a great idea though – use css transformations! The GPU renders those; that has got to be fast, right?
Nope. Not fast.
Looks like we do have to get away from the DOM completely. The most promising library we could find to do that was react-koonva.
I’m sure that next time, we will crack this nut. There will be 10,000 dancing dots on the screen.
It’s gonna be great.
PS: the edited and improved versions of these videos are becoming a video course. Readers of the engineer package of React+d3js ES6 get it for free when it’s ready.
Here's how it works 👇
And get thoughtful letters 💌 on mindsets, tactics, and technical skills for your career. Real lessons from building production software. No bullshit.
"Man, love your simple writing! Yours is the only newsletter I open and only blog that I give a fuck to read & scroll till the end. And wow always take away lessons with me. Inspiring! And very relatable. 👌"
Ready to Stop copy pasting D3 examples and create data visualizations of your own? Learn how to build scalable dataviz components your whole team can understand with React for Data Visualization
Curious about Serverless and the modern backend? Check out Serverless Handbook, modern backend for the frontend engineer.
Ready to learn how it all fits together and build a modern webapp from scratch? Learn how to launch a webapp and make your first 💰 on the side with ServerlessReact.Dev
By the way, just in case no one has told you it yet today: I love and appreciate you for who you are ❤️