What does a real image look like? The rise of modern AI photo editing and generation tools makes this an interesting question.
People fear it's getting too easy for friends to take a photo of you and create a whole video where you're doing something weird. Like star in a Home Alone movie.
Home Stallone is pure fun. We all know Sylvester Stallone wasn't in Home Alone because there's decades of documented evidence.
Plus deepfakes aren't there yet. You can ask a suspicious video participant to look sideways and the current generation of AI will mess up their nose. Folks have started using deepfakes to scam through interviews.
Deep-ish fakes are here
What happens when deepfake tech becomes even easier to use?
My iPad already has a feature to "seamlessly remove objects from a photo using AI to fill in the blank". Photoshop. Works great. 2 taps.
When anyone could have a Rule 34 photo floating around the internet. Do we freak out or roll with it?
I hoped this freedom would come with social media. Everyone says stupid shit online and everyone has past beliefs they’ve outgrown. So what’s the big deal?
Instead we went the opposite way. Everyone is super self conscious and censoring at all times because you never know who’s gonna take it out of context and make a big deal.
Like that dad who got banned from Google for sending a photo of his son to a doctor. In the near future someone could send you a questionable deepfake photo and get you banned from anything 🤔
Are any modern photos real?
Truth is, photos have never been real real. They involve processing. Digital, chemical, or optical.
We can all agree these aren't real photos of an old man.
Matt Growcoot used the same prompt to compare AI image generators. Nothing in these images is real in the sense that photons never bounced off the subject into a recording device. Drawing from imagination.
What about this video of Jordan Peele "driving" Obama's face?
Obama's speech happened and was recorded with a regular camera. Jordan Peele's video happened and was recorded with a regular camera. Then researchers (artists?) merged the two so the video looks and sounds like Obama saying Peele's speech. 🤔
What about this photo?
Obvious photoshop. I took a photo of myself, tapped "select subject" in Photoshop, deleted the background, and replaced it with the first search result for "lambo". Took 2 minutes.
If it's made of real photos, does that make it real?
What about this one?
The entire photo looks as it did in reality. Except the colors are punched up with Lightroom. That makes it look more exciting.
Maybe punched up colors are not real. What about this photo then?
Here the photo looks just as my iPhone 13 mini took it. But the phone uses advanced algorithms to fix colors and lighting. As the New Yorker put it:
Apple’s newest smartphone models use machine learning to make every image look professionally taken. That doesn’t mean the photos are good.
Yes the photo looks similar to what I saw. But there's magic afoot. Taking that same photo with my DSLR that doesn't have Apple's algorithms wouldn't have worked.
Lots of light from the back. My face would be dark.
And did you know that until recently cameras weren't able to accurately capture black faces? Not even old analog film cameras.
Were photos ever real?
Even before digital buffoonery you couldn't really trust a photo. Cameras see differently than your eyes. A lot like using data to lie with facts.
Focal distance changes how your face looks.
Which of those is the photographer's real face? Your brain can adjust and say "They're all the same". But they don't look the same do they?
Journalists use framing, perspective, and optical tricks to push a narrative. Like in this famous example of early Covid coverage.
Danish news site reminds people of being skeptical of how news photographers take pictures. Here is the same place, one picture taken with a zoom lense, and the other with a wide-angle lense: https://t.co/lPMJDHXOfD pic.twitter.com/mOSpiFEsDx— Thomas Baekdal (@baekdal) April 26, 2020
Which of those is the real photo? They both happened at the same time in the same place. Different angle and lens.
Is this a real photo then?
PS: this probably wasn't an excuse to show off how good I look in a suit. It's from a HackerNews discussion, but our brains are lying to us all the time so who knows
Learned something new?
Read more Software Engineering Lessons from Production
I write articles with real insight into the career and skills of a modern software engineer. "Raw and honest from the heart!" as one reader described them. Fueled by lessons learned over 20 years of building production code for side-projects, small businesses, and hyper growth startups. Both successful and not.
Subscribe below 👇
Software Engineering Lessons from Production
Join Swizec's Newsletter and get insightful emails 💌 on mindsets, tactics, and technical skills for your career. Real lessons from building production software. No bullshit.
"Man, love your simple writing! Yours is the only newsletter I open and only blog that I give a fuck to read & scroll till the end. And wow always take away lessons with me. Inspiring! And very relatable. 👌"
Senior Mindset Book
Get promoted, earn a bigger salary, work for top companiesLearn more
Have a burning question that you think I can answer? Hit me up on twitter and I'll do my best.
Who am I and who do I help? I'm Swizec Teller and I turn coders into engineers with "Raw and honest from the heart!" writing. No bullshit. Real insights into the career and skills of a modern software engineer.
Want to become a true senior engineer? Take ownership, have autonomy, and be a force multiplier on your team. The Senior Engineer Mindset ebook can help 👉 swizec.com/senior-mindset. These are the shifts in mindset that unlocked my career.
Curious about Serverless and the modern backend? Check out Serverless Handbook, for frontend engineers 👉 ServerlessHandbook.dev
Want to Stop copy pasting D3 examples and create data visualizations of your own? Learn how to build scalable dataviz React components your whole team can understand with React for Data Visualization
Did someone amazing share this letter with you? Wonderful! You can sign up for my weekly letters for software engineers on their path to greatness, here: swizec.com/blog
By the way, just in case no one has told you it yet today: I love and appreciate you for who you are ❤️