Variance and Self-Deception: How to Avoid Overestimating Your Abilities

Variance and Self-Deception: How to Avoid Overestimating Your Abilities

When things go well, it’s easy to believe you’ve cracked the code to success. When they don’t, it’s tempting to blame bad luck. This tendency—to take credit for wins and blame variance for losses—is a classic trap that affects everyone from poker players to investors to entrepreneurs. Understanding the difference between skill and randomness is essential if you want to make better decisions and grow over time.
What Is Variance—and Why Does It Matter?
Variance describes how much outcomes can fluctuate around an average. In games, markets, and everyday decision-making, it means that even good choices can lead to bad results—and bad choices can sometimes be rewarded.
Imagine two investors who both make sound, data-driven decisions. One sees a big return, the other a loss. In the short term, it might look like one is more skilled, but the difference could be pure chance.
Recognizing variance means accepting that you won’t always get the result you “deserve.” It’s a mental discipline that protects you from overconfidence and helps you maintain a realistic view of your abilities.
The Psychology of Self-Deception
Humans have a built-in tendency to overestimate their competence—a bias known as overconfidence. We remember our successes more vividly than our failures, and we interpret random outcomes as proof of skill.
In trading, for example, a streak of profitable days can make someone feel like they’ve mastered the market. In reality, they may have just been on the right side of short-term volatility. When the variance swings the other way, losses can come fast and hard.
Self-deception isn’t just about ego—it’s a coping mechanism that gives us a sense of control in an unpredictable world. But that illusion of control can be dangerous if left unchecked.
How to Keep Variance in Check
Managing variance isn’t about eliminating randomness—it’s about learning to live with it. Here are some practical strategies:
- Focus on decisions, not outcomes. Ask whether you made the right call based on the information you had, not whether you won or lost.
- Keep a decision log. Record your reasoning, choices, and results. Over time, patterns will reveal whether your strategy truly has an edge or if you’ve just been lucky.
- Use data, not anecdotes. Look at large samples instead of isolated events. The bigger the dataset, the clearer the picture of your actual performance.
- Set limits. Decide in advance how much you’re willing to risk—whether it’s money, time, or energy—and stick to it, no matter how things are going.
These habits help you separate skill from luck and maintain a grounded perspective.
When Success Becomes Dangerous
Ironically, success often leads to the biggest mistakes. After a run of good results, it’s easy to believe you’ve found a winning formula. That belief can lead to bigger risks, less critical thinking, and a sense of invincibility.
But variance has no memory. It always comes back around, and if you don’t respect it, you can lose what you’ve built. The best protection is humility—even when things are going your way.
Think Like a Professional
Professional players, analysts, and investors know that variance is part of the game. They measure success by the quality of their decisions, not by short-term results. They understand that even the best strategy will have losing streaks—and that doesn’t mean the strategy is broken.
Thinking like a professional means accepting uncertainty, trusting your process, and constantly evaluating your judgment. It takes patience, discipline, and a willingness to see reality as it is—not as you wish it to be.
Realistic Confidence
Avoiding self-deception doesn’t mean losing confidence. In fact, true confidence is built on insight and experience, not illusion. When you understand the role of variance, you can stay calm during setbacks and humble during success.
That balance—between confidence and realism—is what separates the lucky from the skilled, and short-term success from long-term stability.










