In storytelling, there a concept of a character's desire and need. Desire is a short-term goal outside of a character. Need is something within a character - what a character really wants but don't know about yet. It is something we need for a better life but can't get because one of our weaknesses stops us. And a character's change happens when they overcome their weaknesses, reach the goal and fulfil the need.
It works because the same happens in real-life. Sometimes we get what we desire but pay a heavy price for it. It disappoints us because it's not what we really need. The realisation comes and it can be upsetting. It is one of the best types of life lessons we can get.
How can we avoid disappointment step? We can either follow our curiosity or intuition. They are not the same even though they seem quite similar. Following our curiosity or listening to our intuition is beneficial because they never lie. They are less affected by the present situation and rely more on our experience and memories. They happen in our subconsciousness and we often do not understand why.
Sometimes the world defines our desires for us. We follow them to reach goals that are not truly ours. But I want to believe there's a part in our head that is who we really are at the essence. Listening to it is the most important thing you can do in your life.
"Can you remember who you were, before the world told you who you should be?" - Unknown Author