Working long time at one place vs switching every few years
So I've been with Goldman almost 4 years (joined straight out of college) and I see many people jump around every 2-3 years. Many of my friends have switched companies at least once in this period. I'm kinda starting to feel the FOMO to change companies even though my current situation is pretty good - high potential, great visibility, learning a lot, decent income (2019 TC: 140k). Just want to mention that I've been switching teams internally during this time so I've been exposed to different parts of the company.
How do I deal with this FOMO? I've tried getting offers a couple months back but got rejected after a few on-sites (Google, Flatiron Health, Compass to name a few). If I switch I'd go for higher comp and more prestige companies with good tech. So I guess I'm not good enough for higher bar companies, the market is competitive or it's a combination of both. What would you do in my situation, stay for another year and learn as much as possible and then reevaluate or try finding something again this year?
2019 TC: 140k