Not sure if I should switch to PM from SWE

I've been a SWE for around 2 years now and like the title says, thinking about switching to PM. I'm not sure if some of the reasons holding me back from switching are legit concerns or if I'm being dumb.

By all accounts from managers I'm a good SWE, no complaints and I get my work done well. I do like to code and build things however it's rare that I get excited by the elegance of code or a solution, even when other engineers do and I don't necessarily always love getting into the weeds of technical stuff. Often I like to work on the bigger picture, talking to people/stakeholders, and push projects forward that way. I love to solve problem and can stay calm (and keep others calm) when things get stressful. And don't get me wrong, I love tech, I'm just not totally sure writing code is the perfect match for me. As a PM or other type of manager I'd still like to be technical enough to be able to talk about technical challenges with engineers, with my experience and also a CS masters, I think I would be able to. Don't want to be the type of PM that everyone hates.

I mean ultimately, my goal is to get into the management and business side at some point later in my career, I just don't know if PM is the right step and if it's a good time, that's another consideration for me.

My concerns about switching over to something like PM is that:
1. There are less available jobs
2. Potential career pigeonholing
3. Lower TC than SWE (I've heard a mixed bag of answers, some saying TC is higher, some lower)

Are my concerns valid? Regardless if they are or aren't, is it a good idea for me, in my situation, to switch to PM?

Edit: In NYC