Do I really have to use my pinky finger to fret?
Yes, you absolutely have to use your pinky finger to fret.
It sucks at first, and feels weak. This happens to everyone.
But over time it will get better, faster, stronger… until eventually, it’s one of your best fretting fingers.