Just thought I'd give an update in case anyone else has this problem in the future.
I took it to a local tool repair guy and he fixed it up for me in less than a day for 25 bucks. He said the polish dust gets inside them and that's what causes it usually. It works perfect now.
I had an older model which only came with a 1 year warranty I guess(looking at the original paperwork), plus I bought it used in a package with lots of pads for a good price, so I didn't mind paying for the repair. I'm just glad the guy took care of me quickly so I can still do my details this weekend without issues.
If anyone is in NJ I highly recommend Power Tool Company in Neptune, call them at 732-776-8282.