Boy, what are you using as an applicator?
Sometimes trying to remove swirls or microswirls by hand, can be difficult. 80 is an excellent product, and you can achieve success by hand, albeit not as great as a pc, nontheless it is attainable. I would suggest either a microfiber or terry foam applicator. The biggest help I could suggest is also using a instant detailer to provie some additional lubricity. Prior to starting, lightly mist the area your addressing, youll find it much easier to work the area, and when its easier, you can spend additional time required to break down the abrasivesm which is necessary with #80. Good luck.....Your ok with straight motions also. You can use circular also,whatever your more comfortable using. I think you'd have better results with fore/aft motion though....