K1ng, Your question is a little difficult to answer. First off, not all clears are the same (some softer and some harder). Second, light swirls to you may not be light swirls to someone else (including a pro). A test spot is always recommended to dial in your process.
Is it feasible to remove defects by hand?? ABSOLUTELY, but I would tell you that you more then likely will need to step up to a little more aggressive polish than Reflect (unless you want to spend quite a bit of time). I would recommend that you get a GG6 (Griot Garage). It is very "new comer" friendly and will have future use (such as machine waxing/sealing). A great investment in my opinion.