Quick detailers are not meant to be used when the car has anything more than very light dust on the paint (many actually require a completely clean surface). Waterless washes are formulated to handle soiled paint better than a quick detailer. If your car had any significant amount of dust or dirt on the paint and you used a quick detailer without washing first, then you run the risk of marring the paint. The pressure applied to the towel and the towel you used can also contribute to the marring.
I only use quick detailers to give the "just waxed/sealed" look after a wash. I do not use them if the paint is not 95%+ free of road debris, dust, pollen, and/or dirt.