Chuck that crinkly old chamois in the bin. Save the blade for the bathroom. What you need here is some soft and pile-licious microfibre. It absorbs water with the best of them, but helps prevent ‘the dirt that got away’ from damaging the paint.
Take your microfibre drying towel and fold it to a manageable size. Microfibre has pile so any dirt that may have escaped the wash process isn’t pressed directly into the paint. Yes... even after the wash a grain or two of dirt may remain!
Consider using a little detailing spray on the panel that you are drying. This can lubricate dirt particles, reducing their chances of marring the paint.
Either pat dry (very safe but quite time consuming) or use a sweeping technique. Always dry from the top of the car down and fold/wring out your drying towel if it becomes waterlogged.
At the end of the drying process, check your drying towel. A good wash process will mean a clean towel. If it is black with grime and has bits of hedgehog in it, then you should have done a better job of washing the car initially.
If you’re going to clay the car (recommended) you will dry after claying (and rinsing), but before polishing. If you're giving claying a miss, start drying before water spots have a chance to appear...