I use the Blue Ultra stuff and haven't noticed any leftover residue.
I have also found that time is significant factor in getting the grime off... I wash a panel, let it sit while I move on to another, then return to rinse and rewash and sit again. I prefer to let the water and detergent do the work instead of mechanically scrubbing it off to minimize scratching.