Try Remote Desktop for Mobiles -- it isn't free like the VNC client, but it seems to be more reliable, and definitely much quicker. They have a trial that you can use to see if it fits your purposes. I was glad to find it after having many of the same struggles you have had with the VNC client.
http://www.desktopmobiles.com/