riding problem?

I think that your horse is just not used to direct contact with you on his back....especially since it's the first time riding him . He will get used to it and if he doesn't then I would talk to your vet about that becaues it might be a medical problem other than that just have patience with him :)