Why did he do this? Was I moving too fast? Guys answer please :)?

Okay so me and this guy are kinda dating...exclusive but without the officialness lol...we've already had and we're really touchy feely. So the other night we went on a movie date and he put his arm around me and i leaned in and snuggled up into his chest...he was rubbing my arm and had his hand on my leg...so i put my hand on his leg...not necessarily on the groin area but right below it...i just kinda kept it there and every once in a while i would kinda move my fingers really slow and light on his inner thigh...and after a minute he took my hand and put it all the way down by his knee! Was i moving too fast was he not in the mood or did he just not want to get turned on?