Ugh what do I do? did he use me?

Just forget about him. If he's mean to you like that, but he tried to feel you up, then he's just using you. You said it yourself, he's only showing signs of being ually attracted to you. Just move on. You deserve better.