Why does my man act like he doesnt want me some times?

OK so I ve had talks with him before and it really gets me no where. Its like when Im around him he is very attentive and caring. He will go fix me something to eat or hold me in his arms and kiss me. Also when we have he doesnt worry about my pleasure and when I tell him that I didnt get anything he acts like it hurts his feelings. I live with my parents. When Im not around him he doesnt call me and sometimes doesnt anwer my phone calls. He also goes days without talking to me. Im always going to his house and sometimes he come over to mine. He says he doesnt like my mine because they make us sit in the living room with him. Im like soo...?? When I ask if he wants me he says he does and says he loves me but not in love with me. I feel like Im doing all the work in the relationship and Im not receiving anything. Which I ve also said something to him about that. I just really want some imput on whether Im just a fling to him or if he really cares about me. I ve even tried to turn the tables on him and stay out late with friends or not call him some nights. And he gets mad with me for not calling him or he gets suspicous of me when i stay out late. I ve asked him if he wants to be friends and he says not really. What should i do?