Body and Soulhs

The skin on my body is prefectly smooth and has lots of moisture. The problem is my face, it is oily but when I rub (or without rubbing) my face, the skin is so easy to come out.

The current brand I use is Netrougena and I use their toner, moisturier and cleanser every day and night. I didn't have the problem with Netrougena b4, but since I used the acne cleanser / moisturizer set from the demonologist, I have less acne problem but skin just fall, no itchy, no pain or redness. The demonologist told me not to use it everyday, then I use the set once every three days, it helped a little and now I haven't use that over a week and skin just getting worse.

Does anyone know what are some possible solution? I even use Jurlique lavender oil (it's for sensitive skin) on my skin after the moisturizer and nothing good happens.