Anna - I believe that what you are seeing is a replay of much that took part in your life with your father. Every time you tried to show a loving caring part of you he refused to see it and ignored you. Not only that but he has changed you inside a bit, and so that is why you shout angrily at that part of you.
But he is as he is probably because of his own hurt need for love, which he dare not see because of its pain.
The trousers are a sign of caring love for a child - the love that you are feeling was missed.
Anna - I do not know if this helps, but many years ago was with a young man who was digging deep within himself. Suddenly he felt sure his father was dying and he got up to rush to telephone his dad. Knowing how we symbolise in such sessions I assured him that he should carry on with what he was experiencing.
He lay down again and after a while began to say that his father was now dead and he must rush to be with him. It was difficult but I managed to get him to stay with what was happening. He then told me that his father had been buried and had hadn't been there. He maintained that it was all over now, his father was dead and buried.
I assured him that if he were patient there was more to come. And then after a while he said with triumph that he had inherited the strength of his dead father and was now a man.
His father was in fact still alive and healthy, but even if he were dead, it is still the way our inner life works, that if we allow things to happen without constantly jumping to conclusions we go through this wonderful inner experience. It is a form of digesting or integrating those who are so much a part of us.
Tony