Dear Mr./Ms. XXX,
You are leaving the office soon. We will miss you.
It has been wonderful for us to work with you. I have not talked personally with you much because of my poor English, but you have been sincere and considerate to us.
We all wish you much happiness and good health. Please contact us when you come back to Japan.
[your name] or [names]