In searching around, I've discovered the following:
Plus aegri ex abitu viri quam ex adventu volupatis crepi. by the playwright Plautus from Amphitruo which was translated into English as "I felt more sorrow in his going than joy in his coming."
If possible, I'd like to keep the same sentiment but just tweak it a little into "I shall feel more sorrow in your going than what joy I felt in all our time together."
Any help at all would be greatly appreciated :) Thanks in advance!
x-posted to latin