You never fill that hole. Not completely. Having kids helped and hurt at the same time. Get some therapy if you can, they can give you excellent tools for dealing with it.