Maybe it’s too late for you to care, but you originally steal them from the Empire Docks East of Pyrog’s Castle, and there are two boats there. Did you lose them both?

I’m playing through it now.