You would need to talk to the shore service desk the day before to make sure you can get of early as taking their bus could be problematic. As well they usually call independent travellers late in the process.
But we had an identical experience in Capetown some years ago and we were let off...