DSCN0093 In Caesarea Maritima, Herod built a fairly large palace that extended out into the Mediterranean Sea. The westernmost section of the palace contained a fresh water swimming pool, which is still visible today.