Work starts to preserve harbour’s historic walls