Pretty much, yes. If you have an entire town covered with a path and you want to remove it, you might as well delete the character, assuming they're literally only a mule. If you delete the pattern itself, your town will be covered in white squares instead.