That is, unfortunately, the case. The best thing you can do is just save all the patterns you want to keep with Mable and swap them around whenever you need a specific pattern.
Extra characters is the way to go to bump up the number of patterns you can have to 40. Also note that changing a pattern will not reflect some others such as your town flag.