The dirt, syrup, and peanut butter is certainly good reason to kidnap and wash the sweater. But as for your being sick of looking at it--being a number of years farther into this job, I am going to give some totally unsolicited advice, which you are of course free to disregard: The more you can ignore your child's appearance, the better the parent/child relationship will be. Health and safety matter; all else is simply style.
P.S. The Babe went through a phase of wearing leggings or tights on her head, as "pants hair." (This was when she had very short hair, after she took a scissors to it.) She went everywhere that way.
Re:
Re: