If anyone turns up to grump about your yard, put them to work.

A significant percentage of such people will say something like "sure, where do I start digging?" or ask what kind of plants you like. For the rest, well, if they care and can't be bothered to do anything, I don't see why you should be bothered when you lack both time and motivation. (I have planted shrubs in Madison and London (two different gardens), and bulbs for a fannish friend elsewhere in New York City. None of the people involved asked me, though one offered to show me his allotment; all cheerfully accepted when I offered.)