If someone asks about it, just start to say “Oh, he’s right-” then just stare at the fence for a moment before looking worried and quickly removing the sign and locking your door.