without the built in switch breaking the smartness

You can’t have a dumb switch magically become smart just because you added another piece. You either need a lamp that is for a switched outlet, or modify an existing switch to no break the circuit