You could always make games as a hobby, best of both worlds. Here’s a great little tutorial site on getting started with a small indie game. If it really is your passion, treat it as such. Keep getting your decent paycheck and make something interesting on the side.