A new Wifi router would not be the best solution. If there’s an available conduit between the houses I would go for fiber install and get 2 ethernet to fiber adapters then get plug that into your current router or look at directional antenna assuming you have line of sight between the houses.
All rooms having dual cables pulled to each room with CAT7 wiring.