Maybe it’s slightly convoluted but here’s how I tackle it in my head: I just think of infrared and ultraviolet, ultraviolet being greater frequencies than violet and infrared being the opposite for red. Blue is on the way from infrared to ultraviolet, so blue has a greater frequency than red.