On a server, you usually don’t use a graphical user interface (GUI), so you just don’t install it. On the other hand, apart from the software that actually does the serving (fileserver need different software than mailservers or webservers), you’ll probably install a remote administration service.