Break it into two classes. The one holding Main should be called SwordGameServer.cs and the one that holds the TCP and UDP servers as well as the users and games should be an instance class called SwordGame (or something like that).

Basically the only static function in the whole project should be Main.

Say you wanted to gather information with a console command while the game was running and spitting out valuable debug messages. It would be impossible since the information would scroll by too fast.

Apart from that it's hugely convenient to have this information separate. It helps a lot with parsing it visually.