Replacing NetHandlerPlayServer for each player

Basically I'm reworking the way player interaction is processed by adding some things to the nethandlers. I've already replacing the client one easily with something like this

@SubscribeEvent
public void onClientTickEvent(ClientTickEvent event){
	if(!(Minecraft.getMinecraft().playerController instanceof CustomPlayerController)){
		System.out.println("Player Controller got changed?");
		Minecraft mc = Minecraft.getMinecraft();
		CustomNetHandlerClient customNet = null;
		if(mc.getNetHandler()!=null){
			customNet = new CustomNetHandlerClient(mc, mc.getNetHandler().guiScreenServer, mc.getNetHandler().netManager, mc.getNetHandler().profile);
		}
		try{
			WorldSettings.GameType currentGameType = Minecraft.getMinecraft().playerController.currentGameType;
			Minecraft.getMinecraft().playerController = new CustomPlayerController(Minecraft.getMinecraft(),customNet);
			Minecraft.getMinecraft().playerController.currentGameType=currentGameType;
		}catch(Exception e){
			Minecraft.getMinecraft().playerController = new CustomPlayerController(Minecraft.getMinecraft(),customNet);
		}
	}
}

On server side however this seems a lot trickier. Where would the nethandlers be stored on the server and could they be replaced without replacing the entityplayer? Also with the player connection event on the serverside the nethandler in the event seems to be final, does that mean all the nethandlers are final?