I had a metal door and an iron gate inside with shitty locks. Burglers broke the locks and got in.
I replaced the door and got great locks. The locks held up fine but they broke the gate right out of the wall and got in.
If someone wants to get in, they will.
One workaround that I can think of is to use ip reservation to give your devices the same ip address whenever they connect. You might find that setting under DHCP on your router. Or just use a static ip on the server.