Eleven Rack Latency

I have been using the eleven rack for a few months now. Until recently I have had no issues with it. Last week when recording I started having really bad latency issues. I am running protools 11, I tried using low latency mode, delay compensation, adjusting the buffer, but nothing helped. The tracks I recorded also had to be adjusted as they were recorded with the latency, so all the sounds were late. I then tried turning off and rebooting the eleven rack, still the issues persisted. I unplugged it and left it for the night, when I came back it it, the issue was fixed. However, it has returned, but this time powering it down and unplugging it does not solve the issue. I have even reset the firmware and made sure it was up to date. Nothing helps. The latency is even there when not running protools, and just using it as an amp for practicing. I am out of ideas. Please help.