Aaaaaand the freeze plug actually looked ok, turns out two of the studs I installed pulled the helicoils out of the block, which probably wasnt letting the pump sit flush and was causing the leak.