Good to briefly pan fry fish fillet?

Fish takes so little time to cook, it seems to me that cooking it twice is cooking it too long. I usually just pan sear my fillets for two or three minutes on each side in a medium hot skillet. As soon as the fish turns from translucent to white it is done. To cook it longer kills nutrients and flavor, and makes the fish dry and tough.