People who are pregnant should not take Diovan as it can harm the unborn baby, especially in the second and third trimesters. Additionally, those allergic to valsartan or with specific kidney conditions should avoid it. Always consult a doctor before starting Diovan.