insignificant prostate cancer

I got some scary news that my doctor is concerned about my rising PSA results. I have been told that i have "clinically insignificant " prostate cancer but now it seems my doctor is worried which makes me worry. I haven't been able to go over results with doctor yet so my anxiety is raging...