"Staging" PCa before a surgery or some of the more exotic scans is really just a number. Reading from the Cleveland Clinic Guide, everyone gets a T1c if they have a biopsy simply because of a PSA.
If the DRE is abnormal, you might get a T2, but even then T2 wants the determination that the PCa is capsule-contained.
If they find something (metastasis) in a CT or a bone scan, then yes, you could be a T3 without having surgery.
I didn't get a T stage until after surgery (there is no mention in any of the notes), but I did ask when I saw it on the post-surgery pathology. I was told it would have been T1c.
If you are looking for a reason to dump the uro, ok, but I wouldn't worry too much about the staging - you can figure it out yourself, and it will certainly change.
I would find a good colo-rectal guy and set up an initial visit. They will put a scope up you, most likely - that hurt worse than my biopsy. It was interesting - because of prior colon surgery, my uro/surgeon required a pre-surgery clearance from the colo-rectal.