SRT/ADT has to be done in sequence ADT first, then a few weeks later SRT. You can wait a few more weeks on ADT - see the MO first, but next week or the week after or the week after that is soon enough.
I agree with what InTheShop said. Just for info, my MO handles the ADT part and the RO handled the radiation. They work as a team at MSKCC. If you can find an MO and an RO who you trust at the same facility, it may make life easier on you both.