Yes, it's advisable to continue to keep contact with a GI after takedown, whether or not this person previously treated you. This is especially true if you don't see your surgeon on a regular basis, or if your surgeon doesn't provide "after care." (some don't; it really depends on the surgeon). If you're looking for a new GI, keep in mind that some GIs don't deal directly with j-pouches, so it's important to confirm that any potential treating GI would be willing to take you on as a patient under the circumstances. That being said, if you have a surgeon who is well versed in pouch problems and treatment, and is willing to follow you after your surgery and is available to see you when needed, then you might not need a GI at all. Some surgeons in fact get very territorial over their pouches and prefer to keep close tabs on their patients. But, this is a decision that should be made between you and your surgeon.
I was in a similar situation, in that I did not see my first GI again after he referred me to my current surgeon. I also lost contact and was no longer considered a patient. A few years after my surgery, my GP and I decided I should have a GI involved in my care, at least as a contact, should any issues pop up (which incidentally, they did.). I found a great GI in the city who was fantastic, personable and understanding, and very well versed in j-pouches. Sadly, he left to practice in Belgium a year later, so I lost a great doctor. Then it was 18 months of "musical GIs": I saw two temporary fill ins at my old GI's former practice before I was finally referred to my current GI, who is actually one of top IBD specialists in Canada. Ironically, after all that bouncing around, my surgeon has recently taken back over my care and I see him every 6 months now, or as needed. I don't usually see my GI anymore unless he and my surgeon decide it's necessary.