Just wanted to share that I have a similar story and a happy outcome. Had no problem getting pregnant with my daughter in 2009, but after delivery my UC flared out of control and I had my first surgery when she was 3 months old.
After a disappointing pouch experience, I went back to the temporary ileo 2 years ago and started trying to get pregnant, but after about a year of trying we got a fertility workup. My HSG was not quite "perfect," one of the tubes had some resistance in it, but it appeared that they were both clear. However, ultrasound showed big pockets of fluid around both my ovaries, suggesting that they were both enveloped in scar tissue, preventing egg from ever reaching sperm, so they recommended going straight to IVF, no IUI or anything else. We had a successful fresh cycle of IVF and my little boy is due in January! We are excited.
I agree with Jill, find a clinic that has good outcomes and low complication rates if possible. I was so fortunate to have a world class fertility center just up the street, so that helped a lot. They harvested 12 eggs, 5 fertilized, and 3 ultimately made it to blastocyst stage (which is great because you can choose to only transfer one--we really wanted to avoid putting my body through a twin pregnancy!). So we still have two frozen embryos that we will eventually transfer (only option we were comfortable with for extra embryos). I'm hoping to have my humpty dumpty body put back together again before any more pregnancies after this, but we just feel so fortunate that things have worked out so well so far, I know not everyone has that experience. Good luck, feel free to PM me with any questions!