Trying to conceive..?

My husband and I are thinking about trying for our second child. It tooks us over 2 years to get pregnant with our first child. I ended up having to see a fertility specialist. The Dr told me that my follicles were not getting large enough to conceive. I got pregnant my first round of shots and ended up having a miscarriage around 6 weeks. We then got pregnant naturally right after that and had a healthy pregnancy with my daughter. Now that we are thinking of trying again i'm not sure what to do. The Dr never diagnose me with PCOS or anything else. Now I'm wondering if it is going to be possible to conceive naturally again or if I will need to see a specialist. Anyone been in our shoes? Looking for advice on how to proceed....