From pogroms to inquisitions (the most famous was the Spanish Inquisition at the tail end of the 15th century, but there were many, and they occurred in many places, including places now friendly to Jews, like Great Britain) to outright genocide, there really hasn't been a time when the Jews have had unlimited opportunity for growth.