Breast asymmetry can have a number of causes. If present from a young age, it is likely congenital. If the breasts become asymmetric during puberty, hormone imbalances or conditions may contribute. In adult women, aging and pregnancy can cause the breasts to become more asymmetric over time.