Figures show nearly 6,000 women waited more than 21 days for an appointment last year.