There are 54 levels in Challenge Mode, but this shouldn't be too hard.
You unlock the levels by how many stars you have altogether in Challenge Mode.
For example if you have 32 stars in total you would have unlocked 32 levels, so you only need 1 star to unlock the next level.