Updating a challenge (leaderboard, phases) after its creation

Hello

Thank you for the great work! I am in the process of creating a new challenge and I am using the EvalAI-Starters template. I was testing my challenge development by pushing the code onto the challenge branch. However, when I make updates to the challenge_config.yaml, I face errors which do not allow me to update the challenge on EvalAI. I did not submit a request for approval of the challenge and have kept the leaderboard and challenge private. However I still cannot pass the challenge validation step. My error log looks like this -

ERROR: The leaderboard with ID: 2 doesn't exist. Addition of a new leaderboard after challenge creation is not allowed.
ERROR: Challenge phase 3 doesn't exist. Addition of a new challenge phase after challenge creation is not allowed.
ERROR: Challenge phase split (leaderboard_id: 1, challenge_phase_id: 3, dataset_split_id: 2) doesn't exist. Addition of challenge phase split after challenge creation is not allowed.
ERROR: Challenge phase split (leaderboard_id: 1, challenge_phase_id: 2, dataset_split_id: 2) not found in config. Deletion of existing challenge phase split after challenge creation is not allowed.

I would appreciate any help, thank you for your consideration!