You shouldn't as all your worlds should be saved to the cloud also when asked on the Xbox only delete the game and not any saved data as you can do that too
1