Is PPO really better than SFT (in general)? under the condition of same amount of data

For example, if we ask the model to generate a program, rather than simply continuation.

If we do not fine-tune them, RL does not even know what to generate I believe.

Do you have more thoughts on this?