microsoft

/

phi-1_5

like 1.36k

Follow

Microsoft 20k

Adding _set_gradient_checkpointing for compatibility when finetuning the model.

Hi,

I find that the updated code for gradient checkpointing does not work in my case, i.e., the memory usage is not reduced.

I wonder whether this code is tested in practice.

Best regards,
Ziniu

Please fix would be very nice

require for fix @gugarosa

Could you please re-update your file with the latest commit? As soon as the merge conflict is solved, I will merge this PR.

I have rebased the PR.

@gugarosa will you be able to merge this?