Published a new notebook in AI4Code Competition on #Kaggle. This one shows how you can train a BERT-Large model on a bigger subset of data and not run out of GPU memory thanks to several optimisations ⚙️ All this with @weights_biases logging support📊🚀 Tweet added by Tanay Mehta @serious_mehta

Tanay Mehta

2 years

Published a new notebook in AI4Code Competition on #Kaggle . This one shows how you can train a BERT-Large model on a bigger subset of data and not run out of GPU memory thanks to several optimisations ⚙️ All this with @weights_biases logging support📊🚀

AI4Code Training BERT-Large in PyTorch - W&B + AMP

Explore and run machine learning code with Kaggle Notebooks | Using data from Google AI4Code – Understand Code in Python Notebooks