How to work training and generating on GPU environment
Hello,
Thank u so much for this wonderful work, it works perfectly!!!! And I was thinking if I could work on GPU will be much more efficient.
But there are some problems with training and generating on a GPU environment that I can't figure out.
Sorry, I do not know well about working it on GPU, never tried that before. :(
Want to ask if you can help me with this problem. Thank u so much!!! :)
(GPU---RTX3050-8G)
Hi Jonathanlin,
Not sure how can I help you, if you follow the installation guidelines from huggingface, the transformer library works by default on GPUs. Then, the code in the documentation uses also the GPUs by default.
But I am distressed about which part of the code in the documentation alters to the GPUs by default. :(
I am trying to add .to('cuda') on it, but I can't found here should I check? Want to ask if you have any tips or suggestions.