layout: default title: Weekly-#4 First insight of LLM accelerate
Finally find the root reason why my chrome extension was rejected, I put the api_key in .gitignore file and it can't upload to chrome extension store successfully when I upload the zip file.
Actually I found the root reason thought the crx file generated by chrome extension. After I pointed out this reason, google extension team also responce to my email and tell me this reason, this make me feel valued.
I also published this product on several media platforms, what left me a deep impression was reddit, I put my project so hard on this platforms, as a result, it banned my account after five hours, I deserve it. So I register another account, I need to culture it for several days to express myself more free.
The result after publishing haven't totally show, so, I will summary that in the next week.
Learn "Fast Cross Entropy Loss" in unsloth blog, I already undertstood the theory. I also need to porve that based on my own code.
This most important thing I have learnt in this week is I finally understand why llm-accelerate projects can work. Most of code of llm design and writed for common ustage, right now, loss function or transformers are used for million times with same format. As a result, we can make this code and theory more specific and make it can make the current network and task well, changing common function and theory to specific one always can improve the efficiency of training and finetune.
I upload two videos about the solutions of leetcode problem this week, it have plenty of benefits, for example, practicing my english speaking ability, prepare for english interview, try to be a youtuber.
Runing five time this week, half hour every time, it's a good start, If I can insist on this week, maybe I should price me some equipments.
1) unsloth also reference some other paper, there are plenty works can be done about this topic, it's also hard, I think it's worth it.
2) publish new project is a great think, I can receive thank for others even it's a small thank. Own proejct can give me a feeling of children, it's totally different.