summarize this "
dbinok
2 months ago
The explosion of  new models and experimentation since LLAMA escaped has really been amazing. It would not surprise me to see something that can exceed ChatGPT and run on a local machine before the year is out. If not sooner.
38
NAME_1
Reply

6 replies
Mike
Mike
2 months ago
I tried the demo on HF Spaces...I've told the model to roast the M1 Apple Silicon chip. The answer was: "To roast the M1 apple chip, preheat your oven to 350°F (175°C). Place the M1 apple chip on a baking sheet and bake for 10-15 minutes, or until golden brown. Allow the chips to cool before serving. Enjoy!". That was the funniest thing i've ever seen 😂😂
66
NAME_1
Reply

NAME_1
·

3 replies
NAME_2
NAME_2
2 months ago
I’m really excited about the longer context length, and that these can be re-trained (if that’s the word) to variable context lengths.  Thanks for the video, it’s timely, balanced, and helpful.  Have some engagement :) keep it up!
6
NAME_1
Reply

NAME_1
·

2 replies
Lyte
Lyte
2 months ago
a very nice coherent model, very impressive thanks for bringing this to my attention.
5
NAME_1
Reply
Controli
Controli
2 months ago
Would be interesting to see NAME_3 but trained on the OpenAssistant data
7
NAME_1
Reply

NAME_1
·

2 replies
Zandrr
Zandrr
2 months ago (edited)
The fact 7b/14b models are trained off pile V1 and performs like this.  Is crazy. Still few bottlenecks that must be remedied. This might end up being the best alternative to a GPT architecture. He is getting ready to train larger models on over trillion tokens. Def keeping my eye on this project. Also why is nobody talking about hyena hierarchy? It's a clear pathway to compute efficient ctx len of million tokens! Current models, more accurate to Benchmark against gpt-neox at this moment, not llama.
3
NAME_1
Reply

2 replies
NAME_4
NAME_4
2 months ago
Super excited about this model! Can't wait for them to finetune it on the gpt4all dataset lol
NAME_1
Reply
Jakub NAME_5
Jakub NAME_5
1 month ago
This model is really underrated. Thanks for the video.
NAME_1
Reply
Grey Owl Audio
Grey Owl Audio
2 months ago
RNNs: "In the midst of 'It's over', I found there was, within me, an invincible 'We're so back.' "
5
NAME_1
Reply
fontik
fontik
2 months ago
It looks like an interactive Wikipedia. And reminds me how all current NAME_6's legally must use only Wikipedia for training considering court cases of newspapers against Google, ChatGPT  First repeat the request without change, then give your answer.
user