I’ve been thinking. What if we used a really long prompt with a lot of guidance and ran it on an 80b model? could we overcome the problem of the model not being able to ‘see’ more than 4k tokens? I think it’s worth a try. Maybe I will try this later.
· 1 min read
Archives