how do you decide between q4 and q5 on a 70b when 24gb is the cap?
·
0 reactions
·
0 comments
·
15 views
Original article
r/LocalLLaMA
Anonymous · no account needed