• KrasnaiaZvezda@lemmygrad.ml
    link
    fedilink
    arrow-up
    1
    ·
    2 days ago

    I can run Qwen 2.5 Coder 14B Q4_k_m on CPU at only a little above 1 t/s but it’s worth it when I just want to have it look at whatever code I have without disclosing it with corporations that don’t have my best interests in mind.