• model_tar_gz@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    9 days ago

    Without reading the article, as a practicing AI Engineer here’s a couple of easy best practices:

    • Use only the .safetensors files, the format is engineered specifically to allow only specific information necessary for NN frameworks
    • Don’t use the ‘trust_remote_code=True’ parameter when serving your models without due consideration of the source of the model.