Add JAIS model(s) (#8118)

* Add `JAIS` model(s) * cleanup * address review comments * remove hack * un-hardcode max-alibi-bias * minor tweaks --------- Co-authored-by: fmz <quic_fzaghlou@quic.com>
2025-06-26 19:55:04 +00:00 · 2024-07-02 10:36:00 -04:00
parent 023b8807e1
commit 968967376d
6 changed files with 288 additions and 9 deletions
--- a/include/llama.h
+++ b/include/llama.h
@ -89,6 +89,7 @@ extern "C" {
        LLAMA_VOCAB_PRE_TYPE_SMAUG          = 14,
        LLAMA_VOCAB_PRE_TYPE_PORO           = 15,
        LLAMA_VOCAB_PRE_TYPE_VIKING         = 16,
+        LLAMA_VOCAB_PRE_TYPE_JAIS           = 17,
    };

    // note: these values should be synchronized with ggml_rope