![]() Ggml_metal_init: loaded kernel_norm 0x10700ee90 Ggml_metal_init: loaded kernel_rms_norm 0x10700e670 Ggml_metal_init: loaded kernel_get_rows_q6_K 0x10700dfb0 Ggml_metal_init: loaded kernel_get_rows_q5_K 0x10700d930 Ggml_metal_init: loaded kernel_get_rows_q4_K 0x10700d2b0 Ggml_metal_init: loaded kernel_get_rows_q3_K 0x10700cc30 Ggml_metal_init: loaded kernel_get_rows_q2_K 0x10700c5b0 Ggml_metal_init: loaded kernel_get_rows_q4_1 0x10700bf30 Ggml_metal_init: loaded kernel_get_rows_q4_0 0x10700b8b0 Ggml_metal_init: loaded kernel_get_rows_f16 0x10700b0c0 Ggml_metal_init: loaded kernel_diag_mask_inf 0x10700aa40 Ggml_metal_init: loaded kernel_soft_max 0x10700a3e0 Ggml_metal_init: loaded kernel_gelu 0x107009d30 Ggml_metal_init: loaded kernel_relu 0x107009810 Ggml_metal_init: loaded kernel_silu 0x1070092f0 ![]() Ggml_metal_init: loaded kernel_scale 0x107008dd0 Ggml_metal_init: loaded kernel_mul_row 0x1070088b0 Ggml_metal_init: loaded kernel_mul 0x107008280 Ggml_metal_init: loaded kernel_add_row 0x107007d60 Ggml_metal_init: loaded kernel_add 0x107007530 Ggml_metal_init: loading '/Users/Konstantinosvamvourellis/llama2/llama.cpp/tal' Llama_new_context_with_model: kv self size = 256.00 MB Llama_model_load_internal: mem required = 4193.33 MB (+ 256.00 MB per state ) Llama_model_load_internal: ggml ctx size = 0.08 MB Llama_model_load_internal: model size = 7B Llama_model_load_internal: ftype = 15 (mostly Q4_K - Medium ) Llama_model_load_internal: freq_scale = 1 Llama_model_load_internal: freq_base = 10000.0 Llama_model_load_internal: n_head_kv = 32 Llama_model_load_internal: n_vocab = 32000 Llama_model_load_internal: format = ggjt v3 (latest )
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |