tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-26 10:09:41 -04:00
Code Issues Packages Projects Releases Wiki Activity

metal : parallel command buffer encoding (#1860)

Browse Source 
* metal : parallel command buffer encoding

* metal : determine number of command buffers based on gf->n_threads
This commit is contained in:
Georgi Gerganov
2023-06-15 20:29:48 +03:00
committed by GitHub
parent 6b8312e797
commit 4bfcc855ab
2 changed files with 471 additions and 447 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
ggml-metal.h
View File

@@ -55,6 +55,7 @@ void ggml_metal_set_tensor(struct ggml_metal_context * ctx, struct ggml_tensor *
void ggml_metal_get_tensor(struct ggml_metal_context * ctx, struct ggml_tensor * t);
// same as ggml_graph_compute but uses Metal
// creates gf->n_threads command buffers in parallel
void ggml_metal_graph_compute(struct ggml_metal_context * ctx, struct ggml_cgraph * gf);
#ifdef __cplusplus