tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-28 12:25:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

server: free sampling contexts on exit (#7264)

Browse Source 
* server: free sampling contexts on exit

This cleans up last leak found by the address sanitizer.

* fix whitespace

* fix whitespace
This commit is contained in:
Steve Grubb
2024-05-14 10:11:24 -04:00
committed by GitHub
parent 1265c670fd
commit 4f0263633b
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
examples/server/server.cpp
View File

@ -671,6 +671,13 @@ struct server_context {
model = nullptr; model = nullptr;
} }
// Clear any sampling context
for (server_slot & slot : slots) {
if (slot.ctx_sampling != nullptr) {
llama_sampling_free(slot.ctx_sampling);
}
}
llama_batch_free(batch); llama_batch_free(batch);
} }