tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-27 03:55:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

server: health: fix race condition on slots data using tasks queue (#5634)

Browse Source 
* server: health: fix race condition on slots data using tasks queue

* server: health:
    * include_slots only if slots_endpoint
    * fix compile warning task.target_id not initialized.
This commit is contained in:
Pierrick Hymbert
2024-02-21 15:47:48 +01:00
committed by GitHub
parent a00a35cef9
commit 1ecea255eb
3 changed files with 84 additions and 43 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/server/utils.hpp
View File

@ -49,7 +49,8 @@ enum server_state {
enum task_type {
TASK_TYPE_COMPLETION,
TASK_TYPE_CANCEL,
TASK_TYPE_NEXT_RESPONSE
TASK_TYPE_NEXT_RESPONSE,
TASK_TYPE_SLOTS_DATA
};
struct task_server {