tristan/gptel
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

gptel-curl: Increased curl timeout (#127)

Browse source 
gptel-curl.arg (gptel-curl--get-args): Increase curl timeout.

Often local LLMs will offload a query to CPU if there is not enough VRAM or in
the case of an unsupported GPU. When a query is offloaded to the CPU responses
can be significantly slower. If curl times out early the user will not get the
response from the LLM back in Emacs.

This change increases the timeout for curl from 60s to 300s to make gptel usable
in slower environments.

Closes #125
This commit is contained in:
Nick Anderson 2023-11-04 22:58:09 -05:00 • committed by Karthik Chikmagalur
parent c97778d5a8
commit ec0e461b35
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
gptel-curl.el
View file

@ -55,7 +55,7 @@ PROMPTS is the data to send, TOKEN is a unique identifier."
(list "--location" "--silent" "--compressed" "--disable" (list "--location" "--silent" "--compressed" "--disable"
(format "-X%s" "POST") (format "-X%s" "POST")
(format "-w(%s . %%{size_header})" token) (format "-w(%s . %%{size_header})" token)
(format "-m%s" 60) (format "-m%s" 300)
"-D-" "-D-"
(format "-d%s" data)) (format "-d%s" data))
(when (not (string-empty-p gptel-proxy)) (when (not (string-empty-p gptel-proxy))