emacs-elpa-diffs
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[nongnu] elpa/gptel ec0e461b35 128/273: gptel-curl: Increased curl timeo


From: ELPA Syncer
Subject: [nongnu] elpa/gptel ec0e461b35 128/273: gptel-curl: Increased curl timeout (#127)
Date: Wed, 1 May 2024 10:02:12 -0400 (EDT)

branch: elpa/gptel
commit ec0e461b351d4b1ff388d3e4ffb8f898ddac141e
Author: Nick Anderson <nick@cmdln.org>
Commit: Karthik Chikmagalur <karthikchikmagalur@gmail.com>

    gptel-curl: Increased curl timeout (#127)
    
    gptel-curl.arg (gptel-curl--get-args): Increase curl timeout.
    
    Often local LLMs will offload a query to CPU if there is not enough VRAM or 
in
    the case of an unsupported GPU. When a query is offloaded to the CPU 
responses
    can be significantly slower. If curl times out early the user will not get 
the
    response from the LLM back in Emacs.
    
    This change increases the timeout for curl from 60s to 300s to make gptel 
usable
    in slower environments.
    
    Closes #125
---
 gptel-curl.el | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/gptel-curl.el b/gptel-curl.el
index 6a0211737d..ae4c993502 100644
--- a/gptel-curl.el
+++ b/gptel-curl.el
@@ -55,7 +55,7 @@ PROMPTS is the data to send, TOKEN is a unique identifier."
      (list "--location" "--silent" "--compressed" "--disable"
            (format "-X%s" "POST")
            (format "-w(%s . %%{size_header})" token)
-           (format "-m%s" 60)
+           (format "-m%s" 300)
            "-D-"
            (format "-d%s" data))
      (when (not (string-empty-p gptel-proxy))



reply via email to

[Prev in Thread] Current Thread [Next in Thread]