":{"code":400,"message":"request (21064 tokens) exceeds the available context si...
错误信息
ZCode 报错信息
报错摘要
Model request exceeded the provider context window.
TraceID: b599d6b5-c3ce-4cb5-b1e3-5f4a49720f5b
报错详情
provider=new-provider model=ling-tiny:latest request=0b49a289-fc6e-45da-b7d4-c15866175bf0 reason=context_exceeded status=400 retryable=false
{"error":{"code":400,"message":"request (21064 tokens) exceeds the available context size (8192 tokens), try increasing it","type":"exceed_context_size_error","n_prompt_tokens":21064,"n_ctx":8192}}
AI 解决方案
🔍 错误翻译
原文:{"error":{"code":400,"message":"request (21064 tokens) exceeds the available context size (8192 tokens), try increasing it","type":"exceed_context_size_error","n_prompt_tokens":21064,"n_ctx":8192}}
译文:{"error":{"code":400,"message":"请求(21064个token)超出了可用的上下文大小(8192个token),请尝试增大它","type":"exceed_context_size_error","n_prompt_tokens":21064,"n_ctx":8192}}
🎯 原因分析
ling-tiny:latest 模型时,模型无法处理超过其上限的输入内容💡 解决方案
方案一:精简输入内容
移除或压缩不必要的上下文信息,确保总token数不超过限制:
# 修复后的代码
def send_request(prompt):
# 对长文本进行截断或摘要
if len(prompt) > 7000: # 预留安全余量
prompt = truncate_or_summarize(prompt)
return call_model(prompt)
方案二:切换到支持更大上下文的模型
如果内容长度必须保留,换用支持更大上下文窗口的模型:
# 修复后的代码
response = client.chat.completions.create(
model="long-context-model", # 切换为支持大上下文的模型
messages=[{"role": "user", "content": long_text}]
)