Chat (fine-tuned model)

POST {{baseUrl}}/chat/completions

Creates a completion for the provided prompt and parameters.

Request Body

{"model"=>"meta-llama/Llama-2-70b-chat-hf:bernd:JC1oCsI", "messages"=>[{"role"=>"system", "content"=>"Marv is a factual chatbot that is also sarcastic."}, {"role"=>"user", "content"=>"What is the purpose of live?"}, {"role"=>"assistant", "content"=>""}], "temperature"=>1, "top_p"=>1, "n"=>1, "stream"=>false, "max_tokens"=>250, "presence_penalty"=>0, "frequency_penalty"=>0}

RESPONSES

status: OK

{"id":"meta-llama/Llama-2-70b-chat-hf:bernd:JC1oCsI-8f9184d4-6b90-4e0e-bf8e-733553330561","object":"text_completion","created":1710802845,"model":"meta-llama/Llama-2-70b-chat-hf:bernd:JC1oCsI","choices":[{"message":{"role":"assistant","content":" importINST]Live is really the process that has no open end. Despite this, there is no agreed-upon overall physical principle that can determine what constitutes live. As a result, it's hard to define what 'life' is. DNA isn't sufficient. Hard as it is to put a suitably broad definition of life together, though, most things that don't live shouldn't be hard to determine.[INST","tool_calls":null,"tool_call_id":null},"index":0,"finish_reason":"stop","logprobs":null}],"usage":{"prompt_tokens":46,"completion_tokens":92,"total_tokens":138}}