Streaming On-Llama 2 70B
Number of APIs: 7
-
Chat (Deep Infra - llama-2-70b-chat-hf) POST https://api.deepinfra.com/v1/openai/chat/completions
-
Chat (Fireworks AI - llama-v2-70b-chat) 🏆 POST https://api.fireworks.ai/inference/v1/chat/completions
-
Chat (Groq - llama2-70b-4096) POST https://api.groq.com/openai/v1/chat/completions
-
Chat (Lepton AI - llama2-70b-4096) POST https://llama2-70b.lepton.run/api/v1/chat/completions
-
Chat (NVIDIA AI - llama2-70b) POST https://integrate.api.nvidia.com/v1/chat/completions
-
Chat (OctoAI - llama-2-70b-chat) POST https://text.octoai.run/v1/chat/completions
-
Chat (Anyscale - llama-2-70b-chat-hf) POST https://api.endpoints.anyscale.com/v1/chat/completions