📌 Anyscale API

Number of APIs: 27

Note: Multi-tenant endpoints will be deprecated on 08/01/2024, use hosted endpoints instead.

Prerequisites

• Qodex

• Anyscale Account: https://app.endpoints.anyscale.com/

Usage

1. Create a fork

2. Update collection variables

3. Send requests

Documentation

• API: https://docs.endpoints.anyscale.com/

• Models: https://docs.endpoints.anyscale.com/

Models

Models include Llama & CodeLlama (by Meta AI, open-weight) and Mixtral (by Mistral AI, open-weight).

About Anyscale

The modern AI infrastructure trusted by the world’s leading AI teams.

1. 🚀 Get Started (Inference) - Chat (meta-llama/Llama-2-70b-chat-hf) POST {{baseUrl}}/chat/completions

2. 🚀 Get Started (Inference) - Chat (meta-llama/Llama-3-70b-chat-hf) POST https://api.endpoints.anyscale.com/v1/chat/completions

3. 🚀 Get Started (Fine-Tuning)-llama-2-13b-chat-hf - Get fine-tuning job GET {{baseUrl}}/fine_tuning/jobs/eftjob_zsab8ywdtku5ybraglvl1rb1nl

4. 🚀 Get Started (Fine-Tuning)-llama-2-13b-chat-hf - Chat (fine-tuned model) POST {{baseUrl}}/chat/completions

5. 🚀 Get Started (Fine-Tuning)-llama-2-70b-chat-hf - Get fine-tuning job GET {{baseUrl}}/fine_tuning/jobs/eftjob_tudiz97ivg13zstd9kllg7i35h

6. 🚀 Get Started (Fine-Tuning)-llama-2-70b-chat-hf - Chat (fine-tuned model) POST {{baseUrl}}/chat/completions

7. 🚀 Get Started (Fine-Tuning)-mistral-7B-Instruct-v0.1 - Create fine-tuning job POST {{baseUrl}}/fine_tuning/jobs

8. 🚀 Get Started (Fine-Tuning)-mistral-7B-Instruct-v0.1 - Get fine-tuning job GET {{baseUrl}}/fine_tuning/jobs/eftjob_g8cug2pze2i41k9hb3mp4l1fs5

9. 🚀 Get Started (Fine-Tuning)-mistral-7B-Instruct-v0.1 - Chat (fine-tuned model) POST {{baseUrl}}/chat/completions

10. 🚀 Get Started (Fine-Tuning)-mixtral-8x7B-Instruct-v0.1 - Create fine-tuning job POST {{baseUrl}}/fine_tuning/jobs