Model Market¶
Overview¶
The Model Market on Highrise Cloud is an integrated platform featuring a variety of pre-trained Large Language Models (LLMs). Users can select suitable models based on their business needs for development, training, tuning, and inference deployment.
Available Models¶
The Model Market includes, but is not limited to, the following selected models:
- Meta-Llama-3-8b-instruct: Suitable for a variety of natural language processing tasks.
- Gemma-2-2b-it: Optimized for conversational and interactive applications.
- Qwen2-72b-instruct: A powerful model ideal for complex reasoning and analytical tasks.
Usage Steps¶
Step 1: Browse the Model Market¶
After logging into the Highrise Cloud platform, navigate to the Model Market to view the list of available models.
Tip
Use the search function to quickly find models relevant to your needs.
Step 2: Select a Model¶
Filter models based on application scenarios or framework types. The Model Market supports multiple application scenarios, including text, images, natural language processing, and computer vision.
Consideration
Consider the model's performance and compatibility with your data and infrastructure.
Step 3: Deploy a Model¶
After selecting the desired model, click the deploy button to create an inference service based on the model.
Deployment Requirements
Review the model's deployment requirements and resource needs before deployment.
Step 4: Model Operations¶
Once the model is deployed, you can perform operations such as viewing API documentation, model fine-tuning, model evaluation, and online experience.
Integration
Use the provided API documentation to integrate the model seamlessly into your applications.
Common Issues and Solutions¶
| Issue | Solution |
|---|---|
| Authentication Error | Ensure the API key is correct and active |
| Request Timeout | Verify network connectivity and latency |
| Unexpected Response Format | Confirm the model name and request payload |
Next Steps¶
After deploying the model, you can start using it for inference or further development. You can proceed to the Model Service to learn more about managing and optimizing your deployed models.
We wish you a pleasant experience using the Model Market on the Highrise Cloud platform!