Comment to How is the Agent App used
-
To enable the use of open-source models from various providers, it would be beneficial to allow direct modifications to the OpenAI API base configuration in UNA sdudio. This involves:
- Enabling Direct Modifications:
- Allow configuration of the OpenAI API base so it can be updated to include support for open-source models from different providers.
- Implementing an Endpoint for Model Selection:
- Add an endpoint for selecting from available models, including those from various open-source providers.
- Testing and Validation:
- Ensure that the new configuration allows seamless integration and usage of both OpenAI and open-source models.
Comment: I have directly modified the script to change the OpenAI API address and used local models or models from other free APIs. However, it would be more flexible if the OpenAI address were a variable that can be changed directly from the studio. This would simplify configuration and allow users to set up various local or online providers according to their preferences.