As someone who isn't a professional programmer, I enjoy experimenting and finding ways to simplify my workflow. This GUI was created to make it easier for me to adjust parameters and save them for future use, without constantly modifying the webui.py or managing multiple scripts. While I'm glad to share this script with others, please understand that my expertise in maintaining it might be limited. Nonetheless, I hope it proves helpful to you, and I appreciate your understanding.

WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, that allows users to configure settings and start the oobabooga web user interface (WebUI). It provides a convenient way to adjust various parameters and launch the WebUI with the desired settings.

• Select a model from a dropdown menu or none (with reload button if added while the StartUI is open)
• Choose wbits and groupsize options
• Select the operating mode (chat, cai-chat, notebook)
• Choose between CPU, GPU or Autodevice
• Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
• Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
• Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
• Enable authentication and choose an authentication file
• Choose extensions for the WebUI
• Enable local network mode and specify the listen port
• Automatically open the browser when loading is finished
• Save settings to a profile
• Load profiles via Dropdown menu.
• Run the text-generation-webui Updater
• Character loader.
• deepspeed Settings
• flexgen Settings
• API Settings
• StartUI Update Notification

1. Clone the repository or download the source code.
2. Install the required dependencies listed in the requirements.txt file.
3. Run the StartUI.py script using Python python3 StartUI.py.
4. Configure the desired settings using the GUI elements.
5. Click the "Save Settings" button to save the current settings to a profile.
6. Click the "Load" button to load and apply settings from a saved profile.
7. Click the "Start" button to launch the WebUI with the selected settings.

Binary releases of this script can be found in the Releases section of this repository. Just put the two files into the root Folder of oobabooga (where the folder with the webui.py and the start script is). On Linux, you'll need to give StartUI the executable flag (chmod +x StartUI or right click -> properties -> make executable).

The WebuiGUI.py must also be there, to handle the flags properly

V1.4 :\

StartGUI is developed and maintained by Pakobbix. It is based on the PyQt5 library and uses gpustat for GPU information. Oobabooga for his great webui.