CSGHub: An open source platform for asset management of large language models

By /

CSGHub is an open source platform developed by the OpenCSG team to provide efficient management solutions for large language models (LLMs) and their related assets. cite

1. Upload models on CSGHub

To upload models on CSGHub, you need to first register and log in to your account, create a model warehouse, and then upload the model files. CSGHub supports uploading files through both Git and the Web interface.

  1. Upload models using Git

    First, make sure your local environment has Git installed and configured with the appropriate account information. Then, follow the following steps:

    • Clone Model Warehouse: Use the Git command to clone the model repository on CSGHub locally.

      Git clone warehouse address>

    • Copy the model file: Copy the local model files to the cloned warehouse directory.

      cp -r /path/to/your_model_files/* Warehouse Directory/

    • Add and submit changes: Execute the following command in the warehouse directory to add changes and commit them.

      cd warehouse catalog>
git add .
git commit -m "Add model file"

    • Push to remote warehouse: Push committed changes to a remote repository on CSGHub.

      git push

    Note:For large files with specific suffixes (such as.bin、.h5etc.), CSGHub will automatically use Git LFS to upload. If your model file type is not in the default list, you need to check in thegit addPreviously execute the following command:

    git lfs track ""

    citeturn0search1

  2. Upload models using the Web interface

    You can also upload model files directly through CSGHub’s Web interface:

    • Create a new file: On the warehouse page, click “Add File” and select “Create New File”, fill in the file content and submit it.

    • Upload files: Click “Add File” and select “Upload File” to select a file locally and upload it.

    citeturn0search1

2. View the historical records of the model warehouse

each timegit add、commitandpushChanges are recorded in the model warehouse when operating. You can view the history in the following ways:

  • Submission history: On the warehouse page, click “Submission History” to view all submission records.

  • Check the specific changes: Click on a single submission to view the specific changes (diff) introduced by that submission.

citeturn0search1

3. Deploy CSGHub

CSGHub supports multiple deployment methods, including Docker and Kubernetes. Here is an example of Docker:

  1. Install Docker: Make sure Docker is installed on your system.

  2. Run the CSGHub container: Start CSGHub with the following command:

    docker run -d --name csghub -p 80:80 opencsg/csghub

  3. Visit CSGHub: open in the browserhttp://localhost, use the default administrator accountrootand passwordRoot@1234Log in.

citeturn0search3

Through the above steps, you can efficiently upload, manage and view your model assets on CSGHub, making full use of the features provided by the platform.

Github：https://github.com/OpenCSGs/csghub

Oil tubing:

Scroll to Top