rhtenhove
174e8562aa
Encountered a similar problem as in https://github.com/mostlygeek/llama-swap/issues/709 but in my case I only needed the :cpu version. So decided to add the github action to build arm64 combined with the amd64 version on the same :cpu tag. Already tested it from this fork: ghcr.io/rhtenhove/llama-swap:cpu and it works perfectly fine. Adding GPU support is a whole other beast, needing quite a bit more work and isn't something I can test.
87 lines
2.8 KiB
YAML
87 lines
2.8 KiB
YAML
name: Build Containers
|
|
|
|
on:
|
|
# time has no specific meaning, trying to time it after
|
|
# the llama.cpp daily packages are published
|
|
# https://github.com/ggml-org/llama.cpp/blob/master/.github/workflows/docker.yml
|
|
schedule:
|
|
- cron: "37 5 * * *"
|
|
|
|
# Allows manual triggering of the workflow
|
|
workflow_dispatch:
|
|
|
|
# Run on workflow file changes (without pushing)
|
|
push:
|
|
paths:
|
|
- '.github/workflows/containers.yml'
|
|
- 'docker/build-container.sh'
|
|
- 'docker/*.Containerfile'
|
|
|
|
# grant permissions on GITHUB_TOKEN to publish packages
|
|
# ref: https://docs.github.com/en/packages/managing-github-packages-using-github-actions-workflows/publishing-and-installing-a-package-with-github-actions#publishing-a-package-using-an-action
|
|
permissions:
|
|
contents: read
|
|
packages: write
|
|
id-token: write
|
|
|
|
jobs:
|
|
build-and-push:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
platform: [intel, cuda, cuda13, vulkan, cpu, musa, rocm]
|
|
fail-fast: false
|
|
steps:
|
|
- name: Checkout code
|
|
uses: actions/checkout@v6
|
|
|
|
- name: Free up disk space
|
|
if: matrix.platform == 'rocm'
|
|
run: |
|
|
echo "Before cleanup:"
|
|
df -h
|
|
sudo rm -rf /usr/share/dotnet
|
|
sudo rm -rf /usr/local/lib/android
|
|
sudo rm -rf /opt/ghc
|
|
sudo rm -rf /opt/hostedtoolcache/CodeQL
|
|
sudo docker system prune -af
|
|
echo "After cleanup:"
|
|
df -h
|
|
|
|
# QEMU enables arm64 cross-builds on the amd64 GitHub runner.
|
|
# Currently only the cpu backend goes multi-arch; the action is a
|
|
# no-op for amd64-only builds, so leaving it on for every matrix
|
|
# entry keeps the workflow simple.
|
|
- name: Set up QEMU
|
|
uses: docker/setup-qemu-action@v4
|
|
|
|
- name: Set up Docker Buildx
|
|
uses: docker/setup-buildx-action@v4
|
|
|
|
- name: Log in to GitHub Container Registry
|
|
uses: docker/login-action@v4
|
|
with:
|
|
registry: ghcr.io
|
|
username: ${{ github.actor }}
|
|
password: ${{ secrets.GITHUB_TOKEN }}
|
|
|
|
- name: Run build-container
|
|
env:
|
|
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
run: ./docker/build-container.sh ${{ matrix.platform }} ${{ github.event_name != 'push' }}
|
|
|
|
# note make sure mostlygeek/llama-swap has admin rights to the llama-swap package
|
|
# see: https://github.com/actions/delete-package-versions/issues/74
|
|
delete-untagged-containers:
|
|
needs: build-and-push
|
|
# Skip on forks — the delete API requires package-admin on the
|
|
# upstream account and would otherwise red-x every fork CI run.
|
|
if: github.repository == 'mostlygeek/llama-swap'
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/delete-package-versions@v5
|
|
with:
|
|
package-name: 'llama-swap'
|
|
package-type: 'container'
|
|
delete-only-untagged-versions: 'true'
|