runtime error
Exit code: 1. Reason: undefined reference to `cudaDeviceCanAccessPeer@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaLaunchKernelExC@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaGetLastError@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaHostRegister@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaDeviceEnablePeerAccess@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaMemset@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cublasGemmEx@libcublas.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cublasStrsmBatched@libcublas.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cudaEventSynchronize@libcudart.so.13' /usr/bin/ld: ../../bin/libggml-cuda.so.0.20.0: undefined reference to `cublasDestroy_v2@libcublas.so.13' collect2: error: ld returned 1 exit status gmake[3]: *** [tools/server/CMakeFiles/llama-server.dir/build.make:116: bin/llama-server] Error 1 gmake[2]: *** [CMakeFiles/Makefile2:6141: tools/server/CMakeFiles/llama-server.dir/all] Error 2 gmake[1]: *** [CMakeFiles/Makefile2:6148: tools/server/CMakeFiles/llama-server.dir/rule] Error 2 gmake: *** [Makefile:1843: llama-server] Error 2 Traceback (most recent call last): File "/home/user/app/app.py", line 137, in <module> start_llama_server() File "/home/user/app/app.py", line 56, in start_llama_server binary_path = build_latest_llama_server() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/app/app.py", line 43, in build_latest_llama_server subprocess.run( File "/usr/local/lib/python3.12/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '--build', 'build', '--config', 'Release', '-j', '192', '--target', 'llama-server']' returned non-zero exit status 2.
Container logs:
Fetching error logs...