Skip to content

Commit 7229d19

Browse files
limam-Bbmahabirbu
authored andcommitted
fix: add NVIDIA CDI device for WSL2 GPU support
Signed-off-by: limam-B <73091373+limam-B@users.noreply.github.com>
1 parent 3fba8e9 commit 7229d19

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

packages/backend/src/workers/provider/LlamaCppPython.ts

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -119,6 +119,12 @@ export class LlamaCppPython extends InferenceProvider {
119119
Type: 'bind',
120120
});
121121

122+
devices.push({
123+
PathOnHost: 'nvidia.com/gpu=all',
124+
PathInContainer: '',
125+
CgroupPermissions: '',
126+
});
127+
122128
devices.push({
123129
PathOnHost: '/dev/dxg',
124130
PathInContainer: '/dev/dxg',

0 commit comments

Comments
 (0)