Set up GPU machines

To use GPU machines for your Docker-based installation of Datalore On-Premises, add the deviceRequests field in the agents-configs.yaml file:

        privileged: true
        deviceRequests:
          - driver: string
            count: number
            deviceIds: [strings]
            capabilities: [[strings]]
    

where:

privileged is a parameter that instructs Datalore to run a container in privileged mode. When set to false, it instructs Datalore run a container in unprivileged mode
capabilities is the only mandatory subfield for the device request.
deviceIds is a list of strings with the GPU device IDs from the host. You can find the device ID in the output of the nvidia-smi interface on the host.
count is the number of the GPU devices to be reserved (providing the host holds that number of GPUs).

Last modified: 15 November 2024