Troubleshooting

Datalore server logs

• For Kubernetes-based deployment, you can use an alternative method of the log extraction: kubectl logs pod/datalore-0 -n datalore

Notebook agent logs

While the notebook agent is alive, you can read its logs in the same way as with the Datalore server. Because there can be multiple agents running in parallel, it is recommended to obtain its agent ID prior to this step. You can obtain the agent ID from the agent pod metadata.

Once the required pod is identified, proceed with acquiring its logs: kubectl logs pod/datalore-agent-.... -n datalore

Notebook kernel startup logs

In some certain circumstances, you may encounter the following error during notebook agent startup: Kernel failed: Failed to install packages. The error log is available in the notebook Attached Files.

To investigate further, access the notebook's attached files and find an error log with the timestamp matching the time the error occurred.

Configure agent logging level

Perform the following steps to modify the logging level for your agents.

1. From the notebook:

   1. Open the Environment tool from the left-hand sidebar. You may need to start the machine to enable the environment management interface in this tool.

      

   2. Click Edit init.sh to install additional dependencies. This will open the init.sh file in the file viewer on the right side of the editor.

   3. Add the following line: ./set_log_level.sh LOG_LEVEL

2. Use an agent environment variable:

   1. Open the datalore.values.yaml file.

   2. For the required instance, add the environment variable as shown in the example below:

      agentsConfig: external: ... instances: - id: external-agent ... env: - name: AGENT_LOG_LEVEL value: "DEBUG"

   1. Open the agents-config.yaml file.

   2. For the required instance, add the environment variable as shown in the example below:

      external: ... instances: - id: external-agent ... env: - name: AGENT_LOG_LEVEL value: "DEBUG"

   The accepted string values for the variable are: TRACE, DEBUG, INFO, WARN, ERROR, ALL or OFF. The special case-insensitive value INHERITED, or its synonym NULL, will force the level of the logger to be inherited from higher up in the hierarchy. This comes in handy if you set the level of a logger and later decide that it should inherit its level.

Further steps

Most of the time, these logs are self-explanatory and can be helpful in identifying a problem root cause so appropriate actions can be taken. However, if you are stuck, feel free to refer to our support resources.