You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Here is the docker info that you can use to host kafka data on the host drive in Windows. I am using deephaven with redpanda so some of the configuration details might be for deephaven.
The reason for saving data on the host drive as opposed to the docker image is that if you have a high-velocity stream (ex. stock market stream), you can fill up the space on the docker image in just a few days, and then you will have issues with redpanda not starting. To overcome this issue, you need to save data to the host drive.
The syntax for the drive path is as follows. This section would go under services->redpanda.
volumes:
- E:/redpanda:/var/lib/redpanda/data`
The path on the left of the colon above is your Windows directory where you want Kafka data to be saved (instead of in the docker image). This path can be changed depending on your preference but make sure the drive has plenty of space as the space can get filled very quickly in a high-velocity stream.
The path to the right of the colon is the path that redpanda/kafka needs for docker. DO NOT change this path as this is the path mapped to your Windows folder. Anything other than this path will result in data being saved on the docker image.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Here is the docker info that you can use to host kafka data on the host drive in Windows. I am using deephaven with redpanda so some of the configuration details might be for deephaven.
The reason for saving data on the host drive as opposed to the docker image is that if you have a high-velocity stream (ex. stock market stream), you can fill up the space on the docker image in just a few days, and then you will have issues with redpanda not starting. To overcome this issue, you need to save data to the host drive.
The syntax for the drive path is as follows. This section would go under services->redpanda.
The path on the left of the colon above is your Windows directory where you want Kafka data to be saved (instead of in the docker image). This path can be changed depending on your preference but make sure the drive has plenty of space as the space can get filled very quickly in a high-velocity stream.
The path to the right of the colon is the path that redpanda/kafka needs for docker. DO NOT change this path as this is the path mapped to your Windows folder. Anything other than this path will result in data being saved on the docker image.
Here is the full docker-compose file.
Beta Was this translation helpful? Give feedback.
All reactions