I'm trying to run Apache Druid on M1 Mac with an ARM 64 processor as docker containers. This works fine as it runs via emulation. But I've encountered two issues with it.
- The druid containers (specifically broker) keep crashing with an exit code of 137. I was able to make it work by increasing the docker memory allocation to 8 GB, but this is not ideal.
- The entire druid setup is very slow. It takes a long time for the entire cluster to spin up and even once it is up, it is slow during ingestion and querying.
I'm wondering if there is a docker image built for ARM64 configuration or dockerfile/instructions to build it from source.
CodePudding user response:
Regarding #1 - Yes, I've hit this as well. The default configuration of the services requires about 7GB of memory to run as a cluster of containers.
Regarding #2 - Druid is designed to run on a cluster. Running on a single computer will allow you to test functionality, but it won't be indicative of the performance you can expect when running on a cluster. If you are just testing functionality, I would suggest a single server execution. There are configurations that use very little resources. Look at the nano and micro quickstart options here: https://druid.apache.org/docs/latest/operations/single-server.html
Here are the instructions to build the docker image: https://github.com/apache/druid/tree/master/distribution/docker