ACA, Django & logging to Kibana

Question

ACA, Django & logging to Kibana

Anand 0

This should be a solved problem, however, I'm here. I'm running ACA. I want to send logs from my server (django) and celery workers to Kibana. Each of these is running as a container instance. I have a docker file for each of my containerized instances through which I deploy to ACA. I would like to: Ship my logs to Kibana How to do this: use Filebeat to ship the logs. The problem: While I know it's possible to modify the container configuration to add Filebeat as a sidecar, I would really like to avoid this since I have my Docker files which I deploy from and would like my workflow to be controlled purely by the docker files. Do you have any way to do this, and/or any resources you can point me to. Non ideal solution: Deploy filebeat as another container app.

MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-30T12:15:16.7933333+00:00

@Anand Thanks for reaching out. AFAIK and quick search I can see that to ship logs from your container instances to Kibana, you can use Filebeat as you mentioned. One way to achieve this without modifying your container configuration is to use a shared volume between your container instances and a Filebeat container. You can create a shared volume in your container app configuration. You can do this by adding a volumes array to your container app resource template and then configuration file that specifies the Kibana output and the log paths to monitor.
Anand 0 Reputation points

2024-02-01T05:28:50.1366667+00:00

Hi Mayank. If I do have to create a separate filebeat container app, then I can do this via a docker file (volumes and everything). What I'm trying to figure out is how to run it as a sidecarOn a related note: Is it possible to create container apps via Docker Compose ? Conceptually, I'm thinking of a scenario where I have a single docker file with the definitions of all the containers I want running (eg: server, celery, redis etc) and use that to create/update the underlying container apps thanks Anand
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-02-02T03:17:24.6966667+00:00

@Anand Thanks for sharing more details. I will check with my team and keep you posted.

Your answer

MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-30T12:15:16.7933333+00:00

@Anand Thanks for reaching out. AFAIK and quick search I can see that to ship logs from your container instances to Kibana, you can use Filebeat as you mentioned. One way to achieve this without modifying your container configuration is to use a shared volume between your container instances and a Filebeat container. You can create a shared volume in your container app configuration. You can do this by adding a volumes array to your container app resource template and then configuration file that specifies the Kibana output and the log paths to monitor.
Anand 0 Reputation points

2024-02-01T05:28:50.1366667+00:00

Hi Mayank. If I do have to create a separate filebeat container app, then I can do this via a docker file (volumes and everything). What I'm trying to figure out is how to run it as a sidecarOn a related note: Is it possible to create container apps via Docker Compose ? Conceptually, I'm thinking of a scenario where I have a single docker file with the definitions of all the containers I want running (eg: server, celery, redis etc) and use that to create/update the underlying container apps thanks Anand
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-02-02T03:17:24.6966667+00:00

@Anand Thanks for sharing more details. I will check with my team and keep you posted.

Share via

ACA, Django & logging to Kibana

Your answer