Hello community. We are trying to set up the supported extension “Auth0 Logs to [AWS] CloudWatch”. We actually have it configured both in our test & prod tenants, but we have the same problem in both tenants: the logs that are being shipped to CloudWatch are 1 month old (so pretty useless).
The problem (I believe) is simple to state: since we have an enterprise account, Auth0 is keeping (nicely) 1 month of event logs for us, but this extension can only ‘ship’ a small-ish number of log events per cycle (5 minute min cycle), and it is starting from ‘the beginning’ of our logs, and so it can never ‘catch up’ to today. In fact, it wouldn’t even keep up even if we could tell it “don’t start from the beginning of the logs, just start with any that are from now+”, because we (our users) are generating more log events than it can process.
When we configure it, the “BATCH_SIZE” is defaulted to 100, and increasing that number seems to have no effect. In the Github repo, I see this line of code:
… which appears to state “if you set me (BATCH_SIZE) to >100, I’ll just (only) do 100”.
Any advice on how to configure this extension properly will be appreciated.