DataDog/LambdaForwarder

• DataDog is a SaaS log and event monitoring platform.

• For AWS CloudWatch logs, it uses a Lambda function subscribed to new Log's in Loggroups to forward them into DataDog

  • https://github.com/DataDog/datadog-lambda-python

• 2020- Download URL from the yaml deployment Cloudformation

  • https://github.com/DataDog/datadog-serverless-functions/releases/download/aws-dd-forwarder-${DdForwarderVersion}/aws-dd-forwarder-${DdForwarderVersion}.zip

Datadog Monitor - email from aws tag

• Goal: Send alert email to address in aws tag.

  • e.g. domain test.com and tag "AlertEmailPrefix"

    #Datadog - alert
    {{#is_alert}}# Alert msg over{{threshold}}%{{/is_alert}} 
    {{#is_warning}}# Warnign msg over {{warn_threshold}}%{{/is_warning}}
    {{#is_recovery}}# Fixed {{warn_threshold}}%{{/is_recovery}}
    
    {{^is_recovery}}## Currently fine {{value}}.{{/is_recovery}}
    
     - Host: {{host.name}}
     - Device: {{device.name}}
     - value: {{value}} {{#is_match "host.env" ""}}
     - Environment: {{host.env}}
    {{#is_match "host.account" ""}}- Account: {{host.account}}{{/is_match}}
    {{#is_match "host.region" ""}}- Region: {{host.region}}{{/is_match}}
    TEST:
    host.name_tag: "{{ host.name_tag }}"
    AlertEmailPrefix: "{{host.alertemailprefix}}"
    
    {{#is_match "host.alertemailprefix" ""}}@{{host.alertemailprefix}}@test.com{{/is_match}}{{^is_match "host.alertemailprefix" ""}}#No aws tag "AlertEmailPrefix" to send email to{{/is_match}}

Find unparsed datadog logs

• https://docs.datadoghq.com/logs/guide/detect-unparsed-logs/

  • Search for "datadog.pipelines:false" in log explorer.