Salt Stack configuration management

• Links SaltCloudAzure , SaltStack/GrainsPythonFunction

• improve output of state.apply to a lot of minions

  • salt --state-output=mixed --summary "*" state.apply backups.deploy

  • sudo salt-call --state-verbose=false state.apply

salt edit /etc/fstab

• Edit lines in fstab e.g. Match cloudimg-rootfs and set the last 0 to a 1

  •  $ sudo salt "*" cmd.run "sed -i '/cloudimg-rootfs\s/ s/0$/1/ ; /cloudimg-bootfs\s/ s/0$/2/' /etc/fstab ; cat /etc/fstab" 

Cloud deploy salt-cloud

• With python debug pudb
  • sudo pudb /usr/bin/salt-cloud --log-level info --map=/etc/salt/cloud.maps.d/softlayer-maps-SVRCONFIG-SALTMASTER.conf

Fix salt-stack apt repo to stable version

• edit /etc/apt/sources.list/saltstack.list

  • deb https://repo.saltstack.com/apt/ubuntu/14.04/amd64/2017.7 trusty main

• Fix  NO_PUBKEY 0E08A149DE57BFBE 

  • sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 0E08A149DE57BFBE

Run from dev branch

• Use pip

  $ sudo pip install salt==2018.3.0rc1

  or

• $ git clone git@github.com:saltstack/salt.git

• git remote add upstream https://github.com/saltstack/salt

• $ git fetch --tags
• virtualenv salt
• source ./salt/bin/activate
• pip install -e ./salt

Do grains lookups for mine values

• Salt mine is a db of all the minion grains.
• It can be used to lookup a value for another minion, e.g. IP

  $ sudo salt-call mine.get 'role:mysql' network.ip_addrs grain

• Using a grain to find the ip of a host with a specific role.(Using mine.sls function that is network.ip_addrs + cidr

  {% set db_ip = salt.saltutil.runner('mine.get', 
                  tgt='G@environment:'+grains['environment']+' and G@role:database',
                  fun='internal_ip_addrs',
                  tgt_type='compound')[0] %}

Links

• Online yaml parser - http://yaml-online-parser.appspot.com/

• http://seedickcode.com/devops/saltstack/saltstack-a-better-salt-top-sls-part-2/

• surveys

  • http://stackoverflow.com/questions/18092979/how-can-i-aggregate-saltstack-command-results

  • https://docs.saltstack.com/en/latest/ref/runners/all/salt.runners.survey.html

SaltStack errors and notes

ERROR:201905 - state.apply "Rendering SLS 'base:<xx>' failed: mapping values are not allowed in this context"

• Cause was a -require: with a string ending in a colon ":"
• Fix: remove the ":"

ERROR:201904 - state.apply "- Rendering SLS 'base:<xx>' failed: did not find expected alphabetic or numeric character"

• Cause was un-quoted context, that received a value "*-serv.jar"

• Fix

    context:
      file: "{{ file-src }}"

ERROR:201811 - mine.get - Unable to manage file: Jinja error: too many values to unpack

• snippet of salt.sls state giving the error

  {#% for server, addrs in salt['mine.get'](
        'G@environment:'+grains['environment']+' and G@role:webserver'
      , 'network.ip_addrs'
      , tgt_type='compound')  %}

• Fix: add dictsort ???

  {#% for server, addrs in salt['mine.get'](
        'G@environment:'+grains['environment']+' and G@role:webserver'
      , 'network.ip_addrs'
      , tgt_type='compound') | dictsort() }

• Explanation: in for loop, python just return the dict keys same as .keys(), but if we add " | dictsort() " we get loop over dicts, not keys.

ERROR:201811 - unicode

• Found offending character with

  grep -n -r -P '[^\x00-\x7f]' salt/common/

ERROR:201810 - docker

• https://github.com/saltstack/salt/issues/45292

• my error

  ----------
            ID: pull down docker_image xxx
      Function: docker_image.present
          Name: xxx.docker.io/xxx.service.xxx:latest
        Result: False
       Comment: Encountered error pulling xxx.docker.io/xxx.service.xxx:latest: Unable to perform images: cannot import name universaldetector

ERROR:201810: salt pip AttributeError: type object 'InstallRequirement' has no attribute 'from_line'

• https://github.com/saltstack/salt/issues/49967

Resolve error on Ubuntu 16.04

1. Uninstall all pip i can with

   pip2 freeze > req.all.txt
   pip2 uninstall -y -r req.all.txt
   #remove files i cant uninstall
   # loop back to pip2 uninstall

2. apt uninstall salt-minion and salt-common
3. apt install salt-minion and salt-common

THE.END ...