lady:ops:jobs

Jobs

We mainly distinguish different job types and group all tasks in the below categories. Then decide the order of categories (not jobs) when is desired to run each.

  • Backups
  • Maintenances
  • Reporting
  • Automations (triggered in some way)
  • Group tasks/jobs in above categories
  • Decide on a sort order (when to run each category)
  • Distribute the categorie thru the time windows for batch Jobs

Then, for each category

  • Sort the tasks inside the category
  • Estimate run time window
  • Identify the master task/job (i.e. backup for dumping jobs, logrotate for the reporting), the job that makes no sense run other tasks after it.
  • For progress and partial results, use some logging
  • Buffer Stdout to generate a report
  • Left STDERR to be catched by cron
  • Use least privileged user if possible

From 00:00 to 00:30. The master job is logrotate, which rotates logs and so archives the data.

  • logwatch
  • awstats
  • anteater
  • pflogsumm
  • git report branches (master-independent)
  • MASTER logrotate / binnacle DB log rotate

From 01:00 to 02:00 The master jobs are the rsnapshot set, as it backups the data and dumps generated into the archive.

  • autogit (each 6 hours)
  • MySQL dumps
  • LDAP dumps
  • Redis dumps
  • MASTER bakSnapshot

From 04:00 to 06:00

  • Deploy code and config
  • Package updates
  • MASTER Maintenances

Current Schedule

TimeFrequencyHostGroupUserTask
00:00dailycontinuityldap-backuproot/usr/local/lib/git/autogit.sh -d /var/backups/ldap /usr/sbin/ldap-git-backup
00:00dailycontinuityphproot[ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi
00:00dailycontinuitytransmitdebian-transmission/usr/local/lib/transmission/queueManager.sh &>/dev/null
00:00dailyidorubackupjack/usr/local/lib/git/autogit.sh -d ~/dev-bak /usr/local/lib/backup/bakDev.sh 2>/dev/null
00:00dailyrydellphproot[ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi
00:00dailywiganphproot[ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi
00:01dailycontinuityladyroot/usr/sbin/logrotate /etc/logrotate.conf > /dev/null
00:01dailyidoruladyroot/usr/sbin/logrotate /etc/logrotate.conf > /dev/null
00:01dailylaneyladyroot/usr/sbin/logrotate /etc/logrotate.conf > /dev/null
00:01dailywiganladyroot/usr/sbin/logrotate /etc/logrotate.conf > /dev/null
00:05dailyidorubackupjack/usr/local/lib/git/autogit.sh -d ~/srv-bak /usr/local/lib/backup/bakSrvCnfg.sh -fd""
00:10dailycontinuityDNS-maintenancejack/usr/local/lib/git/autogit.sh -d ~/dns-zones/ /usr/local/lib/backup/bakDNS.sh 2>/dev/null
00:15dailywiganawstatsroot/usr/local/awstats/tools/awstats_updateall.pl -awstatsprog=/srv/sites/common/private/awstats/cgi-bin/awstats.pl now &>> /var/log/awstats.log
00:16weeklyrydellladyroot/usr/sbin/logrotate -f /etc/logrotate.conf > /dev/null
00:17dailyrydellapticronrootif test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi
00:24dailyidoruapticronrootif test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi
00:29dailywiganapticronrootif test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi
00:31dailycontinuityapticronrootif test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi
00:56dailylaneyapticronrootif test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi
01:01yearlyidorubackuproot/usr/local/lib/backup/bakSnapshot.sh yearly
01:04monthlyidorubackuproot/usr/local/lib/backup/bakSnapshot.sh monthly
01:07weeklyidorubackuproot/usr/local/lib/backup/bakSnapshot.sh weekly
01:10dailyidorubackuproot/usr/local/lib/backup/bakSnapshot.sh daily
02:00dailycontinuityladyroot/usr/local/sbin/syscare.sh -d -m count.zero@l3jane.net
02:00dailyidoruladyroot/usr/local/sbin/syscare.sh -d -m count.zero@l3jane.net
02:00dailylaneyladyroot/usr/local/sbin/syscare.sh -d -m count.zero@l3jane.net
02:00dailyrydellladyroot/usr/local/sbin/syscare.sh -d -m count.zero@l3jane.net
02:00dailywiganladyroot/usr/local/sbin/syscare.sh -d -m count.zero@l3jane.net
02:10weeklycontinuityladyroot/usr/local/sbin/seccheck.sh
02:10weeklyidoruladyroot/usr/local/sbin/seccheck.sh
02:10weeklylaneyladyroot/usr/local/sbin/seccheck.sh
02:10weeklyrydellladyroot/usr/local/sbin/seccheck.sh
02:10weeklywiganladyroot/usr/local/sbin/seccheck.sh
03:00dailycontinuitytransmitkodi/usr/local/lib/kodi/task.sh
03:05monthlywigangit-maintenancejack/usr/local/lib/git/branchReport.sh | mail -s Branch report" jack"
03:10dailycontinuitye2scrub_allroottest -e /run/systemd/system || SERVICE_MODE=1 /sbin/e2scrub_all -A -r
03:10dailyrydelle2scrub_allroottest -e /run/systemd/system || SERVICE_MODE=1 /sbin/e2scrub_all -A -r
03:30weeklycontinuitye2scrub_allroottest -e /run/systemd/system || SERVICE_MODE=1 /usr/lib/x86_64-linux-gnu/e2fsprogs/e2scrub_all_cron
03:30weeklyrydelle2scrub_allroottest -e /run/systemd/system || SERVICE_MODE=1 /usr/lib/x86_64-linux-gnu/e2fsprogs/e2scrub_all_cron
04:00monthlywigangit-maintenancegit/usr/local/lib/git/repCheck.sh | mail -s Git Maintenance" jack"
04:05dailyrydelldockerjackdocker container prune -f --filter until=48h
04:10weeklyrydelldockerjackdocker network prune -f --filter until=24h
04:20monthlyrydelldockerjackdocker system prune -f --filter until=168h
04:30weeklyrydelldockerjackdocker volume prune -f
04:40weeklyidorumysqlrootcd /srv/sql-dump/; /usr/local/lib/backup/bakMySQL.sh -z -i itop,kanbandb,zabbix minerals,syslog | logger -p uucp.info
05:00monthlycontinuityDNS-maintenanceroot/usr/local/sbin/dns-update.sh
07:00dailywigankanbanwww-datacd /srv/sites/www/kanban/ && ./cli cronjob &>/dev/null
17:09dailyrydellpopularity-contestroottest -x /etc/cron.daily/popularity-contest && /etc/cron.daily/popularity-contest --crond
23:00dailyidoruSSDroot/sbin/fstrim -v / 2>&1 | /usr/bin/logger -p news.info -t FStrim
23:00dailyidoruSSDroot/sbin/fstrim -v /srv/sql/ 2>&1 | /usr/bin/logger -p news.info -t FStrim
23:50dailycontinuityladyroot/usr/local/bin/deploy.sh -a lady/ops/hostconfig /etc/
23:50dailyidoruladyroot/usr/local/bin/deploy.sh -a lady/ops/hostconfig /etc/
23:50dailylaneyladyroot/usr/local/bin/deploy.sh -a lady/ops/hostconfig /etc/
23:50dailyrydellladyroot/usr/local/bin/deploy.sh -a lady/ops/hostconfig /etc/
23:50dailywiganladyroot/usr/local/bin/deploy.sh -a lady/ops/hostconfig /etc/
23:55dailycontinuityladyroot/usr/local/bin/deploy.sh -a lady/dev/shell /usr/local
23:55dailycontinuityldap-backuproot( cd /etc/ldap/bak/; /usr/local/lib/backup/bakLDAP.sh )
23:55dailyidoruladyroot/usr/local/bin/deploy.sh -a lady/dev/shell /usr/local
23:55dailylaneyladyroot/usr/local/bin/deploy.sh -a lady/dev/shell /usr/local
23:55dailyrydellladyroot/usr/local/bin/deploy.sh -a lady/dev/shell /usr/local
23:55dailywiganbinnaclewww-data/usr/bin/php /srv/sites/www/ignit/binnacle.php manager logrotate | logger -p syslog.info
23:55dailywiganladyroot/usr/local/bin/deploy.sh -a lady/dev/shell /usr/local
23:57dailycontinuityladyrootdpkg --get-selections > /etc/selections.dpkg
23:57dailyidoruladyrootdpkg --get-selections > /etc/selections.dpkg
23:57dailylaneyladyrootdpkg --get-selections > /etc/selections.dpkg
23:57dailyrydellladyrootdpkg --get-selections > /etc/selections.dpkg
23:57dailywiganladyrootdpkg --get-selections > /etc/selections.dpkg
23:59dailyrydellsysstat.dpkg-distrootcommand -v debian-sa1 > /dev/null && debian-sa1 60 2
  • lady/ops/jobs.txt
  • Last modified: 2021/06/10 21:53
  • by 127.0.0.1