Project

General

Profile

Actions
Copy link

Feature #10786

closed

Cavalcade job and log cleanup

Added by Boone Gorges almost 6 years ago. Updated almost 6 years ago.

Status:
Resolved
Priority name:
Normal
Assignee:
Boone Gorges
Category name:
Cavalcade
Target version:
1.14.3
Start date:
2018-12-05
Due date:
% Done:

0%

Estimated time:
Deployment actions:

Description

The cavalcade MySQL tables get very large over time, which I think contributes somewhat to performance issues. They can use periodic cleanup.

1. wp_cavalcade_logs should be purged occasionally. There's no reason to have hot storage of more than a few weeks' worth of logs. I'm currently doing it manually every couple weeks (export table, then delete everything except the last few weeks).

2. wp_cavalcade_jobs collects many jobs in the 'completed' or 'failed' status. There's generally no reason to keep these (except for debugging) and we should delete them on at least a weekly basis. https://github.com/humanmade/Cavalcade/issues/72

These tasks are easily performed via wp cli, which we could then rig up to a cron job.

Files

Download all files
cavalcade-jobs-rotate.sh (403 Bytes) cavalcade-jobs-rotate.sh Boone Gorges, 2018-12-13 11:30 AM
cavalcade-logs-rotate.sh (397 Bytes) cavalcade-logs-rotate.sh Boone Gorges, 2018-12-13 11:30 AM
Actions
Copy link
 #1

Updated by Boone Gorges almost 6 years ago

I decided to tackle this earlier, since it's not tied to a specific release. The two scripts are attached. They're set to run early on Sunday mornings. I'll confirm that the cron jobs are running correctly on Monday. Backups are in /home/GC/bgorges/cavalcade-backups, should we ever need them. I'll manually purge this directory once a year or so.

Actions
Copy link

Also available in: Atom PDF