CUNY Academic Commons

This is a reoccurence of this bug: https://redmine.gc.cuny.edu/issues/18235#note-1 .

In this instance, the 'stylesheet' option for the tarrelleng110.commons.gc.cuny.edu site was set to 'twentytwenty', but the 'template' option was set to 'twentytwelve'.

I just set the 'template' option back to 'twentytwenty' with the following WP-CLI command:

wp option update template twentytwenty --url=tarrelleng110.commons.gc.cuny.edu --skip-themes=twentytwenty,twentytwelve

And Tarrell's site should be back and up-and-running.

Boone, based on some clues from #18235, I looked at the past 50 failed Cavalcade logs:

mysql> select * from wp_cavalcade_jobs where status = 'failed' order by start desc limit 50;                                            
+---------+-------+--------------------------------+--------+---------------------+---------------------+----------+----------+--------+
| id      | site  | hook                           | args   | start               | nextrun             | interval | schedule | status |
+---------+-------+--------------------------------+--------+---------------------+---------------------+----------+----------+--------+
| 3183112 | 29832 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182874 | 29829 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3183140 | 29833 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3183222 | 29834 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182727 | 29822 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182731 | 29823 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182752 | 29824 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182785 | 29825 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3183046 | 29830 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3183302 | 29835 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182802 | 29826 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3183062 | 29831 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182824 | 29827 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182831 | 29828 | akismet_scheduled_delete       | a:0:{} | 2023-10-23 22:01:47 | 2023-10-23 22:01:47 |    86400 | daily    | failed |
| 3182697 |    15 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 22:04:14 | 2023-10-22 22:04:14 |    86400 | daily    | failed |
| 3182298 | 29817 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 21:54:34 | 2023-10-22 21:54:34 |    86400 | daily    | failed |
| 3182557 | 29820 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 21:54:34 | 2023-10-22 21:54:34 |    86400 | daily    | failed |
| 3182325 | 29818 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 21:54:34 | 2023-10-22 21:54:34 |    86400 | daily    | failed |
| 3182583 | 29821 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 21:54:34 | 2023-10-22 21:54:34 |    86400 | daily    | failed |
| 3182470 |   886 | akismet_scheduled_delete       | a:0:{} | 2023-10-22 12:03:44 | 2023-10-23 12:08:40 |    86400 | daily    | failed |
| 3181804 | 29816 | akismet_scheduled_delete       | a:0:{} | 2023-10-21 21:46:20 | 2023-10-21 21:46:20 |    86400 | daily    | failed |
| 3181631 | 29814 | delete_expired_transients      | a:0:{} | 2023-10-21 13:23:55 | 2023-10-21 13:23:55 |    86400 | daily    | failed |
| 3181630 | 29814 | wp_scheduled_delete            | a:0:{} | 2023-10-21 12:59:17 | 2023-10-21 12:59:17 |    86400 | daily    | failed |
| 3181629 | 29814 | wp_scheduled_auto_draft_delete | a:0:{} | 2023-10-21 01:49:28 | 2023-10-21 01:49:28 |   604800 | weekly   | failed |
| 3180903 | 29796 | wp_scheduled_auto_draft_delete | a:0:{} | 2023-10-21 01:49:28 | 2023-10-21 01:49:28 |   604800 | weekly   | failed |
| 3180182 | 29778 | wp_scheduled_auto_draft_delete | a:0:{} | 2023-10-21 01:49:28 | 2023-10-21 01:49:28 |   604800 | weekly   | failed |
| 3181610 | 29813 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:42:53 | 2023-10-20 21:42:53 |    86400 | daily    | failed |
| 3181696 | 29815 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:42:53 | 2023-10-20 21:42:53 |    86400 | daily    | failed |
| 3181209 | 29808 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:42:53 | 2023-10-20 21:42:53 |    86400 | daily    | failed |
| 3181213 | 29809 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:42:53 | 2023-10-20 21:42:53 |    86400 | daily    | failed |
| 3181503 | 29810 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:42:53 | 2023-10-20 21:42:53 |    86400 | daily    | failed |
| 3181628 | 29814 | akismet_scheduled_delete       | a:0:{} | 2023-10-20 21:14:02 | 2023-10-20 21:14:02 |    86400 | daily    | failed |
| 3180902 | 29796 | delete_expired_transients      | a:0:{} | 2023-10-20 13:20:32 | 2023-10-20 13:20:32 |    86400 | daily    | failed |
| 3180901 | 29796 | wp_scheduled_delete            | a:0:{} | 2023-10-20 12:55:54 | 2023-10-20 12:55:54 |    86400 | daily    | failed |
| 3181645 |    15 | wdev_logger_clear_logs         | a:0:{} | 2023-10-20 00:00:00 | 2023-10-22 18:06:59 |    86400 | daily    | failed |
| 3180557 | 29785 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180565 | 29786 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3181086 | 29806 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3181090 | 29807 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180600 | 29787 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180858 | 29794 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180908 | 29797 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180912 | 29798 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180916 | 29799 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180924 | 29800 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180417 | 29781 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180935 | 29801 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180463 | 29783 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180976 | 29802 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
| 3180981 | 29803 | akismet_scheduled_delete       | a:0:{} | 2023-10-19 21:36:54 | 2023-10-19 21:36:54 |    86400 | daily    | failed |
+---------+-------+--------------------------------+--------+---------------------+---------------------+----------+----------+--------+
50 rows in set (0.04 sec)                                                                                                               

And Tarrell's site is listed (site 29835). I did some further checking from this list and many of these sites have the same wrong 'template' fatal error problem. I wrote a quick WP-CLI script to fix sites affected by the wrong 'template' option:

// Pass blog IDs delimited by space. Otherwise bail.
if ( empty( $args ) ) {
    exit;
}

// This is due to wp-content/plugins/cac-bp-custom-includes/root-blog.php
// TODO: Omit the 'option_template' filter for WP-CLI
remove_all_filters( 'option_template' );

$args = array_unique( $args );

foreach ( $args as $site_id ) {
    $template   = get_blog_option( $site_id, 'template' );
    $stylesheet = get_blog_option( $site_id, 'stylesheet' );

    // Do explicit check for 'twentytwelve' template before updating 'stylesheet' option.
    if ( 'twentytwelve' === $template && 'twentytwelve' !== $stylesheet ) {
        update_blog_option( $site_id, 'template', $stylesheet );
    } else {
        echo "Did nothing for site ID {$site_id}\n";
    }
}

The majority of the sites were using the 'twentytwenty' theme for the stylesheet, while a couple were using the 'ashe' theme. Since the 'twentytwenty' theme is part of the Default Site Template and the 'ashe' theme is part of the Teaching Template, this leads me to believe that something in the site template cloning script might be causing this bug. I'm going to stop for now and will continue tomorrow.

Thanks, Ray. I saw this issue recently myself on a test site. I took a brief look at the code in cac-site-templates that's used for site cloning, and I don't see an immediate problem. But perhaps there's something else in the Commons codebase that's causing certain default settings to be set, and perhaps it's happening in a race condition with the template-cloning process. Thanks for having a closer look.

Tarrell reports that his site is fine. Thanks for the speedy fix!