17 April 2018, 2:17

Greetings All,

I have 2 servers: one running Mahara the other Elasticsearch.

With Mahara 17.04 and Elasticseach 1.7.3 everything worked well. However since Mahara 17.10 and Elastic 5.x I have been struggle to get Elasticseach to function. Currently running Mahara 18.04 and Elasticsearch 5.6.5 The Elastic extension page in Maraha states: 404: no such index

The following commands were run from the Mahara host 192.168.0.1 against the Elasticsearch host 192.168.0.2

curl –XGET 'http://192.168.0.2:9200'
{
 "name" : "Mahara-Search-Node",
 "cluster_name" : "maharasearch",
 "cluster_uuid" : "ABCDJSksT4-bMWgx-Wv3iQ",
 "version" : {
 "number" : "5.6.5",
 "build_hash" : "6a37571",
 "build_date" : "2017-12-04T07:50:10.466Z",
 "build_snapshot" : false,
 "lucene_version" : "6.6.1"
 },
 "tagline" : "You Know, for Search"

curl -XGET '192..168.0.2:9200/_cluster/health?pretty'

{
 "cluster_name" : "maharasearch",
 "status" : "green",
 "timed_out" : false,
 "number_of_nodes" : 1,
 "number_of_data_nodes" : 1,
 "active_primary_shards" : 0,
 "active_shards" : 0,
 "relocating_shards" : 0,
 "initializing_shards" : 0,
 "unassigned_shards" : 0,
 "delayed_unassigned_shards" : 0,
 "number_of_pending_tasks" : 0,
 "number_of_in_flight_fetch" : 0,
 "task_max_waiting_in_queue_millis" : 0,
 "active_shards_percent_as_number" : 100.0
}

The following is from the Apache error logs:
(lib/cron.php:52) ---------- cron running Mon, 16 Apr 2018 06:40:01 +1200 ----------
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 16 Apr 2018 04:55:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue
(lib/cron.php:176) Running core cron user_login_tries_to_zero
(lib/mahara.php:5268) Dropping elasticsearch triggers
(lib/mahara.php:5283) Adding elasticsearch triggers back in
(lib/cron.php:176) Running core cron activity_process_queue
(lib/cron.php:176) Running core cron import_process_queue
(lib/cron.php:176) Running core cron watchlist_process_notifications
(lib/cron.php:176) Running core cron check_imap_for_bounces
(lib/cron.php:216) ---------- cron finished Mon, 16 Apr 2018 06:40:01 +1200 ----------

I'm happy to provide more logs if information if required.

17 April 2018, 12:37

Hello Greg,

Had you followed the instructions at https://git.mahara.org/mahara/mahara/blob/master/htdocs/search/elasticsearch/upgrade_elasticsearch.readme ?

Cheers

Kristina

17 April 2018, 21:13

Greetings Kristina,

Thank you for your prompt post. Unfortunately I didn't find Robert's excellent howto until after I had upgraded from Mahara 17.04 and Elasticseach 1.7.3. I did attempt to use some of the troubleshooting steps but to no avail. Since then I have completely purged Elasticsearch and rebuilt the installation on Elasticsearch 5.6.5. 

Any suggestions on best next steps?

Should I attempt to delete the mahara index and allow Mahara to recreate it?

18 April 2018, 7:51

Hello Greg,

Yes, please re-index your site. The index from the 1.7 install of Elasticsearch would not work. The site needs to be re-indexed from scratch. Best to delete the old index so it doesn't conflict.

There is a CLI script in Mahara 18.04 to do the indexing faster on large sites, but I don't think you have to worry about that: http://manual.mahara.org/en/18.04/administration/cli.html

I'll add a note about the upgrade information to the user manual.

Cheers

Kristina

27 April 2018, 1:03

Thank you for your reply Kristina.

I still seem to be having problems. As far as I can work out elasticsearch it working okay.

root@elastic:~# curl -X GET "localhost:9200/_cat/indices?v"
health status index  uuid                   pri  rep docs.count docs.deleted store.size pri.store.size
green  open   mahara jLmCWLiATfOoMh9abcdefg   2    0          0            0       382b           382b

However the cron job that pushes data to elastic seems to be stuck? 

I have attempted to clear the elastic index many times, deleting the content of /var/lib/elasticsearch/.

I have tried running the cli script to index the site but it reports that cron is running and to try again later.

No errors are reported in Mahara when I try to search but no results are returned for any searches.

Below is the apache error log. Any ideas on how I should proceed next?

(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:05:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(search/elasticsearch/lib.php:820) 2 documents to index in bulk... 
(search/elasticsearch/lib.php:1010) batches: 1; records: 2; errors: 0 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:05:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:10:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron cron_event_log_expire 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:10:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:15:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(search/elasticsearch/lib.php:820) 1 documents to index in bulk... 
(search/elasticsearch/lib.php:1010) batches: 1; records: 1; errors: 0 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:15:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:20:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(search/elasticsearch/lib.php:820) 1 documents to index in bulk... 
(search/elasticsearch/lib.php:1010) batches: 1; records: 1; errors: 0 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:20:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:25:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:25:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:30:01 1200 ---------- 
(lib/cron.php:105) Running PluginAuthSaml::auth_saml_refresh_cron 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(search/elasticsearch/lib.php:820) 1 documents to index in bulk... 
(search/elasticsearch/lib.php:1010) batches: 1; records: 1; errors: 0 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:105) Running PluginInteractionForum::interaction_forum_new_post 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:30:02 1200 ---------- 
(lib/errors.php:536) [InvalidArgumentException]: parameter must be a positive integer to create a User object 
(most recent first): 
* exception(object(InvalidArgumentException)) at Unknown:0 
 
down 
configured -- resuming normal operations 
 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:35:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:35:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:40:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:40:01 1200 ---------- 
not found or unable to stat 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:45:01 1200 ---------- 
(lib/cron.php:105) Running PluginSearchElasticsearch::cron 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:45:01 1200 ---------- 
(lib/errors.php:536) [Elasticsearch\\Common\\Exceptions\\BadRequest400Exception]: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Fielddata is disabled on text fields by default. Set fielddata=true on [mainfacetterm] in
(most recent first):, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
* exception(object(Elasticsearch\\Common\\Exceptions\\BadRequest400Exception)) at Unknown:0, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
(lib/errors.php:536) [Elasticsearch\\Common\\Exceptions\\BadRequest400Exception]: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Fielddata is disabled on text fields by default. Set fielddata=true on [mainfacetterm] in
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* exception(object(Elasticsearch\\Common\\Exceptions\\BadRequest400Exception)) at Unknown:0, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(blocktype/facebooklike/lib.php:0) Declaration of PluginBlocktypeFacebookLike::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 164), integer, true, true, string(size 44), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 164), string(size 44), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 12), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 12)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(blocktype/linkedinshare/lib.php:0) Declaration of PluginBlocktypeLinkedInShare::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 165), integer, true, true, string(size 45), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 165), string(size 45), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 13), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 13)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for usr, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for interaction_instance, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for interaction_forum_post, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for group, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for view, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for artefact, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for block_instance, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for collection, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
for event_log, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
mappings, referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
referer: https://mymaharasite.nz/admin/extensions/pluginconfig.php?plugintype=search&pluginname=elasticsearch 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:50:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:50:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Thu, 26 Apr 2018 23:55:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron cron_institution_data_daily 
(lib/cron.php:176) Running core cron cron_site_data_daily 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Thu, 26 Apr 2018 23:55:04 1200 ---------- 
(blocktype/facebooklike/lib.php:0) Declaration of PluginBlocktypeFacebookLike::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 164), integer, true, true, string(size 44), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 164), string(size 44), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 12), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 12)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(blocktype/linkedinshare/lib.php:0) Declaration of PluginBlocktypeLinkedInShare::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 165), integer, true, true, string(size 45), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 165), string(size 45), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 13), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 13)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(lib/cron.php:52) ---------- cron running Fri, 27 Apr 2018 00:00:01 1200 ---------- 
(lib/cron.php:105) Running PluginAuthLdap::auth_ldap_sync_cron 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:105) Running PluginInteractionForum::interaction_forum_new_post 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Fri, 27 Apr 2018 00:00:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Fri, 27 Apr 2018 00:05:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron auth_clean_expired_password_requests 
(lib/cron.php:176) Running core cron auth_clean_partial_registrations 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Fri, 27 Apr 2018 00:05:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Fri, 27 Apr 2018 00:10:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:216) ---------- cron finished Fri, 27 Apr 2018 00:10:01 1200 ---------- 
(blocktype/facebooklike/lib.php:0) Declaration of PluginBlocktypeFacebookLike::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 164), integer, true, true, string(size 44), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 164), string(size 44), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 12), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 12)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(blocktype/linkedinshare/lib.php:0) Declaration of PluginBlocktypeLinkedInShare::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php 
(most recent first):, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* log_message(string(size 165), integer, true, true, string(size 45), integer) at /var/www/html/lib/errors.php:521, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* error(integer, string(size 165), string(size 45), integer, array(size 11)) at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* require_once() at /var/www/html/lib/mahara.php:1621, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
* safe_require(string(size 9), string(size 13), string(size 7), string(size 12), false, null) at /var/www/html/lib/mahara.php:1653, referer: https://mymaharasite.nz/search/elasticsearch/index.php
* safe_require_plugin(string(size 9), string(size 13)) at /var/www/html/admin/extensions/plugins.php:42, referer: https://mymaharasite.nz/search/elasticsearch/index.php 
https://mymaharasite.nz/search/elasticsearch/index.php 
(lib/cron.php:52) ---------- cron running Fri, 27 Apr 2018 00:15:02 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:216) ---------- cron finished Fri, 27 Apr 2018 00:15:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Fri, 27 Apr 2018 00:20:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Thu, 26 Apr 2018 23:47:38 +1200). 
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Thu, 26 Apr 2018 07:00:01 +1200). 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:216) ---------- cron finished Fri, 27 Apr 2018 00:20:01 1200 ---------- 

27 April 2018, 7:30

Hi Greg,

The problem looks to be an issue with a plugin that is not working as expected, see this line of the error log:

(blocktype/facebooklike/lib.php:0) Declaration of PluginBlocktypeFacebookLike::instance_config_form($instance) should be compatible with PluginBlocktype::instance_config_form(BlockInstance $instance), referer: https://mymaharasite.nz/search/elasticsearch/index.php

The facebooklite plugin looks to have errors in it - it is not calling instance_config_form() with first variable being of type 'BlockInstance'.

See this patch on how we fixed up core plugins https://git.mahara.org/mahara/mahara/commit/2dbcef7de900f466ad929617541fe7dfa6f79055

As facebooklite is not a core plugin it hasn't been fixed up. It will need to be fixed up in a similar way but as I've not seen the code for the plugin I can't say if this is the only fix needed for the plugin.

Cheers

Robert

30 April 2018, 23:02

Much thanks Robert,

I have removed the FacebookLike plugin and a LinkedInShare plugin that seemed to have the same problem.

I then attempted to clean up the database following this guide https://wiki.mahara.org/index.php/Plugins/Artefact/My_Learning/Uninstalling

DELETE FROM blocktype_installed_viewtype WHERE blocktype='facebooklike';
DELETE FROM blocktype_installed_category WHERE blocktype='facebooklike';
DELETE FROM block_instance WHERE blocktype='facebooklike';
DELETE FROM blocktype_installed WHERE name='facebooklike';

DELETE FROM blocktype_installed_viewtype WHERE blocktype='linkedinshare';
DELETE FROM blocktype_installed_category WHERE blocktype='linkedinshare';
DELETE FROM block_instance WHERE blocktype='linkedinshare';
DELETE FROM blocktype_installed WHERE name='linkedinshare';

Unfortunately Elasticsearch still doesn't seem to be getting any data.

The Elasticsearch host seems to be in good health, just no data:

root@elastic:/# curl -X GET "localhost:9200/_cat/indices?v"
health   status   index      uuid                                           pri   rep   docs.count docs.deleted store.size  pri.store.size
green    open     mahara hxkMIm0BS8-S6OpYQP4-_g     2        0                    0                      0         382b               382b

Here is the Apache error log

(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:05:02 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:05:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:10:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:10:01 1200 ---------- 
down 
configured -- resuming normal operations 

(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:15:02 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:15:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:20:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:20:01 1200 ---------- 
down 
configured -- resuming normal operations 

(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:25:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:25:01 1200 ---------- 
down 
configured -- resuming normal operations 

referer: https://kiwiconnexion.nz/admin/site/options.php 
referer: https://kiwiconnexion.nz/admin/site/options.php 
for usr, referer: https://kiwiconnexion.nz/admin/site/options.php 
for interaction_instance, referer: https://kiwiconnexion.nz/admin/site/options.php 
for interaction_forum_post, referer: https://kiwiconnexion.nz/admin/site/options.php 
for group, referer: https://kiwiconnexion.nz/admin/site/options.php 
for view, referer: https://kiwiconnexion.nz/admin/site/options.php 
for artefact, referer: https://kiwiconnexion.nz/admin/site/options.php 
for block_instance, referer: https://kiwiconnexion.nz/admin/site/options.php 
for collection, referer: https://kiwiconnexion.nz/admin/site/options.php 
for event_log, referer: https://kiwiconnexion.nz/admin/site/options.php 
mappings, referer: https://kiwiconnexion.nz/admin/site/options.php 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:30:02 1200 ---------- 
(lib/cron.php:105) Running PluginAuthSaml::auth_saml_refresh_cron 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:105) Running PluginInteractionForum::interaction_forum_new_post 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:30:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:35:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:35:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:40:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:40:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:45:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:45:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:50:02 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:50:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 21:55:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 21:55:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:00:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:105) Running PluginInteractionForum::interaction_forum_new_post 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:00:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:05:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:05:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:10:02 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:10:02 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:15:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:15:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:20:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:20:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:25:01 1200 ---------- 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:25:01 1200 ---------- 
(lib/cron.php:52) ---------- cron running Mon, 30 Apr 2018 22:30:02 1200 ---------- 
(lib/cron.php:105) Running PluginAuthSaml::auth_saml_refresh_cron 
(lib/cron.php:549) Skipping long-running cron job search_elasticsearch_cron (Mon, 30 Apr 2018 00:10:01 +1200).
(lib/cron.php:549) Skipping long-running cron job blocktype_externalfeed_refresh_feeds (Mon, 30 Apr 2018 20:10:01 +1200).
(lib/cron.php:105) Running PluginInteractionForum::interaction_forum_new_post 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:105) Running PluginInteractionForum::clean_forum_notifications 
(lib/cron.php:499) setting mday to 1 
(lib/cron.php:176) Running core cron export_process_queue 
(lib/cron.php:176) Running core cron check_imap_for_bounces 
(lib/cron.php:176) Running core cron user_login_tries_to_zero 
(lib/mahara.php:5268) Dropping elasticsearch triggers 
(lib/mahara.php:5283) Adding elasticsearch triggers back in 
(lib/cron.php:176) Running core cron activity_process_queue 
(lib/cron.php:176) Running core cron import_process_queue 
(lib/cron.php:176) Running core cron watchlist_process_notifications 
(lib/cron.php:216) ---------- cron finished Mon, 30 Apr 2018 22:30:02 1200 ---------- 

I installed pgAdmin4 on my workstation and connected to the Mahara db over ssh tunnel. It's a very good tool.

Looking around I noticed that there are 2 entries in the config table that could be causing a few problems:

_cron_lock_blocktype_externalfeed_refresh_feeds 1525075801
_cron_lock_blocktype_externalfeed_refresh_feeds 1525003801

If those values are in seconds then it seems the cron lock is in place for 48 years! This seems to fit with the continued skipping in the logs above.

Is it safe to delete these rows in the config table or should I change them to more sane values or do you recommend another approach?

01 May 2018, 9:28

Hi Greg,

A couple of things you could try:

1) Remove any cron locks currently on your site. If the elasticsearch cron is locked it will not index the site.

To do this you can run this in your db:

SELECT * FROM config WHERE field LIKE '\_%';

to find the cron locks and then if happy

DELETE FROM config WHERE field LIKE '\_%';

2) Try adding/fetching some test content to your elasticsearch server via command line to make sure that is working as expected

Try adding some fake data for a Journal, eg:

curl -X PUT "localhost:9200/mahara/doc/artefact9999" -H 'Content-Type: application/json' -d '{
    "mainfacetterm" : "Text",
    "secfacetterm" : "Journal",
    "id" : "9999",
    "artefacttype" : "blog",
    "title" : "Test Journal",
    "description" : null,
    "tags" : null,
    "owner" : "1",
    "group" : null,
    "institution" : null,
    "access" : {
        "general" : "none"
    },
    "ctime" : "2018-03-09 08:45:23",
    "sort" : "test journal",
    "license" : null,
    "type" : "artefact"
}'

Then try to check for the data containing 'journal'

curl -X GET "localhost:9200/mahara/_search?q=journal&pretty=true"

Let me know if that helps

Cheers

Robert

02 May 2018, 1:34

Thank you once again Robert.

The puzzle continues....

SELECT * FROM config WHERE field LIKE '\_%';

Returns:

             field                  | value 
--------------------------------------+------------
 _cron_lock_search_elasticsearch_cron | 1525090501

So I tried to delete it.

DELETE FROM config WHERE field LIKE '\_%';

However this didn't improve the situation with data being sent to Elasticsearch from Mahara.

root@elastic:/# curl -X GET "localhost:9200/_cat/indices?v"
health   status   index   uuid                     pri   rep   docs.count docs.deleted store.size  pri.store.size
green    open     mahara  hxkMIm0BS8-S6OpYQP4-_g     2     0            0            0       382b            382b

The curl "put" on the otherhand was successful.

root@elastic:/# curl -X GET "localhost:9200/_cat/indices?v"
health   status   index   uuid                     pri   rep   docs.count docs.deleted store.size  pri.store.size
green    open     mahara  U8OW_piKRAa4gKy371aBMQ     2     0            1            0      6.3kb           6.3kb

Yay some data! It looks like we can send data from the Mahara server to the Elasticsearch and retrieve it. So what is stoppping Mahara sending data?

Your thoughts?