Embedded Elasticsearch 6.5 does not connect to Kibana

• Type: Regression Bug
• Status: Closed
• Resolution: Fixed
• Affects Version/s: 7.1.X, Master
• Fix Version/s: 7.0.0 DXP FP80, 7.0.10.11 DXP SP11, 7.0.X, 7.1.10 DXP FP5, 7.1.10.1 SP1, 7.1.X, 7.2.0 GA1
• Component/s: Search Infrastructure > Elasticsearch Connector
• Labels:
  • QA-FP
  • liferay-connector-to-Elasticsearch-6-1.1.0
  • liferay-dxp-70-sp11
  • liferay-dxp-71-sp1
  • liferay-fixpack-de-80-7010
  • liferay-fixpack-dxp-5-7110
  • search-dec18
• Branch Version/s:
  7.1.x, 7.0.x
• Fix Priority: 4
• Epic Link: Elasticsearch 6.5 upgrade
• Sprint: Search | S02 Sprint 8
• Git Pull Request: https://github.com/brianchandotcom/liferay-portal/pull/65676

Solution

The OSS version of Kibana is compatible with Embedded Elasticsearch 6.5. It can be downloaded here - https://www.elastic.co/downloads/kibana-oss

Liferay documentation will be available here - https://dev.liferay.com/en/discover/deployment/-/knowledge_base/7-1/configuring-elasticsearch-for-liferay-0#embedded-vs-remote-operation-mode

 

Steps to Reproduce

1. Start up portal with embedded elasticsearch
2. Start up a kibana server to connect to the embedded elastic node

Expected Results
Kibana server would connect successfully

Actual Results
Kibana server does not connect and kibana logs show warnings and errors related to X-Pack

  log   [17:44:28.464] [warning][license][xpack] License information from the X-Pack plugin could not be obtained from Elasticsearch for the [data] cluster. [invalid_index_name_exception] Invalid index name [_xpack], must not start with '_'., with { index_uuid="_na_" & index="_xpack" } :: {"path":"/_xpack","statusCode":400,"response":"{\"error\":{\"root_cause\":[{\"type\":\"invalid_index_name_exception\",\"reason\":\"Invalid index name [_xpack], must not start with '_'.\",\"index_uuid\":\"_na_\",\"index\":\"_xpack\"}],\"type\":\"invalid_index_name_exception\",\"reason\":\"Invalid index name [_xpack], must not start with '_'.\",\"index_uuid\":\"_na_\",\"index\":\"_xpack\"},\"status\":400}"}
  log   [17:44:28.465] [error][status][plugin:xpack_main@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.466] [error][status][plugin:searchprofiler@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.466] [error][status][plugin:ml@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.466] [error][status][plugin:tilemap@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.467] [error][status][plugin:watcher@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.467] [error][status][plugin:index_management@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.467] [error][status][plugin:rollup@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.468] [error][status][plugin:graph@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.468] [error][status][plugin:spaces@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.469] [error][status][plugin:security@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.469] [error][status][plugin:grokdebugger@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.469] [error][status][plugin:logstash@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.470] [error][status][plugin:beats_management@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.
  log   [17:44:28.470] [error][status][plugin:reporting@6.5.0] Status changed from yellow to red - X-Pack plugin is not installed on the [data] Elasticsearch cluster.

Reproduced on master - 8c57e44