elastic / elastic/ml-cpp

[ML] Regression job failed in coarse_parameter_search phase if dependent_variable field is unsigned_long

オープン
#1,601 コメント 1 件 リアクション 0 件 担当者 0 名 GitHub で見る
>bug
主要言語
C++
スター
157
フォーク
67
平均マージ
17時間 52分
マージ済み PR(30日)
20

説明

When testing `unsigned_long` data type in 7.10, DFA regression job failed in coarse_parameter_search phase if dependent_variable is `unsigned_long`,

**Error in es log:**
```
[2020-10-30T00:03:25,932][INFO ][o.e.x.m.d.p.AnalyticsProcessManager] [Weis-MacBook-Pro.local] [wine_ul] Started analyzing
[2020-10-30T00:03:25,932][INFO ][o.e.x.m.d.p.AnalyticsProcessManager] [Weis-MacBook-Pro.local] [wine_ul] Waiting for result processor to complete
[2020-10-30T00:03:26,172][INFO ][o.e.x.m.p.AbstractNativeProcess] [Weis-MacBook-Pro.local] [wine_ul] State output finished
[2020-10-30T00:03:26,172][ERROR][o.e.x.m.p.AbstractNativeProcess] [Weis-MacBook-Pro.local] [wine_ul] analytics process stopped unexpectedly:
[2020-10-30T00:03:26,173][ERROR][o.e.x.m.p.l.CppLogMessageHandler] [Weis-MacBook-Pro.local] [controller/5526] [CDetachedProcessSpawner.cc@184] Child process with PID 9510 was terminated by signal 11
[2020-10-30T00:03:26,173][ERROR][o.e.x.m.p.l.CppLogMessageHandler] [Weis-MacBook-Pro.local] [controller/5526] [CDetachedProcessSpawner.cc@99] Will not attempt to kill process 9510: not a child process
[2020-10-30T00:03:26,173][ERROR][o.e.x.m.p.l.CppLogMessageHandler] [Weis-MacBook-Pro.local] [controller/5526] [CCommandProcessor.cc@115] Failed to kill process with PID 9510 in command with ID 524
[2020-10-30T00:03:26,174][ERROR][o.e.x.m.d.p.AnalyticsProcessManager] [Weis-MacBook-Pro.local] [wine_ul] Failed to kill process
java.io.IOException: ML controller failed to execute command [524]: [Failed to kill process with PID 9510]
```

**Job configure:**
```
{
"id": "wine_ul",
"create_time": 1604030604645,
"version": "8.0.0",
"description": "",
"source": {
"index": [
"wine_ul"
],
"query": {
"match_all": {}
}
},
"dest": {
"index": "dest_wine_ul",
"results_field": "ml"
},
"analysis": {
"regression": {
"dependent_variable": "quality",
"num_top_feature_importance_values": 0,
"prediction_field_name": "quality_prediction",
"training_percent": 95,
"randomize_seed": 95,
"loss_function": "mse"
}
},
"analyzed_fields": {
"includes": [
"alcohol",
"chlorides",
"citric acid",
"density",
"fixed acidity",
"free sulfur dioxide",
"pH",
"quality",
"residual sugar",
"sulphates",
"total sulfur dioxide",
"volatile acidity"
],
"excludes": []
},
"model_memory_limit": "125mb",
"allow_lazy_start": false,
"max_num_threads": 1
}
```

dataset csv file can be found here:
[wine_quality_white_ul.csv.zip](https://github.com/elastic/ml-cpp/files/5623518/wine_quality_white_ul.csv.zip)

Step to reproduce:
- use data viz to import wine_quality_white_ul.csv file
- manual update the `quality` mapping to `unsigned_long`
- create a DFA job by using the above job configure
- Run job

コントリビューションガイド

コントリビューションガイドを開く

調査の方向性

wine_quality_white_ul.csv、提供されたジョブ設定、および unsigned_long の品質マッピングを使用して障害を再現します。まず、coarse_parameter_search フェーズと Elasticsearch ログ内のネイティブプロセスのクラッシュを調査します。dependent_variable が unsigned_long の場合に DFA 回帰ジョブが正常に完了すれば完了です。

索引モデルが issue の本文から書いたものです。

評価

技術スタック
cpp
領域
machine-learning
issue の種類
バグ
難易度
4/5
見積もり時間
3〜5日
活発さ
停滞
明瞭さ
おおむね明確
初心者へのやさしさ
35/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。