Angel-ML / Angel-ML/PyTorch-On-Angel

[ASK] Issue ingesting libffm format for xDeepFM

Open
#131 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
173
Forks
51
PR merge metrics
No merged PRs in 30d

Description

I'm currently attempting to train xDeepFM using the libffm format.
I noticed in the code that load_svmlight_file from sklearn is used to load the text file.
While load_svmlight_file works well for to load data in the libsvm format -

**label feature1:value1 feature2:value2**

With the libffm format

**label field1:feature1:value1 field2:feature2:value2**

I get the error

**ValueError: could not convert string to float: b'0:0.11545'**

Since load_svmlight_file ultimately converts to a sparse matrix, I can also convert my data directly to a sparse matrix. However, while it is obvious what the libsvm format would look like in matrix format, it isn't obvious what the libffm format would look like.

Has anyone successfully trained a xDeepFM using this repo? Please help!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the xDeepFM data-loading path that calls scikit-learn's load_svmlight_file and review how its sparse matrix is consumed. Determine whether libffm input is supported or needs a documented conversion path; done should include a confirmed training workflow or a clearly documented limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scikit-learn
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.