Migration from 1.8.1.0 stuck at map step step: table: catalog_product_entity_varchar]:

Open

#818 opened on May 28, 2020 16 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language: PHP
Stars: 339
Forks: 195
PR merge metrics: No merged PRs in 30d

Description

### Preconditions

1. Migration from Magento 1.8.1.0 to Magento 2.3.3 and 2.3.5(both have same error)
2. tried #812 it was related to that. but m1 table "catalog_product_entity_varchar " has thousands of more Value as **NULL**

### Steps to reproduce

1. Data Migration -> Map Step

### Expected result

1. it should avoid all issues and complete the migration

### Actual result

1. `[2020-05-28 08:38:58][INFO][mode: data][stage: data migration][step: Map Step]: started
[2020-05-28 08:39:01][DEBUG][mode: data][stage: data migration][step: Map Step][table: adminnotification_inbox]: migrating
[2020-05-28 08:39:13][DEBUG][mode: data][stage: data migration][step: Map Step][table: captcha_log]: migrating
[2020-05-28 08:39:16][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_entity]: migrating
[2020-05-28 08:39:18][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_entity_datetime]: migrating
[2020-05-28 08:39:20][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_entity_decimal]: migrating
[2020-05-28 08:39:23][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_entity_int]: migrating
[2020-05-28 08:39:25][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_entity_text]: migrating
[2020-05-28 08:39:34][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_product]: migrating
[2020-05-28 08:39:40][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_category_product_index]: migrating
[2020-05-28 08:40:08][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_compare_item]: migrating
[2020-05-28 08:40:11][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_bundle_option]: migrating
[2020-05-28 08:40:13][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_bundle_option_value]: migrating
[2020-05-28 08:40:15][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_bundle_selection]: migrating
[2020-05-28 08:40:17][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_bundle_selection_price]: migrating
[2020-05-28 08:40:19][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity]: migrating
[2020-05-28 08:40:28][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_datetime]: migrating
[2020-05-28 08:40:37][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_decimal]: migrating
[2020-05-28 08:40:53][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_gallery]: migrating
[2020-05-28 08:40:55][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_int]: migrating
[2020-05-28 08:41:55][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_media_gallery]: migrating
[2020-05-28 08:42:13][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_text]: migrating
[2020-05-28 08:42:24][DEBUG][mode: data][stage: data migration][step: Map Step][table: catalog_product_entity_varchar]: migrating`

### Additional notes
this is not completing migration at all.

Hope @victor-v-rad can help

Thanks

Contributor guide

Open the contributing guide

First steps

Read the whole issue, then the project's contributing guide.
Comment on the issue to say you are picking it up — it saves two people doing the same work.
Fork the repository and make your change on a branch.
Open a pull request that references the issue number.

Research direction

Start with the Data Migration -> Map Step and reproduce the migration using the stated Magento versions, watching the log around catalog_product_entity_varchar. Investigate why the step does not complete when the Magento 1 table contains NULL values. Done means the migration completes past this table without losing valid data.

Written by the indexing model from the issue text.

Assessment

Tech stack: php
Domain: data-engineering, databases
Issue type: Bug
Difficulty: 4/5
Estimated time: 3-5 days
Activity status: Stale
Clarity: Needs clarification
Newbie friendliness: 25/100