Delta changes not migrated in M2

Open

#799 opened on Feb 28, 2020 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language: PHP
Stars: 339
Forks: 195
PR merge metrics: No merged PRs in 30d

Description

Hi,

M1 version is 1.9.3.0
M2 version is 2.3.4

[2020-02-28 15:32:00][INFO][mode: delta][stage: delta delivering][step: Customer Attributes Step]: started
[2020-02-28 15:32:00][INFO][mode: delta][stage: volume check][step: Customer Attributes Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity Source: 16243 Destination: 16210
[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity_int Source: 29580 Destination: 29512
[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_entity_varchar Source: 114 Destination: 115
[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_address_entity Source: 15593 Destination: 15566
[2020-02-28 15:32:00][WARNING]: Mismatch of entities in the document: customer_address_entity_varchar Source: 370 Destination: 358
[2020-02-28 15:32:00][WARNING]: Volume Check failed
[2020-02-28 15:32:00][INFO][mode: delta][stage: delta delivering][step: Map Step]: started
[2020-02-28 15:32:00][INFO][mode: delta][stage: volume check][step: Map Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity Source: 181 Destination: 180
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_datetime Source: 228 Destination: 224
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_decimal Source: 114 Destination: 112
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_int Source: 882 Destination: 873
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_text Source: 673 Destination: 660
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_entity_varchar Source: 1226 Destination: 1214
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_category_product Source: 9848 Destination: 9798
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_compare_item Source: 7516 Destination: 17
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity Source: 2521 Destination: 2513
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_datetime Source: 14701 Destination: 14643
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_decimal Source: 12353 Destination: 12307
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_int Source: 10013 Destination: 9981
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery Source: 2778 Destination: 2770
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery_value Source: 2778 Destination: 2770
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_text Source: 12374 Destination: 12328
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_entity_varchar Source: 50805 Destination: 48180
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: catalog_product_website Source: 2521 Destination: 2513
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: cataloginventory_stock_item Source: 2521 Destination: 2513
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: newsletter_subscriber Source: 897 Destination: 891
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: report_compared_product_index Source: 12583 Destination: 28
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: report_event Source: 2940413 Destination: 148365
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review Source: 80 Destination: 81
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_detail Source: 80 Destination: 81
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_entity_summary Source: 38 Destination: 39
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: review_store Source: 160 Destination: 162
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_order_tax Source: 2092 Destination: 2071
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_order_tax_item Source: 1546 Destination: 1531
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: sales_payment_transaction Source: 785 Destination: 776
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist Source: 335 Destination: 327
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist_item Source: 260 Destination: 254
[2020-02-28 15:32:02][WARNING]: Mismatch of entities in the document: wishlist_item_option Source: 268 Destination: 262
[2020-02-28 15:32:02][WARNING]: Volume Check failed
[2020-02-28 15:32:02][INFO][mode: delta][stage: delta delivering][step: Log Step]: started
[2020-02-28 15:32:02][INFO][mode: delta][stage: volume check][step: Log Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: customer_visitor Source: 20488811 Destination: 1
[2020-02-28 15:32:20][WARNING]: Volume Check failed
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: ConfigurablePrices step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: ConfigurablePrices step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: Tier Price Step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: Tier Price Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: Url Rewrite Step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: Url Rewrite Step]: started
0% [>---------------------------] Remaining Time: < 1 sec
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][WARNING]: Volume Check failed
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: OrderGrids Step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: OrderGrids Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_order_grid Source: 3408 Destination: 3375
[2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_invoice_grid Source: 1963 Destination: 1945
[2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: sales_shipment_grid Source: 1306 Destination: 1293
[2020-02-28 15:32:20][WARNING]: Volume Check failed
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: SalesIncrement Step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of order entity: Source: 4146 Destination: 4109
[2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of invoice entity: Source: 1964 Destination: 1946
[2020-02-28 15:32:20][WARNING]: Mismatch in last increment id of shipment entity: Source: 1306 Destination: 1293
[2020-02-28 15:32:20][WARNING]: Volume Check failed
[2020-02-28 15:32:20][INFO][mode: delta][stage: delta delivering][step: Inventory Step]: started
[2020-02-28 15:32:20][INFO][mode: delta][stage: volume check][step: Inventory Step]: started
100% [============================] Remaining Time: < 1 sec
[2020-02-28 15:32:20][WARNING]: Mismatch of entities in the document: inventory_source_item Source: 2513 Destination: 2511
[2020-02-28 15:32:20][WARNING]: Volume Check failed

Does not migrate data in delta.
I spend a few days and execute the delta migration to load the orders but not load them and just show me the differences.

Contributor guide

Open the contributing guide

First steps

Read the whole issue, then the project's contributing guide.
Comment on the issue to say you are picking it up — it saves two people doing the same work.
Fork the repository and make your change on a branch.
Open a pull request that references the issue number.

Research direction

Start by reproducing the delta migration from Magento 1.9.3.0 to 2.3.4 and review the volume-check output for the listed steps and entities. The issue is resolved when delta data, including orders, is migrated rather than only reported as source/destination differences.

Written by the indexing model from the issue text.

Assessment

Tech stack: php
Domain: databases
Issue type: Bug
Difficulty: 4/5
Estimated time: 3-5 days
Activity status: Quiet
Clarity: Needs clarification
Newbie friendliness: 35/100