SITE 2 SITE SYNC TRANSFER NOTES

Transcription

1 SITE 2 SITE SYNC TRANSFER NOTES COUPLE SUPER IMPORTANT THINGS TO NOTE WHEN DOING TRANSFERS Some Considerations For doing the transfer / things to keep in mind - Magento 1 and Magento 2 Data is different. Things have changed drastically between the two systems so it should always be considered when doing transfers - Manually Effort is involved when doing the data transfer. It is impossible to move all data without some human interaction to the data export files prior to import. - FYI in this example all previous products were removed and existing attributes/attribute sets were kept and then "updated" as mentioned below. But in theory a new import of both would work exactly the same. UPDATING of existing products COULD be problematic if configurable relations have changed in Magento 1 vs. Magento 2 so it's best to wipe all existing products and re-import.. unless you're sure of relation changes. 1.) ORDER OF DATA TRANSFER MATTERS!!.. i Recommend moving data in the following order: export/import customers export/import orders export/import attributes export/import categories export/import products export/import customer reviews and there rest any order is fine e.g cms pages static blocks search terms coupon codes etc 2.) NEVER EVER TRANSFER CORE ATTRIBUTES OR 3rd party ATTRIBUTES from one install to another.. exports from m1 shouldn't contain them if they are exported with site 2 site.. but never the less sometimes installs changes or settings or values are changed so they could end up in the export. Its best to remove core attributes so things like (name,description,price,weight) etc.. anything magento has out of box cause on import if it matches which it will it will update and alot of times between versions of Magento the settings are different and changing them could result in undesired results. Also DO NOT move 3rd party attributes 1/2 the time they are setup specific to the developer of the extension and export/imports don't cover all of that data. Additionally its always best to let the extension re-create them on the new install as values and settings changes so no need to transfer these.. installing the 3rd party extension would cover it. User Guide Page 1

2 PRODUCT ATTRIBUTE DATA TRANSFER - STEP 1 - Export Product Attributes from Magento 1. You can find the attribute export profile by login into Magento 1 admin panel and navigating to system -> import/export -> dataflow - advanced profiles and clicking on the one labeled " - Advanced Product Attributes Export". Once export is complete download file to your computer aka export_bulk_product_attributes.csv NOTES: - settings here are saved from previous export and shouldn't need to be changed unless you want a setting different for a reason I'm aware of at the time of this documentation. - to Run Export click on "Run Profile" and then the orange button "Run Profile in Popup". PRODUCT ATTRIBUTE DATA TRANSFER - STEP 2 Once you have the attribute export file. I recommend using openoffice.org Calc tool it's a free download here and more info about calc here Once you open it make sure the Character set is "Unicode (UTF-8)" and column type is text and the area is highlighted like the screenshot below. User Guide Page 2

3 PRODUCT ATTRIBUTE DATA TRANSFER - STEP 3 Now that the file is open it time to remove ALL of the attributes we DO NOT want to import. The types of attributes you DO NOT want to import are the following: 1.) ANY attribute that was created by a 3rd party extension. Some examples would be "groupscatalog2_groups" or "mailchimp_sync_delta" or "wts_gc_additional_prices" as a couple of many possible examples 2.) ANY core Magento attribute that was created by Magento out of the box. Some examples are but not limited too are the following: "cost","contry_of_manufacture","created_at","custom_design","custom_design_from","custom_design_to" and the reason for BOTH is because even between versions in Magento 1 as well as Magento 2 there are additional values and settings related to these attributes that can change and transferring this old data to a new system where values are different could cause the site to break and/or malfunction or act oddly. So its super important to User Guide Page 3

4 read the above and really know what attributes you are importing into the installation. I recommend a taking a back up if you are unsure. (below in the screenshot I'm selection attributes for deletion) User Guide Page 4

5 PRODUCT ATTRIBUTE DATA TRANSFER - STEP 4 After removing all attributes you do NOT want to transfer/import into the new Magento system. Take a double check to make sure all attributes are ones you want to import. The below is the following I choose for import. User Guide Page 5

6 PRODUCT ATTRIBUTE DATA TRANSFER - STEP 5 Now that we have the correct amount of attributes in our file we then need to convert the Magento 1 attribute file into a file that can import into Magento 2. The reason for this is because in Magento 2 they introduced several NEW attribute setting options that we didn't previously have in Magento 1 and so we need to set values for these on import. I added the following 6 attributes to my csv file here in the highlighted area in the screenshot below. "is_filterable_in_grid" "search_weight" "is_visible_in_grid" "additional_data" "is_required_in_admin_store" "sort_order" User Guide Page 6

7 when complete it looked like this. Since i didn't previously have settings for these values i set them to 0 which means NO... and the ones that are blank don't require any value so that is fine for those to be blank. Next i found column "used_in_product_listing" and copied it and added a new column and named it "is_used_in_grid" and copied those settings to that column. These 2 settings have different meanings in Magento but are kind of similar in nature so i set them to be the same. Of course if you want different results your free to adjust use 0 = no and 1 = yes. User Guide Page 7

8 And finally we need to add 2 additional columns here like screenshot below. "is_used_for_price_rules" "is_wysiwyg_enabled" And both have the value of 1 for all rows. Once complete you can save this file and name it import_attributes.csv and it is ready for import into the Magento 2 system. User Guide Page 8

9 PRODUCT ATTRIBUTE DATA TRANSFER - STEP 6 Now that your file is ready for import you can login to magento 2 admin and navigate to this page by going to system -> Import/Export Product Attributes. All settings shown here are default and unless a known reason is needed to change them they can be kept as-is. Just select the import_attributes.csv file you just saved and click "Import Product Attributes" User Guide Page 9

10 If everything was done correctly you will get the following page within 30seconds or less. User Guide Page 10

11 PRODUCT DATA TRANSFER - STEP 1 Now that we have successfully transferred all attributes / attribute sets and related attribute value/options data we can now transfer the products. Because of the way your data is in your Magento 1 install a export of ALL product data at once isn't possible because the ORDER in the export CSV matters for import. For example on import we can't create a configurable product with the related simple products if those related simple products DO NOT YET EXIST right?? so that's the main issue is the export has data all over the place.. so if we tried to do that you would have incomplete and incorrect configurable products.. So the solution is to do 2 different exports one for simple and one for configurable. - export ALL simples products FIRST like below User Guide Page 11

12 And then make sure the export range is (increase this if you have more than 9000 simple products but at the time of this documentation is was roughly 7760) Then once settings on the product export are correct you can run the export. I used the file name export_products_simples.csv to keep things easy to remember file wise. Then once export is complete (for me it took 15-20minutes). Download the file User Guide Page 12

13 PRODUCT DATA TRANSFER - STEP 2 Once you have downloaded the exported product file to your computer and then login to Magento 2 admin. Then navigate to system -> import/export Products Select the file for upload and then on next screen only setting to change here is Import Images By URL set to "YES" and then select the file you uploaded in my example it is "export_products_simples.csv" and click run User Guide Page 13

14 (in the screenshot below the import is running. For me it took several hours to download images for and import 7775 products) User Guide Page 14

15 PRODUCT DATA TRANSFER - STEP 3 Once ALL simple products are loaded then you can export ALL configurable products FIRST like below And then make sure the export range is (increase this if you have more than 9000 configurable products but at the time of this documentation is was roughly 330 and i just left it at the 9000 from the simple export cause i was lazy and it doesn't matter). Once complete download this file also User Guide Page 15

16 PRODUCT DATA TRANSFER - STEP 4 Once you have downloaded the exported configurable products file to your computer, login to Magento 2 admin. Then navigate to system -> import/export Products Select the file for upload and then on next screen only setting to change here is Import Images By Url set to "YES" select the file you uploaded in my example it is "export_products_configurables.csv" and click run User Guide Page 16

17 FYI it also took a couple hours to import configurable products as some of them had 8-10 images to download per product and then build associations so while a small amount of products ALOT of data and resources being used. User Guide Page 17

18 Now for export setting RECOMMENDATIONS export customers - export with customer_id (optional but i like to keep customer_id the same seems alot of 3rd party extensions use this like rewards points and subscription models as well as erp systems and things like cms tools etc) - export multi addresss = true export orders - export product pricing = true (fyi this is important. Setting this to true is giving us all historical pricing and product information. This is espically important because product catalog data can change. So information about a product or the product price or even the type of product (simple/configurable/grouped etc) can change.. so if this is false you just get the sku/qty and on import it will want to check that agaisnt the live catalog on the import site and when that data does NOT match which is likely on historical orders from 5 years ago that order would error/skip. So by setting this to true we get all historical data and on import we set skip product lookup = true and it will import orders with all the same data that exists at the time of that order NOT what is current in the product catalog export historical tax = true same concept as above FYI i also usually export in a date range usually by year or less depending on amount of data.. as the files can grow easily 20-30meg or higher.. i find its easier to manager when i break them down export attributes one important thing to note here is that magento 1 attribute settings and magento 2 attribute settings are different. There is 8 new fields in the DB in magento 2 that didn't exist in magento 1. As a result a magento 1 export WILL NOT import as-is into magento 2.. you MUST modify it see below for instructions. When exporting from magento 1.0 you will be missing some columns/data needed for 2.0. Columns from a m1 export to REMOVE User Guide Page 18

19 is_configurable Columns for m2 import to ADD is_used_for_price_rules is_used_for_promo_rules sort_order is_visible_in_grid is_filterable_in_grid search_weight additional_data is_required_in_admin_store Columns for m2 to CONVERT (aka highlight entire column and copy it. e.g. keep is_html_allowed_on_front but copy and call it also is_wysiwyg_enabled) is_html_allowed_on_front TO is_wysiwyg_enabled used_in_product_listing TO is_used_in_grid export categories - CHECK your category names if any name has / in it.. you need to use another delimiter my go to is ^ - Export Categories for Transfer = true (this just adds category_id / name column to the export.. i like to keep my category ids the same so when i export products it just gives me category_ids.. and they match up. This is espically important when dealing with a multi root catalog category setup as matching by category paths is NOT possible) - DO NOT export with products for categories.. we assign products to categories during product IMPORT...this = yes and importing before products exist will error - export with HTTP urls also. So when importing category images get transferred export products - export with HTTP urls for images here also.. "Export Full Image URL Paths: true" User Guide Page 19

20 And notes on importing Good news here is since we get the correct settings on export and changes some of the data prior to import it usually goes pretty good. See below on notes import customers - auto create customer groups = yes - insert customer id = yes - import multiple customer address = yes import orders - create invoices = yes - create shipments = yes - skip product lookup = yes import attributes - should just go as-is import categories - if you changed category delimiter make sure you adjust here - import images by url = yes (make sure media/import exists on m1 and pub/media/import exists on m2) import products - import images by url = yes (make sure media/import exists on m1 and pub/media/import exists on m2) User Guide Page 20

21 and that's it.. data should move.. some side notes about things ive run into in the past.. - ALOT of m1 data is not validated well and magento2 is very strict so you will get ALOT of errors possibly depending on how old your magento1 was and where that data came from prior..so for example anyone who was on oscommerce and migrated to magento 1 that is know moving to magento 2 would almost CERTAINLY have alot of issues data wise.. so magento 2 will fail on things like bad my @something.con vs.com or even so much as a space at the end "my @something.com ".. magento 2 is TLD validating every .. so the typos in the DB that previous system and in some cases older magento 1 installs allowed are now problematic on import. You should either scrub this data or adjust it accordingly. This can be the case for customer data and address data mismatch of countries or states.. using abbv like FL vs Florida.. etc.. so if your getting errors on import its likley due to this kind of problem and i would encourage a stronger look at your own data. User Guide Page 21