Migrate Work items Not Teams #2547

jeffpriz · 2024-12-03T18:08:55Z

jeffpriz
Dec 3, 2024

I am attempting to upgrade to use a version 16 config instead of a 15.2..
I've got a Work Item Migration configured to migrate a set of work items, however it's erroring as:

{"Timestamp":"2024-12-03T11:55:58.5226939-06:00","Level":"Fatal","MessageTemplate":"Error while running {MigrationContextname}","TraceId":"48645ea5c2ba2f8aef9da05e9c65865c","SpanId":"ae3134754740deec","Exception":"System.Web.Services.Protocols.SoapException: TF400493: A team iteration cannot be created for a tree node that is not an iteration node.\r\n at

I see this in the log
[11:55:57 INF] [16.0.8] Migrating all Teams before the Processor run.
[11:55:57 INF] [16.0.8] TfsTeamSettingsProcessor::InternalExecute: Found 8 teams in Source?
[11:55:58 INF] [16.0.8] -> Settings found for team 'Team123'..
[11:55:58 FTL] [16.0.8] Error while running TfsWorkItemMigrationProcessor

How can I make this NOT try to migrate the teams? I've got the teams configured in the target, and have area paths/iteration paths mapped so things land where I want them, I don't want this to do anything more than move the items I've selected in my query. I have configured a TfsWorkItemMigrationProcessor but have not configured a TfsTeamSettingsProcessorOptions so I am confused as to why it's trying to "Migrate all Teams".

Answered by MrHinsh

Dec 4, 2024

The default behaviour is that the TfsTeamSettingsTool runs to migrate teams.

All of the Tools can be disabled with:

{
  "MigrationTools": {
    "Version": "16.0",
    "CommonTools": {
      "TfsTeamSettingsTool": {
        "Enabled": "False",
      }
    }
  }
}

View full answer

MrHinsh · 2024-12-04T10:28:57Z

MrHinsh
Dec 4, 2024
Maintainer

The default behaviour is that the TfsTeamSettingsTool runs to migrate teams.

All of the Tools can be disabled with:

{
  "MigrationTools": {
    "Version": "16.0",
    "CommonTools": {
      "TfsTeamSettingsTool": {
        "Enabled": "False",
      }
    }
  }
}

2 replies

jeffpriz Dec 4, 2024
Author

Thanks @MrHinsh will go apply that. I will double check the docs to ensure I understand what other tools now are set to Opt-Out instead of Opt-in through the configuration ... and I thank you tremendously for all the work you do for this community and tool, but fwiw I am yet not sure I am a fan of Opt-Out through the configuration vs. the Opt-In in the previous version of the tool. I might need to think about situations where that makes sense, but coming from the previous Opt-in method i am feeling confused :D

MrHinsh Dec 4, 2024
Maintainer

The dificulty @jeffpriz is that many of the users do not have an understanding of ADO and can easily mess things up. Ive set defaults for things as they arise to minimise issues... I'm happy to have different options. All of the default and samples are listed in the appsettings.json file!

If its a node it will load as below then apply the provided config over the top... if its a list it will load the default... e.g. MigrationTools:EndpointDefaults:TfsEndpoint then the specific config... samples are only for the docs...

{
  "Serilog": {
    "Using": [
      "Serilog.Sinks.Console"
    ],
    "MinimumLevel": {
      "Default": "Information",
      "Override": {
        "Microsoft": "Warning",
        "Microsoft.Hosting.Lifetime": "Verbose"
      }
    }
  },
  "MigrationTools": {
    "EndpointDefaults": {
      "TfsEndpoint": {
        "Collection": "",
        "Project": "",
        "AllowCrossProjectLinking": false,
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "Authentication": {
          "AuthenticationMode": "AccessToken",
          "AccessToken": "",
          "NetworkCredentials": {
            "UserName": "",
            "Password": "",
            "Domain": ""
          }
        },
        "AuthenticationMode": "AccessToken",
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        }
      },
      "TfsTeamProjectEndpoint": {
        "Collection": "",
        "Project": "",
        "AllowCrossProjectLinking": false,
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "Authentication": {
          "AuthenticationMode": "AccessToken",
          "AccessToken": "",
          "NetworkCredentials": {
            "UserName": "",
            "Password": "",
            "Domain": ""
          }
        },
        "AuthenticationMode": "AccessToken",
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        }
      }
    },
    "EndpointSamples": {
      "TfsTeamProjectEndpoint": {
        "Collection": "https://dev.azure.com/nkdagility-preview/",
        "Project": "migrationSource1",
        "AllowCrossProjectLinking": false,
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "Authentication": {
          "AuthenticationMode": "AccessToken",
          "AccessToken": "jklsadhjksahfkjsdhjksahsadjhksadhsad",
          "NetworkCredentials": {
            "UserName": "",
            "Password": "",
            "Domain": ""
          }
        }
      },
      "TfsEndpoint": {
        "Collection": "https://dev.azure.com/nkdagility-preview/",
        "Project": "migrationSource1",
        "AllowCrossProjectLinking": false,
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "Authentication": {
          "AuthenticationMode": "AccessToken",
          "AccessToken": "jklsadhjksahfkjsdhjksahsadjhksadhsad",
          "NetworkCredentials": {
            "UserName": "",
            "Password": "",
            "Domain": ""
          }
        },
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        }
      },
      "AzureDevOpsEndpoint": {
        "AuthenticationMode": "AccessToken",
        "AccessToken": "jklsadhjksahfkjsdhjksahsadjhksadhsad",
        "Organisation": "https://dev.azure.com/xxx/",
        "Project": "myProject",
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId"
      }
    },
    "CommonTools": {
      "FieldMappingTool": {
        "Enabled": false,
        "FieldMaps": [],
        "FieldMapDefaults": {
          "ApplyTo": [ "*" ]
        }
      },
      "TfsChangeSetMappingTool": {
        "Enabled": false,
        "File": null
      },
      "TfsNodeStructureTool": {
        "Enabled": true,
        "Areas": {
          "Filters": [],
          "Mappings": {
          }
        },
        "Iterations": {
          "Filters": [],
          "Mappings": {
          }
        },
        "ShouldCreateMissingRevisionPaths": true,
        "ReplicateAllExistingNodes": true
      },
      "TfsTeamSettingsTool": {
        "Enabled": true,
        "MigrateTeamSettings": true,
        "UpdateTeamSettings": true,
        "MigrateTeamCapacities": true,
        "Teams": []
      },
      "TfsWorkItemLinkTool": {
        "Enabled": true,
        "FilterIfLinkCountMatches": true,
        "SaveAfterEachLinkIsAdded": false
      },
      "TfsRevisionManagerTool": {
        "Enabled": true,
        "ReplayRevisions": true,
        "MaxRevisions": 0
      },
      "TfsAttachmentTool": {
        "RefName": "TfsAttachmentTool",
        "Enabled": true,
        "ExportBasePath": "c:\\temp\\WorkItemAttachmentExport",
        "MaxAttachmentSize": 480000000
      },
      "StringManipulatorTool": {
        "Enabled": true,
        "MaxStringLength": 1000000,
        "Manipulators": []
      },
      "TfsUserMappingTool": {
        "Enabled": false,
        "UserMappingFile": "C:\\temp\\userExport.json",
        "IdentityFieldsToCheck": [
          "System.AssignedTo",
          "System.ChangedBy",
          "System.CreatedBy",
          "Microsoft.VSTS.Common.ActivatedBy",
          "Microsoft.VSTS.Common.ResolvedBy",
          "Microsoft.VSTS.Common.ClosedBy"
        ]
      },
      "WorkItemTypeMappingTool": {
        "Enabled": false,
        "Mappings": {
          "Source Work Item Type Name": "Target Work Item Type Name"
        }
      },
      "TfsWorkItemEmbededLinkTool": {
        "Enabled": true
      },
      "TfsEmbededImagesTool": {
        "Enabled": true
      },
      "TfsGitRepositoryTool": {
        "Enabled": true,
        "Mappings": {
        }
      }
    },
    "CommonToolSamples": {
      "TfsGitRepositoryTool": {
        "Enabled": true,
        "Mappings": {
          "RepoInSource": "RepoInTarget"
        }
      },
      "FieldMappingTool": {
        "Enabled": true,
        "FieldMaps": [
          {
            "FieldMapType": "FieldMergeMap",
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceFields": [ "Custom.FieldA", "Custom.FieldB" ],
            "targetField": "Custom.FieldC",
            "formatExpression": "{0} \n {1}"
          },
          {
            "FieldMapType": "FieldValueMap",
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "System.State",
            "targetField": "System.State",
            "defaultValue": "New",
            "valueMapping": {
              "Active": "InProgress",
              "Resolved": "InProgress",
              "Closed": "Done"
            }
          },
          {
            "FieldMapType": "FieldToFieldMap",
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "Microsoft.VSTS.Common.BacklogPriority",
            "targetField": "Microsoft.VSTS.Common.StackRank",
            "defaultValue": 42
          }
        ],
        "FieldMapSamples": {
          "FieldClearMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "targetField": "Custom.FieldC"
          },
          "FieldMergeMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceFields": [ "Custom.FieldA", "Custom.FieldB" ],
            "targetField": "Custom.FieldC",
            "formatExpression": "{0} \n {1}"
          },
          "FieldLiteralMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "targetField": "Custom.SomeField",
            "value": "New field value"
          },
          "MultiValueConditionalMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceFieldsAndValues": {
              "Field1": "Value1",
              "Field2": "Value2"
            },
            "targetFieldsAndValues": {
              "Field1": "Value1",
              "Field2": "Value2"
            }
          },
          "targetFieldsAndValues": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "targetField": "Custom.ReflectedWorkItemId"
          },
          "FieldValueMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "System.State",
            "targetField": "System.State",
            "defaultValue": "StateB",
            "valueMapping": {
              "StateA": "StateB"
            }
          },
          "FieldToFieldMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "Microsoft.VSTS.Common.BacklogPriority",
            "targetField": "Microsoft.VSTS.Common.StackRank",
            "defaultValue": 42
          },
          "FieldToFieldMultiMap": {
            "ApplyTo": [ "SomeWorkItemType", "SomeOtherWorkItemType" ],
            "SourceToTargetMappings": {
              "SourceField1": "TargetField1",
              "SourceField2": "TargetField2"
            }
          },
          "FieldToTagMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "System.State",
            "formatExpression": "ScrumState:{0}"
          },
          "FieldToTagFieldMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceFields": [
              "System.Description",
              "Microsoft.VSTS.Common.AcceptanceCriteria"
            ],
            "targetField": "System.Description",
            "formatExpression": "{0} <br/><br/><h3>Acceptance Criteria</h3>{1}"
          },
          "RegexFieldMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "COMPANY.PRODUCT.Release",
            "targetField": "COMPANY.DEVISION.MinorReleaseVersion",
            "pattern": "PRODUCT \\d{4}.(\\d{1})",
            "replacement": "$1"
          },
          "FieldValueToTagMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "sourceField": "Microsoft.VSTS.CMMI.Blocked",
            "pattern": "Yes",
            "formatExpression": "{0}"
          },
          "TreeToTagMap": {
            "ApplyTo": [ "SomeWorkItemType" ],
            "toSkip": 3,
            "timeTravel": 1
          }
        }
      },
      "TfsChangeSetMappingTool": {
        "Enabled": true,
        "File": "c:\\changesetmappings.json"
      },
      "TfsNodeStructureTool": {
        "Enabled": true,
        "Areas": {
          "Filters": [ "*\\Team 1,*\\Team 1\\**" ],
          "Mappings": {
            "^migrationSource1([\\\\]?.*)$": "MigrationTest5$1",
            "^Skypoint Cloud([\\\\]?.*)$": "MigrationTest5$1",
            "^7473924d-c47f-4089-8f5c-077c728b576e([\\\\]?.*)$": "MigrationTest5$1"
          }
        },
        "Iterations": {
          "Filters": [ "*\\Sprint*", "*\\Sprint*\\**" ],
          "Mappings": {
            "^migrationSource1([\\\\]?.*)$": "MigrationTest5$1",
            "^Skypoint Cloud([\\\\]?.*)$": "MigrationTest5$1",
            "^7473924d-c47f-4089-8f5c-077c728b576e([\\\\]?.*)$": "MigrationTest5$1"
          }
        },
        "ShouldCreateMissingRevisionPaths": true,
        "ReplicateAllExistingNodes": true
      },
      "TfsTeamSettingsTool": {
        "Enabled": true,
        "MigrateTeamSettings": true,
        "UpdateTeamSettings": true,
        "MigrateTeamCapacities": true,
        "Teams": [ "Team 1", "Team 2" ]
      },
      "TfsWorkItemLinkTool": {
        "Enabled": true,
        "FilterIfLinkCountMatches": true,
        "SaveAfterEachLinkIsAdded": false
      },
      "TfsRevisionManagerTool": {
        "Enabled": true,
        "ReplayRevisions": true,
        "MaxRevisions": 0
      },
      "TfsAttachmentTool": {
        "RefName": "TfsAttachmentTool",
        "Enabled": true,
        "ExportBasePath": "c:\\temp\\WorkItemAttachmentExport",
        "MaxAttachmentSize": 480000000
      },
      "StringManipulatorTool": {
        "Enabled": true,
        "MaxStringLength": 1000000,
        "Manipulators": [
          {
            "$type": "RegexStringManipulator",
            "Enabled": true,
            "Pattern": "[^( -~)\n\r\t]+",
            "Replacement": "",
            "Description": "Remove invalid characters from the end of the string"
          }
        ]
      },
      "TfsUserMappingTool": {
        "Enabled": true,
        "UserMappingFile": "C:\\temp\\userExport.json",
        "IdentityFieldsToCheck": [
          "System.AssignedTo",
          "System.ChangedBy",
          "System.CreatedBy",
          "Microsoft.VSTS.Common.ActivatedBy",
          "Microsoft.VSTS.Common.ResolvedBy",
          "Microsoft.VSTS.Common.ClosedBy"
        ]
      },
      "WorkItemTypeMappingTool": {
        "Enabled": true,
        "Mappings": {
          "User Story": "Product Backlog Item"
        }
      },
      "TfsWorkItemEmbededLinkTool": {
        "Enabled": true
      },
      "TfsEmbededImagesTool": {
        "Enabled": true
      }
    },
    "ProcessorDefaults": {
      "AzureDevOpsPipelineProcessor": {
        "Enabled": false,
        "MigrateBuildPipelines": true,
        "MigrateReleasePipelines": true,
        "MigrateTaskGroups": true,
        "MigrateVariableGroups": true,
        "MigrateServiceConnections": true,
        "BuildPipelines": null,
        "ReleasePipelines": null,
        "SourceName": "sourceName",
        "TargetName": "targetName"
      },
      "TfsWorkItemMigrationProcessor": {
        "Enabled": false,
        "UpdateCreatedDate": true,
        "UpdateCreatedBy": true,
        "WIQLQuery": "SELECT [System.Id] FROM WorkItems WHERE [System.TeamProject] = @TeamProject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan','Shared Steps','Shared Parameter','Feedback Request') ORDER BY [System.ChangedDate] desc",
        "FixHtmlAttachmentLinks": true,
        "WorkItemCreateRetryLimit": 5,
        "FilterWorkItemsThatAlreadyExistInTarget": false,
        "PauseAfterEachWorkItem": false,
        "AttachRevisionHistory": false,
        "GenerateMigrationComment": true,
        "SourceName": "Source",
        "TargetName": "Target",
        "WorkItemIDs": [],
        "MaxGracefulFailures": 0,
        "SkipRevisionWithInvalidIterationPath": false,
        "SkipRevisionWithInvalidAreaPath": false
      }
    },
    "ProcessorSamples": {
      "AzureDevOpsPipelineProcessor": {
        "Enabled": false,
        "MigrateBuildPipelines": true,
        "MigrateReleasePipelines": true,
        "MigrateTaskGroups": true,
        "MigrateVariableGroups": true,
        "MigrateServiceConnections": true,
        "BuildPipelines": null,
        "ReleasePipelines": null,
        "SourceName": "sourceName",
        "TargetName": "targetName"
      },
      "TfsWorkItemMigrationProcessor": {
        "Enabled": false,
        "WIQLQuery": "SELECT [System.Id] FROM WorkItems WHERE [System.TeamProject] = @TeamProject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan','Shared Steps','Shared Parameter','Feedback Request') ORDER BY [System.ChangedDate] desc",
        "FilterWorkItemsThatAlreadyExistInTarget": false,
        "SourceName": "Source",
        "TargetName": "Target"
      },
      "ExportUsersForMappingProcessor": {
        "Enabled": true,
        "WIQLQuery": "SELECT [System.Id] FROM WorkItems WHERE [System.TeamProject] = @TeamProject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan','Shared Steps','Shared Parameter','Feedback Request') ORDER BY [System.ChangedDate] desc",
        "OnlyListUsersInWorkItems": true,
        "SourceName": "Source",
        "TargetName": "Target"
      }
    },
    "Infrastructure": {
      "ClassNameChangeMappings": {
        "TfsGitRepositoryTool": "TfsGitRepositoryTool",
        "TfsTeamSettingsEnricher": "TfsTeamSettingsTool",
        "TfsWorkItemLinkEnricher": "TfsWorkItemLinkTool",
        "TfsAttachmentEnricher": "TfsAttachmentTool",
        "StringManipulatorEnricher": "StringManipulatorTool",
        "TfsUserMappingEnricher": "TfsUserMappingTool",
        "FieldBlankMap": "FieldClearMap",
        "FieldtoTagMap": "FieldToTagFieldMap",
        "TreeToTagMap": "TreeToTagFieldMap",
        "TeamMigration": "TfsTeamSettingsProcessor",
        "WorkItemQueryMigration": "TfsSharedQueryProcessor",
        "WorkItemMigration": "TfsWorkItemMigrationProcessor",
        "WorkItemMigrationContext": "TfsWorkItemMigrationProcessor",
        "TfsTeamProjectConfig": "TfsTeamProjectEndpoint",
        "WorkItemGitRepoMappingTool": "TfsGitRepositoryTool",
        "WorkItemFieldMappingTool": "FieldMappingTool",
        "CreateTeamFolders": "TfsCreateTeamFoldersProcessor",
        "ExportProfilePicture": "TfsExportProfilePictureFromADProcessor",
        "ExportProfilePictureFromAD": "TfsExportProfilePictureFromADProcessor",
        "ImportProfilePicture": "TfsImportProfilePictureProcessor",
        "ImportProfilePictureFromAD": "TfsImportProfilePictureProcessor",
        "ExportUsersForMapping": "TfsExportUsersForMappingProcessor",
        "ExportUsersForMappingContext": "TfsExportUsersForMappingProcessor",
        "ExportTeamListProcessor": "TfsExportTeamListProcessor",
        "ExportTeamList": "TfsExportTeamListProcessor",
        "ExportUsersForMappingProcessor": "TfsExportUsersForMappingProcessor",
        "TestConfigurationsMigration": "TfsTestConfigurationsMigrationProcessor",
        "TestConfigurationsMigrationProcessor": "TfsTestConfigurationsMigrationProcessor",
        "TestConfigurationsMigrationContext": "TfsTestConfigurationsMigrationProcessor",
        "TestPlansAndSuitesMigration": "TfsTestPlansAndSuitesMigrationProcessor",
        "TestPlansAndSuitesMigrationProcessor": "TfsTestPlansAndSuitesMigrationProcessor",
        "TestPlansAndSuitesMigrationContext": "TfsTestPlansAndSuitesMigrationProcessor",
        "TestVariablesMigration": "TfsTestVariablesMigrationProcessor",
        "TestVariablesMigrationProcessor": "TfsTestVariablesMigrationProcessor",
        "TestVariablesMigrationContext": "TfsTestVariablesMigrationProcessor",
        "WorkItemBulkEditProcessor": "TfsWorkItemBulkEditProcessor",
        "WorkItemUpdate": "TfsWorkItemBulkEditProcessor",
        "WorkItemDelete": "TfsWorkItemDeleteProcessor",
        "WorkItemDeleteProcessor": "TfsWorkItemDeleteProcessor",
        "WorkItemPostProcessingContext": "TfsWorkItemOverwriteProcessor",
        "WorkItemPostProcessing": "TfsWorkItemOverwriteProcessor",
        "WorkItemPostProcessingProcessor": "TfsWorkItemOverwriteProcessor",
        "WorkItemUpdateAreasAsTagsContext": "TfsWorkItemOverwriteProcessor",
        "WorkItemUpdateAreasAsTagsProcessor": "TfsWorkItemOverwriteProcessor"
      }
    }
  }
}

jeffpriz · 2024-12-04T20:04:25Z

jeffpriz
Dec 4, 2024
Author

just to follow up, I was able to get this configured and running successfully. I did run in to a bug found in v16.0.8 (User map null bug) but it was fixed in 16.0.9 that was release today, so migration is executing!

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Migrate Work items Not Teams #2547

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Migrate Work items Not Teams #2547

jeffpriz Dec 3, 2024

Replies: 2 comments · 2 replies

MrHinsh Dec 4, 2024 Maintainer

jeffpriz Dec 4, 2024 Author

MrHinsh Dec 4, 2024 Maintainer

jeffpriz Dec 4, 2024 Author

jeffpriz
Dec 3, 2024

Replies: 2 comments 2 replies

MrHinsh
Dec 4, 2024
Maintainer

jeffpriz Dec 4, 2024
Author

MrHinsh Dec 4, 2024
Maintainer

jeffpriz
Dec 4, 2024
Author