AWS dynamo DB to Azure cosmos DB migration issue

Question

Hi

I am trying to migrate Aws dynamo db to cosmos Azure

Transferred: 0; Failed: 0; Elapsed Time: 00:00:41.3749277
Critical error: Service is currently unavailable.
ActivityId: 8e70db34-033f-416f-b371-c174c46e0de8,
RequestStartTime: 2023-09-21T13:09:27.2366002Z, Number of regions attempted: 1
ResponseTime: 2023-09-21T13:09:34.2152245Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11317/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151523s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:34.2308741Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11000/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151522s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:39.2376404Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11009/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151524s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:45.3158712Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11317/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151523s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:45.3158712Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11000/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151522s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:50.3817333Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11009/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151524s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:09:55.4241070Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11015/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681233077230p/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:10:01.5172714Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11015/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681233077230p/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:10:07.6003145Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11317/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151523s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
ResponseTime: 2023-09-21T13:10:07.6003145Z, StoreReadResult: StorePhysicalAddress: rntbd://cdb-ms-prod-westus1-fd51.documents.azure.com:11000/apps/502b60a8-504e-4087-985e-df2f5536f5b9/services/5c10c766-5a11-4122-9ffa-f110cbeb1155/partitions/586143db-7915-482d-8ec1-126fae824b53/replicas/133395681287151522s/, LSN: -1, GlobalCommittedLsn: -1, PartitionKeyRangeId: , IsValid: False, StatusCode: 410, IsGone: True, IsNotFound: False, IsInvalidPartition: False, RequestCharge: 0, ItemLSN: -1, SessionToken: , ResourceType: Database, OperationType: Query
AddressResolution - StartTime: 2023-09-21T13:09:27.3006424Z, EndTime: 2023-09-21T13:09:28.3081019Z, TargetEndpoint: https://ragavtest-westus.documents.azure.com//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd
AddressResolution - StartTime: 2023-09-21T13:09:39.2376404Z, EndTime: 2023-09-21T13:09:39.4561980Z, TargetEndpoint: https://ragavtest-westus.documents.azure.com//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd
AddressResolution - StartTime: 2023-09-21T13:09:55.4241070Z, EndTime: 2023-09-21T13:09:55.6483922Z, TargetEndpoint: https://ragavtest-westus.documents.azure.com//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd
AddressResolution - StartTime: 2023-09-21T13:10:01.5172714Z, EndTime: 2023-09-21T13:10:01.7433766Z, TargetEndpoint: https://ragavtest-westus.documents.azure.com//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd
, documentdb-dotnet-sdk/2.2.1 Host/64-bit MicrosoftWindowsNT/6.2.9200.0

DocumentDB Data Migration Tool v1.8.3.0

Usage:

  dt.exe [/<option>:<value>] /s:<source-name> [/s.<source-option>:<value>] /t:<target-name> [/t.<target-option>:<value>]

Options:

  /ErrorLog: Optional. Name of the CSV file to redirect data transfer failures
  /EnableCosmosTableLog: Optional, Enables logging to a remote Cosmos DB Table API account. Unless destination is cosmos tables api, this also needs 'CosmosTableLogConnectionString' property.
  /CosmosTableLogConnectionString: Optional, Connection string for cosmos tables for logging. If provided, it will use this endpoint info for remotely logging failure info.
  /OverwriteErrorLog: Optional. Overwrite error log file
  /ProgressUpdateInterval: Optional, default is 00:00:01. Time interval to refresh on-screen data transfer progress
  /ErrorDetails: Optional, default is None. Specifies that detailed error information should be displayed for the following errors: None, Critical, All

Available sources:

  JsonFile: Reads data from JSON files, either one or multiple
    /s.Files: One or more file search patterns to read JSON from
    /s.Decompress: Optional. If source files should be decompressed with GZip

  MongoDB: Reads data from MongoDB documents collection
    /s.ConnectionString: Connection string including database name (example: "mongodb://localhost/database")
    /s.Collection: Name of the documents collection
    /s.Query: Optional. Mongo query document
    /s.QueryFile: Optional. Path to the file containing query document
    /s.Projection: Optional. Document that defines fields to include or exclude (example: {"state": true, "city": true} or {"state":1, "city":1})
    /s.ProjectionFile: Optional. Path to the file containing projection document

  MongoDBExport: Reads data from MongoDB export (mongoexport) JSON files
    /s.Files: One or more file search patterns to read MongoDB export (mongoexport) JSON from
    /s.Decompress: Optional. If source files should be decompressed with GZip

  SQL: Reads data from SQL database
    /s.ConnectionString: Connection string for the SQL Server
    /s.Query: SQL query to get the data. Query and QueryFile are mutually exclusive to each other, only one of them can be specified
    /s.QueryFile: Path to the file containing SQL query. Query and QueryFile are mutually exclusive, only one of them can be specified
    /s.NestingSeparator: Optional. Special character in the column name to indicate that nested document is needed

  CsvFile: Reads data from CSV files, either one or multiple
    /s.Files: One or more file search patterns to read CSV from
    /s.NestingSeparator: Optional. Special character in the column name to indicate that nested document is needed
    /s.TrimQuoted: Optional. If empty space at the start and end of the quoted value should be removed
    /s.NoUnquotedNulls: Optional. If unquoted NULL string should be treated as string
    /s.UseRegionalSettings: Optional. If system regional settings should be used to parse the files. This includes such settings as list separator, number, date and time format
    /s.Decompress: Optional. If source files should be decompressed with GZip

  AzureTable: Reads data from Azure Table storage
    /s.ConnectionString: Connection string for the table endpoint
    /s.LocationMode: Optional, default is PrimaryOnly. Specifies which location mode to use when connecting to Azure Table storage: PrimaryOnly, PrimaryThenSecondary, SecondaryOnly, SecondaryThenPrimary
    /s.Table: Name of the Azure Table
    /s.InternalFields: Optional, default All. Specifies which internal Azure Table fields should be preserve in the output: None, RowKey, All
    /s.Filter: Optional. Filter string to apply
    /s.Projection: Optional. List of columns to select

  DynamoDB: Reads data from Amazon DynamoDB tables
    /s.ConnectionString: Amazon DynamoDB connection string (example: "ServiceURL=xyz;AccessKey=xyz;SecretKey=xyz")
    /s.Request: DynamoDB query or scan request
    /s.RequestFile: Path to the file containing DynamoDB query or scan request

  HBase: Reads data from HBase table using Stargate REST API
    /s.ConnectionString: HBase connection string (example: "ServiceURL=xyz;Username=xyz;Password=xyz")
    /s.Table: Name of the table to scan
    /s.Filter: Optional. HBase Stargate scanner filter definition in JSON format
    /s.FilterFile: Optional. Path to the JSON file containing HBase Stargate scanner filter definition
    /s.ExcludeId: Optional. If row id property should be excluded from the output
    /s.BatchSize: Optional, default is 100. Number of cells to read per request

  DocumentDB: Reads data from DocumentDB collections
    /s.ConnectionString: Connection string (example: "AccountEndpoint=xyz;AccountKey=xyz;Database=xyz")
    /s.ConnectionMode: Optional, default is DirectTcp. Specifies how to connect to DocumentDB account: DirectTcp, DirectHttps, Gateway
    /s.Retries: Optional, default is 30. Number of retries on transient failures
    /s.RetryInterval: Optional, default is 00:00:01. Retry interval on transient failures
    /s.Collection: Regex pattern to match one or more documents collection names
    /s.InternalFields: Optional. Preserve internal DocumentDB fields in the output
    /s.Query: Optional. Documents query to execute
    /s.QueryFile: Optional. Path to the file containing documents query

Available targets:

  TableAPIBulk: Uploads data into Azure CosmosDB Table in batches
    /t.ConnectionString: Connection string for the table endpoint
    /t.TableName: Specifies the name of the table to write to
    /t.Overwrite: Optional, default is false. Specifies if existing values should be overwritten
    /t.MaxInputBufferSize: Optional, default is 10MB. Approximate estimate of input bytes to buffer before flushing data to sink
    /t.Throughput: Optional, service defaults if not specified. Specifies throughput to configure for table
    /t.MaxBatchSize: Optional, default is 2MB. Specify the batch size in bytes

  DocumentDBBulk: Uploads data into one or more single partition DocumentDB collections in batches
    /t.CollectionThroughput: Optional, default is 1000. Specifies maximum throughput of the collection
    /t.IndexingPolicy: Optional. Indexing policy for the collection
    /t.IndexingPolicyFile: Optional. Path to the file containing indexing policy for the collection
    /t.IdField: Optional. Name of the source field that should be treated as document ID
    /t.DisableIdGeneration: Optional. Disable automatic generation of document ids
    /t.UpdateExisting: Optional. Update existing documents with the same ID
    /t.Dates: Optional, default is String. Specifies how timestamps should be persisted: String, Epoch, Both
    /t.ConnectionString: Connection string (example: "AccountEndpoint=xyz;AccountKey=xyz;Database=xyz")
    /t.ConnectionMode: Optional, default is DirectTcp. Specifies how to connect to DocumentDB account: DirectTcp, DirectHttps, Gateway
    /t.Retries: Optional, default is 30. Number of retries on transient failures
    /t.RetryInterval: Optional, default is 00:00:01. Retry interval on transient failures
    /t.Collection: One or more documents collection names. Use "[a-b]" placeholder to automatically generate collection index, e.g. "Data[0-2]" will result in the following collection names: Data0, Data1, Data2
    /t.PartitionKey: Optional. Name of the property to use as hash partitioning key. If not provided - records will be randomly distributed across all target collections
    /t.StoredProcFile: Optional, default is BulkInsert.js. Name of the file containing bulk insert stored procedure
    /t.BatchSize: Optional, default is 50. Number of documents in one batch
    /t.MaxScriptSize: Optional, default is 524278. Size (in bytes) of the bulk insertion JSON array

  DocumentDB: Uploads data into partitioned DocumentDB collection
    /t.CollectionThroughput: Optional, default is 1000. Specifies maximum throughput of the collection
    /t.IndexingPolicy: Optional. Indexing policy for the collection
    /t.IndexingPolicyFile: Optional. Path to the file containing indexing policy for the collection
    /t.IdField: Optional. Name of the source field that should be treated as document ID
    /t.DisableIdGeneration: Optional. Disable automatic generation of document ids
    /t.UpdateExisting: Optional. Update existing documents with the same ID
    /t.Dates: Optional, default is String. Specifies how timestamps should be persisted: String, Epoch, Both
    /t.ConnectionString: Connection string (example: "AccountEndpoint=xyz;AccountKey=xyz;Database=xyz")
    /t.ConnectionMode: Optional, default is DirectTcp. Specifies how to connect to DocumentDB account: DirectTcp, DirectHttps, Gateway
    /t.Retries: Optional, default is 30. Number of retries on transient failures
    /t.RetryInterval: Optional, default is 00:00:01. Retry interval on transient failures
    /t.Collection: Name of the documents collection
    /t.PartitionKey: Optional. Path to the property to use as hash partitioning key (example: "/deviceId")
    /t.ParallelRequests: Optional, default is 10. Number of parallel document create requests

  JsonFile: Stores data in a single JSON file with root array element
    /t.File: Path to the file to write data to
    /t.Prettify: Optional. If JSON in the target file should be indented
    /t.Overwrite: Optional. Overwrite target file
    /t.Compress: Optional. If target file should be compressed with GZip

C:\Users\j.jeyaseelan.albert\Downloads\azure-documentdb-datamigrationtool-1.8.3\azure-documentdb-datamigrationtool-1.8.3>