1.  Go to the SharePoint Admin center 
   Note: We recommend changing the Managed Properties that you are going to use on more than one site at the Tenant level as a best practice.  
2. Go to search  
3. Go to Manage search schema  
4. Search for “LastModifiedTime” 
5. Click on “Edit/Map property” 
6. Change the order of the crawled property as shown below: 
7. Save. 
8. Search for “Created” 
9. Click on “Edit/Map property” for “Created” 
10. Change the order of the crawled property as shown below:
11. Save.  

The Scenario

It’s about Control

Your Options

• Option 1: Remove the requirement that accepting users must match invited users. This is something that the inviting organization must do. To disable this feature, you may choose between the option "External users must accept sharing invitations using the same account that the invitations were sent to" check box under Additional Settings on the Sharing configuration page of your SharePoint Online tenant admin portal; or you can use the Microsoft SharePoint Online Management Console and run the following command after connecting to your tenant (using the Connect-SPOService cmdlet): Set-SPOTenant -RequireAcceptingAccountMatchInvitedAccount $false
• Option 2: The Invited Organization can add the upn of the user as an smtp-proxy address to the user object in Active Directory and sync it up to the cloud. This means that the upn of the user is a valid email address.  While this somewhat defeats the purpose of having separate email addresses and UPNs, not advertising the email address except in special circumstances, such as this, still maintains some of the original difficulty in discovering the person’s username.
• Option 3: Users who are invited to tenants that are configured in this scenario, where neither organization wants to pursue Option 1 or 2, can still create a separate Microsoft Account and log in to the partner tenant using those credentials. The easiest way to do that is to create an Outlook.Com email address and invite that address to the tenant.

Final Thoughts

 Why is this occurring?

How can I search for my list item without having to specify the listitemid managed property?

Note: We recommend making the Managed Properties that you are going to use on more than one site at the Tenant level as a best practice.

**After this change you may get unexpected result when performing numeric searches.

1. Go to the SharePoint Admin center.
2. Go to search
3. Go to Manage search schema
4. Click on “Create a new managed property”
5. Give it a name and make sure that the following options are checked: Searchable, Queryable, Retrievable, Token Normalization
6. Add a mapping to the ows_ListItemID
7. Save.

What is ClickJacking? 

Why does the Admin not get prompted?

Introduction to SharePoint Online Search

• Enterprise Search center
• Site Search
• List and library search
• Search Web Parts
• “Shared with me” view in OneDrive for business
• Usage and popularity trends
• DLP, eDiscovery Searches, and Retention

Legacy Site Auditing

• Editing items
• Checking out or checking in items
• Moving or copying items to another location in the site
• Deleting or restoring items
• Editing content types and columns
  • See section Limited/Partial/No Auditing Further details below

• Editing users and permissions
• Searching site content

• Searching site content and Popularity reports are only available as part of the legacy site auditing.
• As "Opening or downloading documents, viewing items in lists, or viewing item properties" is not available for SharePoint Online if you try to view the Content Viewing report:or create a custom report with only "Opening or downloading documents, viewing items in lists, or viewing item properties" selected, you will see this message which is expected behavior:

Audit logs in the Office 365 Compliance Center

• Site Creation/deletion
• Editing items
• Checking out or checking in items
• Moving or copying items to another location in the site
• Deleting or restoring items
• Opening or downloading documents, viewing items in lists, or viewing item properties
• Editing content types and columns
  • See section "Limited/Partial/No Auditing Further details" below.

• Editing users and permissions
• Auditing AD Security groups membership/changes that are used to give permission to SPO resources
• 
• Enable/Disable Features or changing sites Setting 
  • See section "Limited/Partial/No Auditing Further details" below.

• Changing Tenant Settings
  • See section "Limited/Partial/No Auditing Further details" below.

• When trying to reduce the number of activities returned by providing a user, make sure that you look for UPN and email (especially if they are different) to ensure a full set of results is retuned.
• You can search the Office 365 audit log for activities that were performed within the last 90 days.
• The following article goes into detail of the properties that are currently captured for the different services in Office 365:  Detailed Properties in the Office 365 audit log

Limited/Partial /No Auditing Further details

• Adding/Editing content types and columns: For adding or editing content types and fields you won't be able to get the exact activity but searching for the page associated with Content types and Site columns in Office 365 Audit Logs will allow you to gather some information on who and when these changes could have been made. Here is an example of editing a Site Columns:

• User profile properties: Currently there is no auditing of add/delete/updates made to User Profile Properties
• Enable/Disable Features or changing sites Setting: Currently there isn't any direct auditing of features being enabled and disabled however often times when enabling features, it will result in the creation of certain list and libraries which could be used to determine timeframe etc.
• Changing Tenant Settings: For changing tenant setting there isn't an exact activity but searching for "admin"in the "File, folder or site" and find the items that are related to "TenantSettings.aspx".The other option is to search for the exact link. Example of the link you can use: https://contoso-admin.sharepoint.com/_layouts/15/online/TenantSettings.aspx

• Adding/Editing content types and columns
• Enable/Disable Features or changing sites Setting
• Changing Tenant Settings

• The activity needs to have occurred in the last 60 days though it is preferable if it is in the last 30 days.
• The activity needs to be isolated to a few day timeframe

Other Auditing options

[CmdletBinding(DefaultParameterSetName="UseCustomTermSet")] Param ( [Parameter(Mandatory=$true)] $url ) $loadInfo1 = [System.Reflection.Assembly]::LoadWithPartialName("Microsoft.SharePoint.Client") $loadInfo2 = [System.Reflection.Assembly]::LoadWithPartialName("Microsoft.SharePoint.Client.Runtime") $cred = get-credential $clientContext = New-Object Microsoft.SharePoint.Client.ClientContext($url) $credentials = New-Object Microsoft.SharePoint.Client.SharePointOnlineCredentials($cred.username, $cred.password) $clientContext.Credentials = $credentials $site = $clientContext.Site $clientContext.Load($site) $clientContext.ExecuteQuery() $changeQuery = New-Object Microsoft.SharePoint.Client.ChangeQuery($true, $true) $changes = $site.GetChanges($changeQuery) $clientContext.Load($changes) $clientContext.ExecuteQuery() foreach ($change in $changes) { if ($change) { $change } }

The Complication:

Connect-MSOLService
Get-MSOLUser -UserPrincipalName john@fabrikam.com

Technical Background:

Resolution

• Workflow instance can’t be started manually.
• Workflow can’t be published in SharePoint Designer 2013.
• Workflow has been published but isn’t displayed in SharePoint Designer 2013.
• Workflow Settings page for the associated list or library fails to render.
• Workflow instance doesn’t start automatically on Item Create or Item Change as expected.
• Workflow instance transitions immediately into a fail-retry loop and eventually becomes suspended.

Accessing Library Settings

1. Append the following text to the site URL, then navigate to the resulting URL: _api/web/lists/getbytitle('wfsvc')/id
   1. This step obtains the unique ID of the ‘wfsvc’ library within the specified site.
   2. Example: https://contoso.sharepoint.com/sites/marketing/_api/web/lists/getbytitle('wfsvc')/id
2. The resulting XML blob will contain a Globally Unique Identifier or GUID formatted similarly to this: 0fc0ee2b-ddc0-4e59-93b1-dcc92e086839
3. Append the following text to the site URL, then navigate to the resulting URL: _layouts/15/listedit.aspx?List={0fc0ee2b-ddc0-4e59-93b1-dcc92e086839}
   1. Replace the GUID in this text with the GUID obtained from the previous step.
   2. Example: https://contoso.sharepoint.com/sites/marketing/_layouts/15/listedit.aspx?List={0fc0ee2b-ddc0-4e59-93b1-dcc92e086839}

Default versioning settings

• Content Approval -> Require content approval for submitted items? is set to No.
• Document Version History -> Create a version each time you edit a file in this document library? is set to Create major versions.
• Require Check Out -> Require documents to be checked out before they can be edited? is set to No.

Default columns

Default content types

How does the "Find a file/Item" work?

1. The user enters a string to search for in the "Find an item".
2. The list control gets that query string, and sends it to the SearchAdapter.
3. The SearchAdapter now has the query string and the list that requested the search. It goes into that list (the ENTIRETY of the list) and finds the list item IDs that correspond to that query string, and returns the first 500 that match the query string (regardless of view/folder etc).
4. The list takes those 500 results and adds them to a CAML query which contains the original view information.
5. The list submits the CAML query and can result in only a subset of the list item IDs that are in that view and displays those to the user.

Real world Scenario:

1. The user knows that there are at least 1,000 items within this folder that have the "New York" metadata tag yet it is only returning 500 that have this tag.
2. They also notice that some of these items are from other folders.

 Why did this happen?

How to determine if you are running into this limitation or if content isn't available in the index?

Search in the "Find an item: search using the list item id.

1. You will need to first modify the view of the list/library to show the ID. Simply click on library settings > Modify view > Check the ID field.
2. You will then see the ID of the document as you can see below:
3. Next, you will want to run a search for that ID managed property by typing in the Find an Item Search using Listitemid:(x)

Search for one of the files that you are expecting from the search for the site collection.

What we recommend if you are hitting this limit?

Divide the content into multiple libraries

• By dividing the content and reducing the item count within a single library, you reduce the chance of reaching the 500 item find a file search limit.
  • Pros: Usability and management of the list is easier long term
  • Cons: Initial effort needed to divide the content into separate list and libraries.
• More information on managing large lists and libraries in SharePoint can be found here

Utilize Enterprise search.

• Enterprise search utilizes a type of query that does not have the same limitation as the Find a File search query. This would prevent you from having to separate your content and is the Best Practice recommendation for searching within SharePoint Online if you are hitting these limits.
  • Pros: Will return more than 500 items/files.
  • Cons: Search results are not limited to the list/library so additional search knowledge is needed to isolate the results to the areas needed.

• We are in the process of creating this in a separate blog post. We will post it here when completed.

Create search web parts configured to search the document library in question.

• If you require a custom search option that allows you to query the document library in question while also bypassing the 500-item limit, creating a custom site and putting a search web part on it that is sourced to the library in question may be a viable option.
• More information on search and search web parts can be found here.
• We are also in the process of creating a separate blog post on how to do this. We will update this article to include a link when completed.

1. Creation of initial package. For SharePoint migrations this a ‘prime’ package made with either Export-SPWeb or custom code. For file system data this package is created with New-SPOMigrationpackage
2. Converting the package so it is compatible with SPO (ConvertTo-SPOMigrationTargetedPackage)
3. Upload the package to Azure Storage and start a migration job (Invoke-SPOMigraitonEncryptUploadSubmit or Submit-SPOMigrationJob)
4. Behind the scenes the job started in step 3 will scan the data and begin importing it into SharePoint Online.

Migrating File System Data

1. Ensure the destination site and library are created prior to the migration.
2. Create the initial package (New-SPOMigrationPackage).
   1. This requires an output folder where it saves the package called OutputPackagePath.
3. Convert the package so it is compatible with SPO Migrations (ConvertTo-SPOMIgrationTargetedPackage).
   1. This consumes the package created in step 1 and outputs data to a different output path OutputPackagePath. Even though the parameter name is the same as in step 1, it is expecting a different path. In other words, the output of New-SPOMigrationPackage is the input of ConvertTo-SPOMigrationTargetedPackage, and ConvertTo-SPOMigrationTargetedPackage has its own output.
4. Encrypt and upload the data to Azure storage, and start the migration job (Invoke-SPOMigraitonEncryptUploadSubmit)
   1. Similar to the previous commands, Invoke-SPOMigraitonEncryptUploadSubmit uses the output of the previous command, ConvertTo-SPOmigrationTargetedPackage. The output of Invoke-SPOMigraitonEncryptUploadSubmit is encrypted and uploaded automatically to Azure Storage.
5. Optional: Monitor the migration job (Get-SPOMigrationJobProgress).

[CmdletBinding(DefaultParameterSetName="UseCustomTermSet")]
Param
(
 [Parameter(Mandatory=$true)]
 $sourceFiles,

[Parameter(Mandatory=$true)]
 $tempDir1,

[Parameter(Mandatory=$true)]
 $tempDir2,

[Parameter(Mandatory=$true)]
 $targetWeb,

[Parameter(Mandatory=$true)]
 $targetDocLib
)

$cred = get-credential

New-SPOMigrationPackage -SourceFilesPath $sourceFiles -OutputPackagePath $tempDir1 -TargetWebUrl $targetWeb -TargetDocumentLibraryPath $targetDocLib -IgnoreHidden –ReplaceInvalidCharacters

$finalPackages = ConvertTo-SPOMigrationTargetedPackage -ParallelImport -SourceFilesPath $sourceFiles -SourcePackagePath $tempDir1 -OutputPackagePath $tempDir2 -Credential $cred -TargetWebUrl $targetWeb -TargetDocumentLibraryPath $targetDocLib

$job = Invoke-SPOMigrationEncryptUploadSubmit -SourceFilesPath $sourceFiles -SourcePackagePath $tempDir2 -Credentials $cred -TargetWebUrl $targetWeb

#This next line is optional but will show the progress of the job after the data is uploaded.
 $status = Get-SPOMigrationJobProgress -TargetWebUrl $targetWeb -AzureQueueUri $job.ReportingQueueUri -Credentials $cred -JobIds $job.JobId.Guid -EncryptionParameters $job.Encryption

Migrating SharePoint Data

• It is best to begin by scanning your environment for migration blockers using the SharePoint Migration Assessment Tool (SMAT)
• For information on the output of SMAT see: Scan Reports Roadmap
• If you don’t want to migrate using PowerShell, we have a new migration tool you can use Introducing the SharePoint Migration Tool
• Regarding supportability, the migration API supports migrating content from SharePoint 2013 to SharePoint Online. Using the migration API to migrate content from MOSS 2007 or SharePoint 2010 is not supported. In addition, the migration API does not facilitate SPO to SPO site migrations.

Migrating Lists

1. The first step is to export the list using Export-SPWeb from the SharePoint Server. The export should use -nofilecompression and -itemurl parameters to ensure the migration api cmdlets can properly read the files. To improve performance of the migration, only export the most recent version by using -includeversions 1 For example, if your list is called Expenses and is located at https://SP in your on prem farm, the export command could look like this: Export-SPWeb -Identity https://SP -ItemUrl '/lists/expenses' -Path c:\exportfolder -NoFileCompression -IncludeVersions 1
2. Now that the package is created, go to the SharePoint site where you want to move the list, create an empty OOB custom list. This step can be scripted if necessary.
3. Set up a machine to migrate the data to SharePoint Online by installing the SharePoint Online PowerShell Module
4. Once the PowerShell Module is installed, you are ready to convert the package from SharePoint On Premises Prime package to a SharePoint Online package. This is done using the ConvertTo-SPOMigrationTargetedPackage cmdlet. This cmdlet is used for converting list exports, library exports, but also packages created from file system data.
5. After the package data is converted to be a valid SharePoint Online package, we use Invoke-SPOMigrationEncryptUploadSubmit to encrypt the data, upload to azure storage, and start the migration job within SharePoint (technet doesn't yet have an article on this one, but it is referenced in the article: Upload on-premises content to SharePoint Online)
6. Once the job has started all that is needed is to wait for it to complete. If you want to check the status, you can use Get-SPOMigrationJobProgress

[CmdletBinding(DefaultParameterSetName="UseCustomTermSet")]
Param
(
    [Parameter(Mandatory=$true)]
    $sourceFiles,
 
    [Parameter(Mandatory=$true)]
    $tempDir1,
 
    [Parameter(Mandatory=$true)]
    $targetWeb,
 
    [Parameter(Mandatory=$true)]
    $targetListRelativePath 
)
 
$cred = get-credential
 
$finalPackages = ConvertTo-SPOMigrationTargetedPackage -ParallelImport -SourceFilesPath $sourceFiles -SourcePackagePath $sourceFiles -OutputPackagePath $tempDir1 -Credential $cred -TargetWebUrl $targetWeb -TargetListPath $targetListRelativePath
 
$job = Invoke-SPOMigrationEncryptUploadSubmit -SourceFilesPath $sourceFiles -SourcePackagePath $tempDir1 -Credentials $cred -TargetWebUrl $targetWeb 
 
#this next line will produce some UI to show the progress of the job after its uploaded. This is optional and be removed of monitor isn't what you want.
Get-SPOMigrationJobProgress -TargetWebUrl $targetWeb -AzureQueueUri $job.ReportingQueueUri -Credentials $cred -JobIds $job.JobId.Guid -EncryptionParameters $job.Encryption

Migrating Libraries

Improving SharePoint Data migration speeds

1. As the article referenced above states, it is critical that you triage your data prior to migration. Here are 3 things to keep in mind when triaging your data.
1. Large lists and libraries (greater than 5k items/files) will move much more slowly than small or medium lists. The larger the list, the more slowly it will migrate. If a large list or library must be migrated, consider migrating that content last. Migrating “larger” content last helps ensure these lists and libraries do not de-rail project timelines.
2. Wide lists and libraries (many columns). Like large lists, lists with many columns migrate more slowly, since there is more data to migrate per item. Consider migrating wide lists and libraries at the end of the project as well.
3. Lists and Libraries with Versions enabled. When you migrate a list or library with versions enabled each item version must be migrated separately. This means that an item with 100 versions will migrate at the same speed as 100 items with a single version. Consider exporting the most recent item version, or the 5 most recent item versions to improve migration performance.
2. Outside of data rationalization/triaging, using simultaneous migrations is the number one way to improve overall throughput. When migrating multiple packages at once, you can avoid throttling by using a different account for each simultaneous migration attempt. A common example would be 16 accounts migrating 16 packages at once.
3. Another common bottle neck is local network bandwidth issues. One good workaround is to use Azure VMs to migrate the export packages.
]]>