Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
FMA Scenario Severities
View Xbox Requirements
Test Cases
003-02 Title Integrity
| Scenario | Severity | Platform |
|---|---|---|
| The title is UWP and does not allow the user to launch or resume from the Game hub. | Not Relevant (-4) | Xbox One, Xbox Series |
| The title exhibits slowdown that does not prevent gameplay progression and does not affect the gameplay experience. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| The title exhibits minor visual and/or audio corruption which does not affect gameplay progression. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| The title displays null characters within a user-generated string of text when customized to contain special characters. (For example, Subscript and superscript characters.) Note Use XR-046 for Display Name issues. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| Incorrect art assets which affect understanding of the title in a non-prominent area (for example, Sub-menu, Xbox Help). Incorrect includes null, missing, clipped, overlapping or placeholder art assets. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| The title links to a blank Xbox Store page when attempting to purchase DLC from the in-title store. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| [Save Files] After creating a save with the console localized to a given language, the title displays null characters within the user's save file name when accessed while the console is localized to a different language and location. When switching the language back, the file name is displayed correctly. |
Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| [Compilation Disc] The title displays placeholder artwork/a placeholder name for packages whilst installing from a compilation disc. The title correctly displays artwork/the package name once the installation reaches the initial play marker or full installation. |
Not Relevant (-4) | Xbox One, Xbox Series |
| Incorrect art assets which do not affect understanding of the title, in a very prominent area (for example, Title screen). Incorrect includes null, missing, clipped, overlapping or placeholder art assets. | Very Minor (1) | Xbox One, Xbox Series, Windows |
| The title only outputs audio in Stereo. | Very Minor (1) | Xbox One, Xbox Series, Windows |
| The title exhibits visual and/or audio corruption or slowdown that does not prevent gameplay progression but distracts from the gameplay experience. | Minor (2) | Xbox One, Xbox Series, Windows |
| The title displays a small amount of placeholder content that detracts from the user experience. (Text issues to be logged under 003-04 Language Support.) | Minor (2) | Xbox One, Xbox Series, Windows |
| Incorrect art assets which have a minor impact in game critical areas. Incorrect includes null, incorrectly localized, missing, clipped, overlapping or placeholder art assets. | Minor (2) | Xbox One, Xbox Series, Windows |
| Debug output is displayed which has no effect on usability / playability. | Minor (2) | Xbox One, Xbox Series, Windows |
| The title links to an unexpected Xbox Store page when attempting to purchase DLC from the in-title store. | Minor (2) | Xbox One, Xbox Series, Windows |
| The title exhibits moderate visual and/or audio corruption which makes gameplay progress difficult for the average user. | Moderate (6) | Xbox One, Xbox Series, Windows |
| Incorrect art assets which has a moderate impact in game critical areas. Incorrect includes null, missing, clipped, overlapping or placeholder art assets. | Moderate (6) | Xbox One, Xbox Series, Windows |
| The title is a full release but displays the words Beta/Game Preview/Trial in the title's name. | Moderate (6) | Xbox One, Xbox Series, Windows |
| [DLC] A specific piece of DLC does not work in-title as expected, however other examples of that type of DLC do work as expected; for example, one skin pack does not work at least one other does. |
Moderate (6) | Xbox One, Xbox Series, Windows |
| [Compilation Disc] The title displays placeholder artwork/a placeholder name for packages whilst installing from a compilation disc. The placeholder assets are still displayed when the package is fully installed. |
Moderate (6) | Xbox One, Xbox Series |
| The title enters a recoverable partially unresponsive state that can be resolved without termination. | Moderate (6) | Xbox One, Xbox Series, Windows |
| The title emulates a proprietary Xbox Network system, such as Achievement Toasts, which will cause confusion to the end user. | Critical (12) | Xbox One, Xbox Series, Windows |
| Progression of core gameplay is prevented for the average user. (Text issues to be logged under 003-04 Language Support.) | Critical (12) | Xbox One, Xbox Series, Windows |
| Severe visual and/or audio corruption is exhibited which may also prevent gameplay progress. | Critical (12) | Xbox One, Xbox Series, Windows |
| Significant number of incorrect art assets in game critical areas that strongly affect the core experience. Incorrect includes null, missing, clipped, overlapping or placeholder art assets. | Critical (12) | Xbox One, Xbox Series, Windows |
| Slowdown is exhibited that prevents gameplay progression. | Critical (12) | Xbox One, Xbox Series, Windows |
| User generated content becomes, or appears to become, inaccessible. | Critical (12) | Xbox One, Xbox Series, Windows |
| A debug feature allows game/system breaking interaction or has a severe impact to usability / playability. | Critical (12) | Xbox One, Xbox Series, Windows |
| Launching the title with the console set to one or more supported languages prevents the user from accessing one or more critical title areas. | Critical (12) | Xbox One, Xbox Series, Windows |
| The title displays a Beta watermark though it is not a Beta release. | Critical (12) | Xbox One, Xbox Series, Windows |
| [DLC] A particular type of DLC as a whole does not work in-title as expected; for example, all consumables or all skin packs. |
Critical (12) | Xbox One, Xbox Series, Windows |
| [Cross Region (Multiplayer)] The title supports cross-region multiplayer gameplay over the Xbox Network but users on different SKUs cannot enter gameplay sessions together. |
Critical (12) | Xbox One, Xbox Series, Windows |
| No current Scenario | Catastrophic (22) |
Notes
- The Microsoft representative should be notified for Xbox Store related issues (for example, placeholder content displayed, English description for non-English locales)
- [Windows] This test case only applies to Gamepass Submissions.
- An issue regarding an unrecoverable "partially unresponsive state" is to be logged under Title Stability.
- "Partially unresponsive state" means that the title remains unresponsive to the majority of user input but does respond to minimal controller input (that is, A button input, left/right stick input, etc.).
003-03 Options
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | |
| One or more options act slightly differently than intended, but with almost no impact on the end user. | Very Minor (1) | Xbox One, Xbox Series, Windows |
| With all audio sliders set to 0, the title still provides audio in certain locations. | Minor (2) | Xbox One, Xbox Series, Windows |
| An option works in a way significantly different than what the user would expect, affecting the user experience. | Minor (2) | Xbox One, Xbox Series, Windows |
| Options reset between game sessions. | Minor (2) | Xbox One, Xbox Series, Windows |
| No current Scenario | Moderate (6) | Xbox One, Xbox Series, Windows |
| An option, when changed, makes the game unplayable. (log under integrity) | Critical (12) | Xbox One, Xbox Series, Windows |
| No current Scenario | Catastrophic (22) |
Notes
- [Windows] This test case only applies to Gamepass Submissions.
- Core options are those most impactful to the gameplay and most likely to be used, including controller layout.
003-04 Language Support
| Scenario | Severity | Platform |
|---|---|---|
| Incorrect characters, strings or spoken language which does not affect understanding of the title in a non-prominent area (for example, Sub-menu, Xbox Help). Incorrect includes null, missing, clipped, overlapping or placeholder strings. | Not Relevant (-4) | Xbox One, Xbox Series |
| The title is launched with the console set to a supported language, but the expected language is not displayed in-title. The title's text is fully localized into an appropriate default language (that is, English, or the language of a country/region-specific app) instead of what the console is set to. Send an In-Test query to the Microsoft representative that the supported language is not supported. | Not Relevant (-4) | Xbox One, Xbox Series |
| Rich Presence strings or Achievements or Hero Stats are displayed in English, regardless of console settings. | Not Relevant (-4) | Xbox One, Xbox Series |
| Incorrect characters, strings or spoken language which does not affect understanding of the title, in a very prominent area (for example, Title screen). Incorrect includes null, missing, clipped, overlapping or placeholder strings. An appropriate default language is acceptable (that is, English, or the language of a country/region-specific app). | Very Minor (1) | Xbox One, Xbox Series |
| The title is launched with the console set to a supported language, but the expected language is not displayed in-title. The text is NOT fully localized into an appropriate default language (that is, English, or the language of a country/region-specific app). Send an In-Test query to the Microsoft representative that the supported language is not supported. | Minor (2) | Xbox One, Xbox Series |
| Incorrect characters, strings or spoken language which has a minor impact in game critical areas. Incorrect includes null, incorrectly localized, missing, clipped, overlapping or placeholder strings. | Minor (2) | Xbox One, Xbox Series |
| The title does not correctly play non-critical audio or display non-critical text when the console language is set to certain languages. | Minor (2) | Xbox One, Xbox Series |
| Incorrect characters, strings or spoken language which has a moderate impact in game critical areas. Incorrect includes null, missing, clipped, overlapping or placeholder strings. An appropriate default language is acceptable (that is, English, or the language of a country/region-specific app). | Moderate (6) | Xbox One, Xbox Series |
| Significant number of incorrect characters, strings, spoken language, or mistranslations, in game critical areas that strongly affect the core experience. Incorrect includes null, missing, clipped, overlapping or placeholder strings. An appropriate default language is acceptable (that is, English, or the language of a country/region-specific app). | Critical (12) | Xbox One, Xbox Series |
| Launching the title with the console set to an unsupported language results in no text or null characters being displayed that makes the game unplayable to a significant degree to the average user. | Critical (12) | Xbox One, Xbox Series |
| Written or spoken language content so incorrect that it makes the game unplayable for the average user. Incorrect includes null, missing, clipped, overlapping or placeholder strings. An appropriate default language is acceptable (that is, English, or the language of a country/region-specific app). | Catastrophic (22) | Xbox One, Xbox Series |
Notes
- In general, if a partner wishes to use English text with the console set to other languages, this is acceptable. If a language is supported but not implemented when expected, query the Microsoft representative as to the partner's intention.
003-05 Navigation
| Scenario | Severity | Platform |
|---|---|---|
| Voice user interface (VUI) does not function in Japan (this is currently unsupported). | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| No current Scenario | Very Minor (1) | |
| Inability to navigate fully with natural user interface (NUI)/VUI or Controller, if supported, to a degree where the user cannot access a non-core area (for example, credits) | Minor (2) | Xbox One, Xbox Series, Windows |
| Button imagery/written command which has a different action than expected, no action where expected, or is widespread through navigation with minor to severe impact to the user. | Minor (2) | Xbox One, Xbox Series, Windows |
| No current Scenario | Moderate (6) | Xbox One, Xbox Series, Windows |
| Inability to navigate fully with NUI/VUI or Controller, if supported, to a degree where user cannot access a core area. (log under integrity) | Critical (12) | Xbox One, Xbox Series, Windows |
| No current Scenario | Catastrophic (22) |
Notes
- Any issues deemed Catastrophic to the platform in this category should be logged under Integrity.
- [Windows] This test case only applies to Gamepass Submissions.
003-07 Leaderboards
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | Xbox One, Xbox Series |
| No current Scenario | Very Minor (1) | Xbox One, Xbox Series |
| A small element of a single Leaderboard does not work as expected with limited end-user impact. | Minor (2) | Xbox One, Xbox Series |
| One or more minor Leaderboard(s) cannot be accessed. | Moderate (6) | Xbox One, Xbox Series |
| One or more Leaderboard(s) cannot be sorted correctly. | Moderate (6) | Xbox One, Xbox Series |
| A moderate element of a single Leaderboard does not work as expected with limited end-user impact. | Moderate (6) | Xbox One, Xbox Series |
| Most key Leaderboard(s) cannot be accessed. | Critical (12) | Xbox One, Xbox Series |
| Significant elements of one or more Leaderboards do not update correctly. | Critical (12) | Xbox One, Xbox Series |
| No current Scenario | Catastrophic (22) |
Notes
- No current FMA Notes to consider.
003-08 Low or High Friend Count
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | |
| No current Scenario | Very Minor (1) | |
| A small part of the title is unavailable when using an account with a certain number of friends. | Minor (2) | Xbox One, Xbox Series |
| A moderate part of the title is unavailable when using an account with a certain number of friends. | Moderate (6) | Xbox One, Xbox Series |
| The title does not display all of a user's Friends within the in-title Friends list when a profile has a high friend count. | Moderate (6) | Xbox One, Xbox Series |
| An important part of the title is unavailable when using an account with a certain number of friends. | Critical (12) | Xbox One, Xbox Series |
| Unable to access essential or major features when using an account with a certain number of friends. | Catastrophic (22) | Xbox One, Xbox Series |
Notes
- This test case naturally overlaps others. If the 100 friends is used, log against this test case. Fails tend to be associated with friends list population and Leaderboards so consult those scenarios for guidance.
003-14 Local Multiple Players
| Scenario | Severity | Platform |
|---|---|---|
| The title does not support more than one player per console over the Xbox Network. | Not Relevant (-4) | Xbox One, Xbox Series |
| No current Scenario | Very Minor (1) | Xbox One, Xbox Series |
| Minor level of gameplay impact when the maximum amount of users conduct a session. | Minor (2) | Xbox One, Xbox Series |
| Moderate level of gameplay impact when the maximum amount of users conduct a session. | Moderate (6) | Xbox One, Xbox Series |
| Critical level of gameplay impact when the maximum amount of users conduct a session. | Critical (12) | Xbox One, Xbox Series |
| Sessions that support more than one player do not work. | Catastrophic (22) | Xbox One, Xbox Series |
| A second user cannot join a two player session. | Catastrophic (22) | Xbox One, Xbox Series |
Notes
- No current FMA Notes to consider.
003-16 Save Game Compatibility
| Scenario | Severity | Platform |
|---|---|---|
| Titles utilizes Persistent Local Storage (PLS) (see FMA notes for more info) as a long-term cache to store non-game-save data such as replays. If PLS is used to store replays, there is no expectation that replays will be available on another console or after the title has been uninstalled and reinstalled. PLS should not be used for storing other game-save data. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| Saves made on the updated version cannot be used on the base version, but saves are not lost or corrupted. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| The base version of the title crashes when loading a save made with the content-updated version of the title, but proper incompatibility messaging is displayed on the content-updated version of the title. | Not Relevant (-4) | Xbox One, Xbox Series, Windows |
| No current Scenario | Very Minor (1) | Xbox One, Xbox Series, Windows |
| Loss of gameplay progress when loading a save which does not require a significant amount of time to recover. | Minor (2) | Xbox One, Xbox Series, Windows |
| A misleading incompatibility message is shown when accessing a CU-made save game on the base, but no save data is lost. | Minor (2) | Xbox One, Xbox Series, Windows |
| The base version of the title crashes when loading a save made with the content-updated version of the title, and no incompatibility messaging is displayed on the content-updated version of the title. [Log under Title Stability] | Minor (2) | Xbox One, Xbox Series, Windows |
| A save made on the CU version of the title can be accessed on the base version, but a form of corruption occurs (for example, loss of gameplay progress). | Minor (2) | Xbox One, Xbox Series, Windows |
| Core or non-core option settings generated on a Content Updated version of the title reset when accessed on the base version, or vice versa. | Minor (2) | Xbox One, Xbox Series, Windows |
| No current Scenario | Moderate (6) | |
| No current Scenario | Critical (12) | |
| A save made on the base version of the title cannot be accessed on the CU version. | Catastrophic (22) | Xbox One, Xbox Series, Windows |
Notes
- Note that for digital only titles, users cannot experience the scenario of trying to load content-updated save on a previous version of the title as they can never revert back to it.
- [Windows] This test case only applies to Gamepass Submissions.
- PLS - Check that AppXManifest to verify that PLS is being allocated for the submission. What they use it for is not as important as long as other game-save data is saved using connected storage and is available on another console.
Example pulled from AppxManifest.xml:
<mx:PackageExtension Category=""xbox.storage""> <mx:Storage> <mx:PersistentLocalStorage SizeInMegabytes=""1024"" /> </mx:Storage> </mx:PackageExtension>
003-17 Headset State Change
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | |
| No current Scenario | Very Minor (1) | |
| The title exhibits minor audio corruption/distortion following a change in headset state which mildly detracts from the user experience but either resolves itself in a short amount of time or with little user interaction without termination. | Minor (2) | Xbox One, Xbox Series |
| The title exhibits moderate audio corruption/distortion following a change in headset state that detracts from the user experience. | Moderate (6) | Xbox One, Xbox Series |
| The title ceases to output audio through either the TV or headphones following a change in headset state. | Critical (12) | Xbox One, Xbox Series |
| The title exhibits severe audio corruption/distortion when a change in headset state occurs. | Critical (12) | Xbox One, Xbox Series |
| No current Scenario | Catastrophic (22) |
Notes
- No current FMA Notes to consider.
003-18 Headset State Change after Suspend
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | |
| No current Scenario | Very Minor (1) | |
| The title exhibits minor audio corruption/distortion following a change in headset state which mildly detracts from the user experience but either resolves itself in a short amount of time or with little user interaction without termination. | Minor (2) | Xbox One, Xbox Series |
| The title exhibits moderate audio corruption/distortion following a change in headset state that detracts from the user experience. | Moderate (6) | Xbox One, Xbox Series |
| The title ceases to output audio through either the TV or headphones following a change in headset state. | Critical (12) | Xbox One, Xbox Series |
| The title exhibits severe audio corruption/distortion when a change in headset state occurs. | Critical (12) | Xbox One, Xbox Series |
| No current Scenario | Catastrophic (22) |
Notes
- No current FMA Notes to consider.
003-19 Headset State Change after Connected Standby
| Scenario | Severity | Platform |
|---|---|---|
| No current Scenario | Not Relevant (-4) | |
| No current Scenario | Very Minor (1) | |
| The title exhibits minor audio corruption/distortion following a change in headset state which mildly detracts from the user experience but either resolves itself in a short amount of time or with little user interaction without termination. | Minor (2) | Xbox One, Xbox Series |
| The title exhibits moderate audio corruption/distortion following a change in headset state that detracts from the user experience. | Moderate (6) | Xbox One, Xbox Series |
| The title ceases to output audio through either the TV or headphones following a change in headset state. | Critical (12) | Xbox One, Xbox Series |
| The title exhibits severe audio corruption/distortion when a change in headset state occurs. | Critical (12) | Xbox One, Xbox Series |
| No current Scenario | Catastrophic (22) |
Notes
- No current FMA Notes to consider.