Convert MRTK button from MR device to PC mouse and touch

Question

Convert MRTK button from MR device to PC mouse and touch

NG KEI CHI [THEi/LCDI] 26

We have developed an app for HoloLens 2 and used MRTK button.
Now, we need to convert it to PC version with mouse and touch.

Is there any easy way to convert MRTK button interact with mouse and touch?

Zuocheng Wang - MSFT 3,091 Reputation points Microsoft External Staff

2022-11-14T08:55:53.78+00:00

Hello, Welcome to Microsoft Q&A,

May I ask what is the scenario? Would you share more details? The input system in MRTK provides functions such as custom Data providers, custom controller mapping, etc., so that the project can use different devices on different platforms, or support multiple input devices on a single platform, please refer to Input System Terminology - MRTK 2 | Microsoft Learn to learn more. For your needs, you can try to add the Unity Mouse Device Manager and add a mapping for the Mouse Controller. About the Unity Touch Device Manager, it refers to the touch method on the mobile side. If this is not what you want, you can add a custom Data Provider, please refer to Creating an input system data provider - MRTK 2 | Microsoft Learn.

----
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
NG KEI CHI [THEi/LCDI] 26 Reputation points

2022-11-15T07:30:07.133+00:00

I have follow https://learn.microsoft.com/en-us/training/paths/beginner-hololens-2-tutorials to create the Unity project and deploy to HoloLens 2 as below:

And I create the button from MRTK Mixed reality toolkit as the picture below:

The targeting code as below:

ResourcesManager.MAIN.partsActionData[Buttonindex].ActionButton.GetComponent<ButtonConfigHelper>().OnClick.AddListener
(delegate {buttonOnPressed(Buttonindex);} );

Now, I need to convert the app to PC version as below:

User can click the buttons by mouse or touch to control the 3D models.
They cannot navigate through the 3D world in the PC version.

2 answers

Your answer

Zuocheng Wang - MSFT 3,091 Reputation points Microsoft External Staff

2022-11-14T08:55:53.78+00:00

Hello, Welcome to Microsoft Q&A,

May I ask what is the scenario? Would you share more details? The input system in MRTK provides functions such as custom Data providers, custom controller mapping, etc., so that the project can use different devices on different platforms, or support multiple input devices on a single platform, please refer to Input System Terminology - MRTK 2 | Microsoft Learn to learn more. For your needs, you can try to add the Unity Mouse Device Manager and add a mapping for the Mouse Controller. About the Unity Touch Device Manager, it refers to the touch method on the mobile side. If this is not what you want, you can add a custom Data Provider, please refer to Creating an input system data provider - MRTK 2 | Microsoft Learn.

----
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
NG KEI CHI [THEi/LCDI] 26 Reputation points

2022-11-15T07:30:07.133+00:00

I have follow https://learn.microsoft.com/en-us/training/paths/beginner-hololens-2-tutorials to create the Unity project and deploy to HoloLens 2 as below:

And I create the button from MRTK Mixed reality toolkit as the picture below:

The targeting code as below:

ResourcesManager.MAIN.partsActionData[Buttonindex].ActionButton.GetComponent<ButtonConfigHelper>().OnClick.AddListener
(delegate {buttonOnPressed(Buttonindex);} );

Now, I need to convert the app to PC version as below:

User can click the buttons by mouse or touch to control the 3D models.
They cannot navigate through the 3D world in the PC version.

Answer 1

NG KEI CHI [THEi/LCDI] 26

I find an answer by myself.
Just add a Unity Mouse Device Manager in MixedRealityToolkit > Inspectror > MixedRealityTookit > Input > Input Data Providers as the picture below

Answer 2

Hello, Welcome to Microsoft Q&A,

Base on the information you have shared, you require dedicated support on MRKT usage. The hololens-development tag is specifically about writing HoloLens applications. For help with MRTK outside of HoloLens please see the options at Engage with the Community in the MRTK documentation.

----
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Share via

Convert MRTK button from MR device to PC mouse and touch

2 answers

Your answer