responsible ai tool integration

Question

I have seen the demo of responsible ai but is there any plan to make the error analysis, metrics together so that we can see it as a report? Currently if you want this data you need to check everywhere which is not making any sense.

Answer 1

@luteberg

Thanks for reaching out to us, I think we have a dashboard already to integrate everything together.

The Responsible AI Toolbox for text data is a customizable, interoperable tool where you can select components to perform analytical functions for Model Assessment and Debugging, which involves determining how and why AI systems behave the way they do, identifying and diagnosing issues, then using that knowledge to take targeted steps to improve their performance.

Each component has a variety of tabs and buttons. The article will help to familiarize you with the different components of the dashboard and the options and functionalities available in each.

Please see the github for more information - https://github.com/microsoft/responsible-ai-toolbox

Useful Links

• Take a tour of Responsible AI Dashboard
• Get started

Tabular Examples:

• Try the tool: make decisions for house improvements (decision making)
• Try the tool: provide recommendations to patients using diabetes data (decision making)
• Try the tool: model debugging of a census income prediction model (classification)
• Try the tool: model debugging of a housing price prediction model (classification)
• Try the tool: model debugging of a diabetes progression prediction model (regression)

Text Examples:

• Try the tool: model debugging of an OpenAI Question Answering model on SQuAD
• Try the tool: model debugging of a HuggingFace Question Answering model on SQuAD
• Try the tool: model debugging of a DBPedia text classification model
• Try the tool: model debugging of a binary text classification model
• Try the tool: model debugging of a COVID-19 multilabel text classification model

Vision Examples:

• Try the tool: model debugging of a fridge image classification model
• Try the tool: model debugging of a fridge multilabel image classification model
• Try the tool: model debugging of a fridge object detection model

I hope this helps.

Regards,

Yutong

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.