Edit

Share via

What's new in Azure AI Studio?

  • Article

Note

Azure AI Studio is currently in public preview. This preview is provided without a service-level agreement, and we don't recommend it for production workloads. Certain features might not be supported or might have constrained capabilities. For more information, see Supplemental Terms of Use for Microsoft Azure Previews.

Azure AI Studio is updated on an ongoing basis. To stay up-to-date with recent developments, this article provides you with information about new releases and features.

February 2024

Azure AI hub

Azure AI resource is renamed Azure AI hub resource. For additional information about the Azure AI hub resource, check out the Azure AI hub resource documentation.

January 2024

Benchmarks

New models, datasets, and metrics are released for benchmarks. For additional information about the benchmarks experience, check out the model catalog documentation.

Added models:

  • microsoft-phi-2
  • mistralai-mistral-7b-instruct-v01
  • mistralai-mistral-7b-v01
  • codellama-13b-hf
  • codellama-13b-instruct-hf
  • codellama-13b-python-hf
  • codellama-34b-hf
  • codellama-34b-instruct-hf
  • codellama-34b-python-hf
  • codellama-7b-hf
  • codellama-7b-instruct-hf
  • codellama-7b-python-hf

Added datasets:

  • truthfulqa_generation
  • truthfulqa_mc1

Added metrics:

  • Coherence
  • Fluency
  • GPTSimilarity

November 2023

Benchmarks

Benchmarks are released as public preview in Azure AI Studio. For additional information about the Benchmarks experience, check out Model benchmarks.

Added models:

  • gpt-35-turbo-0301
  • gpt-4-0314
  • gpt-4-32k-0314
  • llama-2-13b-chat
  • llama-2-13b
  • llama-2-70b-chat
  • llama-2-70b
  • llama-2-7b-chat
  • llama-2-7b

Added datasets:

  • boolq
  • gsm8k
  • hellaswag
  • human_eval
  • mmlu_humanities
  • mmlu_other
  • mmlu_social_sciences
  • mmlu_stem
  • openbookqa
  • piqa
  • social_iqa
  • winogrande

Added tasks:

  • Question Answering
  • Text Generation

Added metrics:

  • Accuracy

Related content