How to leverage whisper model to do prompt

Question

Hello, I see the news whisper model is available in OpenAI, I want to use it to do prompt because I want to make multi audio together, can you help with this?

Answer 1

Hello @Erik Engel

Thanks for reaching out to us, yes, I have answered your other post, please take a look and let me know if you have any question, you can do that in a easy way.

Please refer to the OpenAI cookbook -

https://github.com/openai/openai-cookbook/blob/main/examples/Whisper_prompting_guide.ipynb

Prompting Whisper is not the same as prompting GPT. For example, if you submit an attempted instruction like "Format lists in Markdown format", the model will not comply, as it follows the style of the prompt, rather than any instructions contained within.

In addition, the prompt is limited to only 224 tokens. If the prompt is longer than 224 tokens, only the final 224 tokens of the prompt will be considered; all prior tokens will be silently ignored. The tokenizer used is the multilingual Whisper tokenizer.

To get good results, craft examples that portray your desired style.

Please let me know if you have any questions regarding to the cookbook.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.