Whisper: OpenAI’s 3,000 WPM on 18 GPUs

Share

“Exploring the Performance of Different GPUs in AI-Based Transcription with OpenAI’s Whisper”

OpenAI has released an impressive new tool capable of generating Python code, aptly named the OpenAI API. This system, powered by models such as "gpt-3.5-turbo", can generate Python code with remarkable accuracy and efficiency. For developers and coders, this opens up an exciting new frontier of AI-assisted programming, where writing code can be as simple as describing what you want the program to do.

To use the OpenAI API, you need to make a call to the API endpoint specifying the model and providing a sequence of messages. This is done using OpenAI’s Python client. Here is an example:

import openai

openai.api_key = 'your-api-key'

response = openai.Completion.create(
  model="gpt-3.5-turbo",
  messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Write a Python function to calculate the factorial of a number."},
    ]
)

print(response['choices'][0]['message']['content'])

You can adjust the parameters max_tokens and temperature to control the length and randomness of the output respectively. The model parameter is set to "gpt-3.5-turbo" in this example, but it can be changed to use different models like "gpt-4" or "gpt-4-32k" based on your needs.

The OpenAI API not only generates code, but it also provides detailed references and examples to guide users. This is a significant advancement in the field of AI and programming, making the process of writing code more accessible and efficient.

Whisper, another project by OpenAI, has also been making waves. It provides real-time transcription of audio through the use of a GPU, with the entire process running locally for free. It can also be run on a CPU, although the speed drops significantly.

The process of running Whisper involves installing Miniconda, creating a new conda environment for Whisper, installing prerequisites, downloading OpenAI’s Whisper, and then transcribing an audio file by specifying the language, model, and device.

The advent of AI-powered tools like the OpenAI API and Whisper signals an exciting new era for programming and development. By providing the ability to generate code and transcribe audio locally for free, these tools are democratizing access to advanced technologies and enhancing the efficiency of coding processes. Whether you’re a seasoned developer or a novice coder, these tools offer promising potential for your coding journey.

Read more

Related Updates