Home » Tips & Tricks » GPT 4 image input: does it work with ChatGPT?

GPT 4 image input: does it work with ChatGPT?

We look at GPT 4's possibilities, the technology behind it, and how you can get involved

Updated: May 25, 2023 10:02 am
GPT 4 image input: does it work with ChatGPT?

WePC is reader-supported. When you buy through links on our site, we may earn an affiliate commission. Prices subject to change. Learn more

Are you curious about the latest advancements in OpenAI Multi-Model GPT 4? Then, you might be interested in learning about GPT-4 image input, a new feature that allows for the processing of both image and text input. 

GPT-4’s multimodal capability can process various types and sizes of images, including documents with text and photographs, hand-drawn diagrams, and screenshots. With this feature, the Model can receive both text and visual inputs and generate an output that is just as capable as text-only inputs. 

In this article, we will explore the possibilities of GPT-4 image input, the technology behind it, and how it can be made possible. 

GPT 4 image input & the technology

So, what can GPT-4 do? Well, you can input a unique image alongside a set of clear instructions, questions, or opinions, and receive a structured answer that uses both sets of data as inputs. This opens up a wide range of possibilities, from asking GPT-4 to understand the context of an image to analyze data presented in a graph. 

For instance, you can input an image of a pattern of shapes and ask GPT-4 which shape completes the pattern. GPT-4’s ability to interpret and understand images is a significant breakthrough in the field of AI. During a developer live stream organized by OpenAI, GPT-4 demonstrated its ability to describe a screenshot of a Discord window in great detail. 

The model took a little over a minute to process the input and generated an extremely accurate and descriptive response. The response captured almost every element of the input screen, from the server’s name on the top left corner to the different voice channels, and even named all of the Discord members online in the right sidebar.

image

In an example to showcase the capabilities of GPT-4’s image input and processing, OpenAI’s GPT-4 technical review presented an example of the popular meme, “World map made up of chicken nuggets.”  GPT-4 was able to interpret the image and generate an accurate response that captured the humor and unexpected juxtaposition of the text and the image. 

It identified the meme as a joke that combined two unrelated things and explained that the image was actually of chicken nuggets arranged to resemble a map of the world.  GPT-4’s ability to process such visual and textual inputs and generate a structured output shows its immense potential in various applications, from media analysis to social media monitoring and beyond. 

READ NOW: Can Chat GPT be detected by Turnitin?

image

Does GPT 4 image input work with ChatGPT?

ChatGPT Plus powered by GPT-4 does not currently allow users to input images through the user interface. As GPT-4 continues to be trained and developed, its image processing capabilities are expected to improve, there is a possibility that this feature could be added in the future but we cannot speak for OpenAI’s plans with the service. As of now when we are aware of the fact that GPT-4 image input functionality is not yet available to the general public.

Open AI is not offering GPT 4 image input as a service right now, however, it is a common question. There has already been a great deal of interest around image input so we could easily see a feature appear in the near future to support demand.

So, what are our options and how do you input an image to ChatGPT? One way to attempt image entry to ChatGPT is through prompts.

How to use GPT 4 image input

At the time of writing GPT-4 image input is not available to the general public. Despite ChatGPT Plus being based upon the GPT-4 framework, it does not have the ability to process image-based prompts as of yet. The fact that OpenAI have been showing off the multimodal capabilities of GPT-4 does suggest that they intend to make this feature available in the future.

Currently, the only way to access the image processing capabilities of GPT 4 is through GPT-4 API which is only available to developers. We have our fingers crossed in hopes that image input will be available to everyone soon though!

Does ChatGPT create images?

No, that is not what ChatGPT is. It is a simple text-generation tool. As mentioned, ChatGPT has the capability to suggest the perfect prompt for what you might need when using a tool like Midjourney or DALL-E. It makes sense to assume there will be an all-encompassing tool in the future that allows a variety of inputs and delivers a variety of outputs right back but there is no mention of this anywhere just yet.

Can ChatGPT make art?

As previously mentioned, if we’re talking about visual art then unfortunately ChatGPT is not cut out for it. ChatGPT is currently an entirely text based chatbot which means you can neither input images or expect the software to create them for you. You could however use ChatGPT in conjunction with AI image software, using ChatGPT to create prompts and then inputting them into another program. ChatGPT is also a fantastic resourse for helping you flesh out you own ideas for artwork. If you are struggling for inspiration you could ask ChatGPT to give you some ideas and then continue to use the software to flesh out one of said ideas.

If we’re talking about art in the broader sense of the term then some people would argue that yes ChatGPT is capable of creating art. Many people have been using ChatGPT to create poetry and also using ChatGPT to help write music music. If your prompts are specific enough you might be surprised at how good the AI chatbot is at writing verse.

What is GPT 4 being used with so far?

You can read more about the above applications and how GPT 4 is being implemented here.

How do you access GPT 4?

GPT 4 is a developer tool only available to those who have subscribed for ChatGPT Plus. You will have to join a waitlist, which OpenAI requires you to sign up to.

Is GPT 4 free to use?

GPT 4 requires a monthly subscription to ChatGPT Plus to access, however, at the moment requires no more on top.


Shaun, with a computer science degree and 15 years of computer experience, has been passionate about competitive FPS gaming since the mid-2000s.

Trusted Source

WePC’s mission is to be the most trusted site in tech. Our editorial content is 100% independent and we put every product we review through a rigorous testing process before telling you exactly what we think. We won’t recommend anything we wouldn’t use ourselves. Read more