The Strange Review
Posts
Open AI's app store moment, turbocharges capabilities with GPT Turbo and Vision API

Open AI's app store moment, turbocharges capabilities with GPT Turbo and Vision API

Now you can monetize on the Open AI app store. Figma launches Figjam AI

Tara Tan
November 09, 2023

Open AI's App Store moment is here. At the company’s first ever Dev Day on Monday, Open AI announced GPTs, a no-code, custom-GPT builder for anyone to create their own ChatGPT — and make money from it.

This classic platform playbook move is resonant of the early days of the iOS and Shopify app stores, and feels like a gold rush moment for app / GPTs builders to monetize on the marketplace. OpenAI plans to do a rev share with the GPTs who get top usage.
This is at the same time a great way for Open AI to extend their ecosystem, and get more proprietary data for model training. Having said that, builders and users can opt out of being used for model training.

And there’s more. Open AI also announced:

New GPT-4 Turbo model that is more capable, cheaper and supports a 128K context window
New Assistants API that makes it easier for developers to build their own assistive AI apps that have goals and can call models and tools
New multimodal capabilities in the platform, including vision, image creation (DALL·E 3), and text-to-speech (TTS)

Within 11 hours of the Dev Day keynote announcement, builders have made some incredible apps with the new releases. Here are a few of my favorite prototypes from live event narration to the myriad of use cases for Vision API. What a wild ride.

GPT-4V + TTS = AI Sports narrator 🪄⚽️
Passed every frame of a football video to gpt-4-vision-preview, and with some simple prompting asked to generate a narration
No edits, this is as it came out from the model (aka can be SO MUCH BETTER)
— Gonzalo Espinoza Graham 🏴‍☠️ (@geepytee)
1:45 AM • Nov 7, 2023

WebcamGPT:
Use the new GPT-4 Vision API to actively recognize what's happening in real-time....
This is a live web demo. Try it yourself, link in comments. twitter.com/i/web/status/1…
— Benjamin De Kraker (@BenjaminDEKR)
2:29 AM • Nov 7, 2023

's GPT-4-Vision is a literal game changer. I was able to hack together this flow of doing low fidelity mock up -> actual html in like < 5 hours of the api being available. The future is bright.
— Sawyer Hood (@sawyerhood)
2:34 AM • Nov 7, 2023

Here's a demo of the gpt-4-vision API that I built in
@bubble in 30 min.
It takes a URL, converts it to an image, and sends it through the Vision API to respond with custom landing page optimization suggestions.
— Seth Kramer (@sethjkramer)
10:55 PM • Nov 6, 2023

🔥 Latest News

App Store for AI: OpenAI’s GPT Store lets you build (and monetize) your own GPT. OpenAI took the leash (and the “Chat”) off ChatGPT today with the announcement of GPTs, a way for anyone to build their own version of the popular conversational AI system. Not only can you make your own GPT for fun or productivity, but you’ll soon be able to publish it on a marketplace they call the GPT Store — and maybe even make a little cash in the process. https://tcrn.ch/3tVxmaU
Microsoft to bring Inworld generative game AI to Xbox empire. Microsoft announced a multi-year partnership with AI gaming startup Inworld AI that will let developers use generative neural networks to create characters, dialog, and adventures for Xbox games. Founded in 2021 and backed by M12, Microsoft's venture capital arm, Inworld AI has been trying to make a "fully integrated character engine" that can produce non-player characters based on input text descriptions. https://tinyurl.com/3xskuuz6

Elon Musk unveils Grok, an AI chatbot with a ‘rebellious streak’. Elon Musk is inspired by The Hitchhiker’s Guide to the Galaxy. The Tesla CEO said the competitor to ChatGPT would be made available to premium subscribers on his X platform after testing. Musk also revealed that Grok had access to user posts on X, which he owns, and has a penchant for sarcastic responses. https://tinyurl.com/mr3radc5

Runway unveils a significant upgrade to its Gen-2 text-to-video generator. The latest enhancements center on elevating the realism and precision of AI-generated videos, with users reporting a resolution boost from 1792×1024 to an impressive 2816×1536. This remarkable leap in resolution empowers the generation of intricate details and seamless motion within the virtual landscape. Runway has also fine-tuned its “Director Mode” feature, which was initially introduced in September, for more lifelike camera movements. https://tinyurl.com/yckst3hn

🔧 Cool Tools and Experiments

Plai Labs launches a text-to-video generator, PlaiDay, that uses selfies to personalize content https://tcrn.ch/3QkEG7q

MidJourney tests Style Tuner that allows users to generate their unique visual style and apply it to images generated in the application https://tinyurl.com/mvbvpjwa

PepsiCo unveils Doritos Silent: AI-powered crunch cancellation software for gamers https://tinyurl.com/yjyphw9d

PopSockets introduces an AI Customizer tool that will allow anyone to design their next phone accessory, including grips, cases and wallets, via an optimized version of Stable Diffusion XL (SDXL) https://tcrn.ch/3sqe0uk

Portalis.AI launches AI avatars that can have a conversation with humans as well as their lifelike, fully interactive, and animated digital avatars https://tinyurl.com/3wwurntn

💰 Latest Startup Fundings

GFR Fund raises $53.5M to invest in games and entertainment https://tinyurl.com/mt5cwuwx

Captions, an AI video generation application, raises $25M in Series B funding led by Kleiner Perkins https://tinyurl.com/2ze9syh8

IBM, which invested in Hugging Face, launches $500M enterprise AI venture fund https://tinyurl.com/2cwwdj3z

Aleph Alpha, a Germany-based leader in the field of explainable and trustworthy AI, raises over $500M in Series B financing https://tinyurl.com/3bkfwydy