Plugins for ChatGPT, the new frontier | | | | Turtles AI

  OpenAI has announced the launch of plugins that connect ChatGPT to third-party applications, enhancing its capabilities to perform a wide range of actions. This can be regarded as a sort of "app store" for ChatGPT. These plugins enable ChatGPT to interact with APIs defined by developers, including retrieving real-time information like sports scores, stock prices, and the latest news, retrieving knowledge-base information like company documents and personal notes, and performing actions on behalf of the user like booking a flight or ordering food. The plugins are currently in a limited alpha and may not yet be accessible to users, but interested individuals can join the waitlist to get access. During the alpha, OpenAI will be working closely with users and developers to iterate on the plugin system, which may evolve significantly. To build a plugin, developers need to create a manifest file and host it at their domain. The file has to include metadata about the plugin, details about required authentication, and an OpenAPI spec for the endpoints to be exposed. Once registered in the ChatGPT UI, users can manually activate the plugin to start using it in their conversations. The model acts as an intelligent API caller and proactively calls the API to perform actions based on a natural-language description of when to use the API. The system will evolve to accommodate more advanced use cases over time. Additionally, the model may choose to invoke an API call from a relevant plugin when a user asks a relevant question. OpenAI hopes to build features to help users discover useful and popular plugins and is currently sending the user's country and state in the Plugin conversation header to enable further data sources like shopping, restaurants, weather, and more. The developer's terms of use provide more details on the consent screen required for these additional data sources.