OpenAI recently unveiled a new ChatGPT API, prompting comparisons with the existing GPT-3 API in question-answering tasks. The evaluation focused on the "generation" step of a question-answering chain, using the text-davinci-003 model and ChatGPT with VectorDBQAChain prompts. The ChatGPT API distinguishes itself by using a list of messages with distinct roles—user, system, and assistant—compared to the single string input of GPT-3. In testing, ChatGPT and GPT-3 were evaluated for their ability to answer questions generated from a dataset, with results showing slight differences in grading between the two models. GPT-3 was noted for being succinct, while ChatGPT provided more detailed and polite responses, though the evaluation was limited by a small sample size. The study highlighted the need for further exploration of the ChatGPT API's role parameter and its optimal use, as well as the development of suitable abstractions for this new API paradigm.