Large Language Models (LLMs) like GPT-3 have shown significant potential in the task of few-shot Named Entity Recognition (NER), especially in low-resource settings where annotated data is sparse. While LLMs generally underperform compared to supervised methods when ample labeled data is available, their adaptability makes them useful for novel entity types that lack extensive annotations, such as those in biomedicine. The GPT-NER approach transforms NER into a generation task, which suits LLM capabilities, but still falls short against supervised models due to issues like hallucination. However, techniques like self-verification can mitigate some of these drawbacks, enhancing performance in few-shot scenarios. OpenAI's GPT series, particularly GPT-3, has been a focal point in these explorations, but results vary in few-shot settings, indicating no clear superior model. Researchers have also experimented with targeted distilling, using LLMs to train smaller models that outperform their original counterparts in specific tasks. The field remains ripe for exploration, with open-source LLMs offering promising avenues for further development, potentially revolutionizing NER approaches and impacting broader machine learning domains.