LightGPT

LightGPT-instruct-6B is an AI language model created by AWS Contributors, building upon GPT-J 6B. Trained on the OIG-small-chip2 instruction dataset, it consists of approximately 200K high-quality examples with an Apache-2.0 license. This model generates text responses based on prompts with specific instructions, recognizing the completion when the prompt ends with "### Response:\n". LightGPT-instruct-6B is designed for English conversations and deployed easily on Amazon SageMaker with provided code samples. Evaluation metrics include LAMBADA PPL, LAMBADA ACC, WINOGRANDE, HELLASWAG, PIQA, and GPT-J. However, limitations exist, such as inaccurately following long instructions, giving incorrect answers to math and reasoning questions, and occasionally producing false or misleading responses. The model lacks contextual understanding but serves as a natural language generation tool for various conversational prompts. Users should remain aware of these limitations.