Compact Llama instruction model for fast chat and local deployment
Details
| Field | Value |
|---|---|
| id | llama-3.1-8b-instant |
| family | llama |
| modality | text->text |
| context_length | 131072 |
| max_output_tokens | 131072 |
| quantization | unknown |
| knowledge_cutoff | 2023-12 |
| release_date | 2024-07-23 |
| is_open_weights | yes |
| supports_tool_call | yes |
| supports_reasoning | no |
| supports_structured_output | no |
| supports_attachment | no |
| input_modalities | text |
| output_modalities | text |