Search results

Wanted to run LLMs in parallel by locking the chips while inferencing

Status: Open.

#105 In aws-neuron/transformers-neuronx;

· VenkateshPasumarti opened on Jan 31, 2025

Llama and Mistral model inputs change after using different computation

Status: Open.

#104 In aws-neuron/transformers-neuronx;

· kahfizulkifli opened on Dec 20, 2024

Neuron model NEFFs are dependent on the python path

Status: Open.

#99 In aws-neuron/transformers-neuronx;

· dacorvo opened on Oct 7, 2024

Gibberish output for princeton-nlp/Sheared-LLaMA-1.3B with continuous batching

Status: Open.

#94 In aws-neuron/transformers-neuronx;

· pinak-p opened on Jul 15, 2024

Not able to load llama 3 70b on inf2.24xlarge instance

Status: Open.

#92 In aws-neuron/transformers-neuronx;

· sangraamp opened on Jul 10, 2024

Any plan to support Qwen-2 Model

Status: Open.

#89 In aws-neuron/transformers-neuronx;

· mynewstart opened on Jun 27, 2024

llava support

Status: Open.

#88 In aws-neuron/transformers-neuronx;

· sonic182 opened on Jun 20, 2024

Latest changes introduced for continuous batching break Mixtral model

bugSomething isn't workingSomething isn't working

Status: Open.

#84 In aws-neuron/transformers-neuronx;

· dacorvo opened on Apr 15, 2024

Add support for Baichuan-13B model

Status: Open.

#83 In aws-neuron/transformers-neuronx;

· cszhz opened on Apr 9, 2024

Add support for gemma models

Status: Open.

#82 In aws-neuron/transformers-neuronx;

· benglewis opened on Apr 2, 2024

Improve Neuron model loading time

Status: Open.

#80 In aws-neuron/transformers-neuronx;

· dacorvo opened on Mar 13, 2024

Backward compatibility with saved llama 2 compiled artifacts

enhancementNew feature or requestNew feature or request

Status: Open.

#78 In aws-neuron/transformers-neuronx;

· dacorvo opened on Jan 18, 2024