requirements/neuron.txt

# Common dependencies
-r common.txt

# Dependencies for Neuron devices
packaging>=24.2
setuptools>=77.0.3,<80.0.0
torch-neuronx >= 2.5.0
neuronx-cc>=2.0.0a0
torchvision # Required for Llama3.2 multimodal image preprocessing
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00			`# Common dependencies`
Move requirements into their own directory (#12547) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> 2025-03-08 17:44:35 +01:00			`-r common.txt`
[Misc] Define common requirements (#3841) 2024-04-05 00:39:17 -07:00
			`# Dependencies for Neuron devices`
[Neuron][Build] Require setuptools >= 77.0.3 for PEP 639 (#17603) Signed-off-by: Liangfu Chen <liangfc@amazon.com> 2025-05-02 19:41:59 -07:00			`packaging>=24.2`
			`setuptools>=77.0.3,<80.0.0`
[Docker] bump up neuron sdk v2.21 (#11593) Signed-off-by: Liangfu Chen <liangfc@amazon.com> 2024-12-29 21:46:14 -08:00			`torch-neuronx >= 2.5.0`
Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357) Signed-off-by: Satyajith Chilappagari <satchill@amazon.com> Co-authored-by: Aaron Dou <yzdou@amazon.com> Co-authored-by: Shashwat Srijan <sssrijan@amazon.com> Co-authored-by: Chongming Ni <chongmni@amazon.com> Co-authored-by: Amulya Ballakur <amulyaab@amazon.com> Co-authored-by: Patrick Lange <patlange@amazon.com> Co-authored-by: Elaine Zhao <elaineyz@amazon.com> Co-authored-by: Lin Lin Pan <tailinpa@amazon.com> Co-authored-by: Navyadhara Gogineni <navyadha@amazon.com> Co-authored-by: Yishan McNabb <yishanm@amazon.com> Co-authored-by: Mrinal Shukla <181322398+mrinalks@users.noreply.github.com> 2025-05-07 00:07:30 -07:00			`neuronx-cc>=2.0.0a0`
			`torchvision # Required for Llama3.2 multimodal image preprocessing`