software-mansion/react-native-executorch-eurollm

eurollm

This repository hosts the eurollm models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Upstream model: utter-project/EuroLLM-1.7B-Instruct

Variants

Path	Backend	Precision
1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte	xnnpack	8da8w
1_7b/mlx/eurollm_1_7b_mlx_int8.pte	mlx	int8

Unshipped backends

A backend directory carrying a NOTES.md and no .pte was exported and not published. Its note records why.

• 1_7b/vulkan (why)

Repository structure

1_7b/mlx/config.json                          1.5 kB
1_7b/mlx/eurollm_1_7b_mlx_int8.pte            1.7 GB
1_7b/tokenizer.json                           8.2 MB
1_7b/tokenizer_config.json                    47.4 kB
1_7b/vulkan/NOTES.md                          261 B
1_7b/xnnpack/config.json                      1.5 kB
1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte   1.7 GB
config.json                                   29 B

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.

Export notes

Weights are 8-bit: 4-bit (8da4w) lost 6-9 BLEU on WMT13 en->de and often failed to stop. XNNPACK uses dynamic int8 activations with per-channel int8 weights; MLX uses int8 weight-only. For translation, prompt it as the model card does, without a BOS token:

<|im_start|>system\n<|im_end|>\n<|im_start|>user\nTranslate the following English source text to German:\nEnglish: {text} \nGerman: <|im_end|>\n<|im_start|>assistant\n