-
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 17 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 13 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 6 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 65
Guilherme Monteiro
guicybercode
AI & ML interests
smol-llms, llm-training, chinese-history, brazilian-history, production-ml, terminal-ui, data-curation, edge-ai
Recent Activity
commentedon a paper about 1 hour ago
PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States new activity about 5 hours ago
Horizon-Labs/prompt-injection-guard-base:Per-language false alarms and the int8 ONNX file on long inputs updated a Space about 9 hours ago
guicybercode/nl2bash-pt-explorerOrganizations
Key papers on small LLMs, data-centric training, and multilingual NLP.
-
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Paper • 2406.17557 • Published • 108 -
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper • 2502.02737 • Published • 261 -
The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
Paper • 2506.05209 • Published • 66
Multilingual models featuring Portuguese, Chinese, and other languages essential for cross-cultural historical research. Curated for fine-tuning on Ch
-
Qwen/Qwen2.5-0.5B
Text Generation • 0.5B • Updated • 1.23M • • 482 -
Qwen/Qwen2.5-0.5B-Instruct
Text Generation • 0.5B • Updated • 5.49M • • 709 -
Qwen/Qwen2.5-1.5B-Instruct
Text Generation • 2B • Updated • 4.94M • • 907 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 342k • 184
Datasets and an interactive explorer connecting Japan, Iceland, mathematics, technology, philosophy, Asian culture and Christian ethics.
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
Small language models (≤3B params) that can be fine-tuned or run locally for history-focused tasks. Curated for training on Chinese and Brazilian hist
-
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 1.81M • 259 -
HuggingFaceTB/SmolLM2-135M-Instruct
Text Generation • 0.1B • Updated • 1.19M • 458 -
HuggingFaceTB/SmolLM2-360M
Text Generation • 0.4B • Updated • 128k • 143 -
HuggingFaceTB/SmolLM2-360M-Instruct
Text Generation • 0.4B • Updated • 203k • 234
-
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 17 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 13 -
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 6 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 65
Datasets and an interactive explorer connecting Japan, Iceland, mathematics, technology, philosophy, Asian culture and Christian ethics.
Key papers on small LLMs, data-centric training, and multilingual NLP.
-
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Paper • 2406.17557 • Published • 108 -
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper • 2502.02737 • Published • 261 -
The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
Paper • 2506.05209 • Published • 66
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
Multilingual models featuring Portuguese, Chinese, and other languages essential for cross-cultural historical research. Curated for fine-tuning on Ch
-
Qwen/Qwen2.5-0.5B
Text Generation • 0.5B • Updated • 1.23M • • 482 -
Qwen/Qwen2.5-0.5B-Instruct
Text Generation • 0.5B • Updated • 5.49M • • 709 -
Qwen/Qwen2.5-1.5B-Instruct
Text Generation • 2B • Updated • 4.94M • • 907 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 342k • 184
Small language models (≤3B params) that can be fine-tuned or run locally for history-focused tasks. Curated for training on Chinese and Brazilian hist
-
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 1.81M • 259 -
HuggingFaceTB/SmolLM2-135M-Instruct
Text Generation • 0.1B • Updated • 1.19M • 458 -
HuggingFaceTB/SmolLM2-360M
Text Generation • 0.4B • Updated • 128k • 143 -
HuggingFaceTB/SmolLM2-360M-Instruct
Text Generation • 0.4B • Updated • 203k • 234