Inference Optimization

inference-optimization's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

MeganEFlynn 

updated a model 1 day ago

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

4B • Updated 1 day ago • 67

ChibuUkachi 

updated a model 2 days ago

inference-optimization/Ministral-3-14B-Instruct-2512-NVFP4

Text Generation • Updated 1 day ago • 301

MeganEFlynn 

published a model 3 days ago

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

4B • Updated 1 day ago • 67

kylesayrs 

updated a model 3 days ago

inference-optimization/Qwen3-1.6B-A0.9B

Text Generation • 2B • Updated 3 days ago • 75

kylesayrs 

published a model 3 days ago

inference-optimization/Qwen3-1.6B-A0.9B

Text Generation • 2B • Updated 3 days ago • 75

kylesayrs 

updated a model 4 days ago

inference-optimization/gemma-4-1B-0.8B-tiny

1B • Updated 4 days ago • 10 • 1

kylesayrs 

published a model 4 days ago

inference-optimization/gemma-4-1B-0.8B-tiny

1B • Updated 4 days ago • 10 • 1

MeganEFlynn 

updated a dataset 6 days ago

inference-optimization/Gemma4-Responses-Nemotron

Viewer • Updated 6 days ago • 762k • 51 • 1

MeganEFlynn 

published a dataset 6 days ago

inference-optimization/Gemma4-Responses-Nemotron

Viewer • Updated 6 days ago • 762k • 51 • 1

ChibuUkachi 

updated a model 8 days ago

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated 8 days ago • 63

ChibuUkachi 

published a model 8 days ago

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated 8 days ago • 63

ChibuUkachi 

updated 2 models 8 days ago

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated 8 days ago • 198

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated 8 days ago • 192

alexmarques 

updated a model 8 days ago

RedHatAI/Qwen3-235B-A22B-Instruct-2507-quantized.w8a8

Text Generation • 235B • Updated 8 days ago • 119

ChibuUkachi 

updated a model 8 days ago

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated 8 days ago • 176

ChibuUkachi 

updated a model 8 days ago

RedHatAI/Qwen3-235B-A22B-Instruct-2507-quantized.w8a8

Text Generation • 235B • Updated 8 days ago • 119

MeganEFlynn 

updated a dataset 8 days ago

inference-optimization/Longbench_Samples_Specdec

Viewer • Updated 8 days ago • 160 • 55

krishnateja95 

updated 3 models 8 days ago

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-noise

Image-Text-to-Text • 32B • Updated 8 days ago • 131

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-hybrid

Image-Text-to-Text • 32B • Updated 8 days ago • 127

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-heuristic

Image-Text-to-Text • 32B • Updated 8 days ago • 158