All Inference optimization Listings

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Torch-Pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning

Open Source Inference optimization

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Open Source Inference optimization

BitNet

Official inference framework for 1-bit LLMs

Open Source Framework Inference optimization

llama.cpp

LLM inference in C/C++

Open Source Inference optimization

Listings per page

Showing1 - 4of4listings

Page 1 of 1

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Loading

...

Torch-Pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning

Open Source Inference optimization

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Open Source Inference optimization

BitNet

Official inference framework for 1-bit LLMs

Open Source Framework Inference optimization

llama.cpp

LLM inference in C/C++

Open Source Inference optimization

Listings per page

Showing1 - 4of4listings

Page 1 of 1

Filter

All Inference optimization Listings

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Loading

Filter

Torch-Pruning

smoothquant

BitNet

llama.cpp

Loading

Loading

Loading

Loading

Loading

Loading

Torch-Pruning

smoothquant

BitNet

llama.cpp