Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 99 repositories
- devenv Public
neuralmagic/devenv’s past year of commit activity - model-validation-configs Public
neuralmagic/model-validation-configs’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
neuralmagic/vllm’s past year of commit activity - nyann-bench Public
neuralmagic/nyann-bench’s past year of commit activity - nm-vllm-omni-ent Public Forked from vllm-project/vllm-omni
A framework for efficient model inference with omni-modality models
neuralmagic/nm-vllm-omni-ent’s past year of commit activity - vllm-openshift-recipes Public
neuralmagic/vllm-openshift-recipes’s past year of commit activity - gorilla Public Forked from ShishirPatil/gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
neuralmagic/gorilla’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…