Ben Chuanlong Du's Blog

It is never too late to learn.

Rust for Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

candle

Candle is a minimalist ML framework for Rust with a focus on easiness of use and on performance (including GPU support).

dfdx

dfdx is an ergonomics & safety focused deep learning in Rust.

burn

burn is a flexible and comprehensive deep learning framework in Rust . It can leverage multiple backends so you can choose the best engine for your workload.

tch-rs

tch-rs is a Rust bindings for the C++ API of PyTorch.

linfa

BastionAI

BastionAI is a confidential deep learning framework that enables data scientists to train their models on sensitive data, while ensuring the data providers no third party will have access to these.

tract

tract is a Neural Network inference toolkit developed in Rust. It can read Tensorflow 1, ONNX or NNEF, optimize them and run data through them.

tensorflow/rust

tensorflow/rust is a Rust language binding for TensorFlow.

Other Python Libraries Based-on Rust Implementation

safetensors

SafeTensors implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).

tokenizers

Tokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

References

Comments