Ben Chuanlong Du's Blog

It is never too late to learn.

Rust for Machine Learning

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

candle

Candle is a minimalist ML framework for Rust with a focus on easiness of use and on performance (including GPU support).

dfdx

dfdx is an ergonomics & safety focused deep learning …

Hardware for AI

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

TVM for deep learning is kind of like LLVM for programming languages.

Nvidia TensorRT

Embedded/Edge AI

Jetson Nano

Google Coral

Intel Neural Compute Stick 2

https://heartbeat.fritz.ai/edge-tpu-google-coral-usb-accelerator-cf0d79c7ec56 …

Loss Functions for Machine Learning Models

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Tips and Traps

  1. A Loss function is always non-negative. If you get a negative loss when training a model, there must be something wrong with the code. For example, maybe you …

Entropy

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Entropy
  2. Shannon Entropy
  3. Cross Entropy
  4. K-L divergence

Tips

  1. The entropy concept was first introduced for discrete distributions (called Shannon entropy), which is defined as

    $$H(X) = E …