Python Alternatives to Shell

Jan 03, 2019

Python Equivalent of Shell Commands

Shell Command	Alternative	Python
which git	shutil.which("git")	shutil
mkdir -p /path/to/file	Path("path/to/some/file").mkdir(exist_ok=True)	pathlib
	os.makedirs("/path/to/file", exist_ok=True)	os
	!mkdir -p /path/to/file	IPython
	mkdir -p /path/to/file	xonsh
cp …

Extracting PDF Pages Using the Python Package PyPDF

Aug 15, 2021

The Python package PyPDF can be used to extract pages from a PDF file. The function aiutil.pdf.extract_pages is a wrapper over PyPDF which makes it even easier to extract pages from a PDF file.

Read Tensorboard Logs

Sep 24, 2021

Using pandas.read_csv¶

This approaches requires you to have a running TensorBoard which is serving the data you want to read.

Check the checkbox "Show data download links". See highlighted in the top-left corner of the screenshot below for an example.
Select an experimentation whose you'd like to download. See highlighted in the bottom-right corner of the screenshot for an example.

Parse TOML Files in Python

Apr 26, 2021

There are 2 popular Python libraries tomlkit and toml for parsing TOML formatted files in Python. tomlkit is preferred to toml as it is more flexible and style-preserving.
A TOML file always interpret a key (even a bare ASCII integer) as string. For this reason, a dict with numerical keys …

Manipulate Videos Using MoviePy in Python

Apr 06, 2020

Installation¶

Process Big Data Using PySpark

Apr 30, 2021

PySpark 2.4 and older does not support Python 3.8. You have to use Python 3.7 with PySpark 2.4 or older.
It can be extremely helpful to run a PySpark application locally to detect possible issues before submitting it to the Spark cluster.
```
#!/usr/bin/env bash …
```

← Older Newer →

Ben Chuanlong Du's Blog

And let it direct your passion with reason.