Ben Chuanlong Du's Blog

And let it direct your passion with reason.

Useful Visual Studio Code Extensions

Places to Find Extensoins

Visual Studio Code Marketplace and Open VSX Registry are 2 places to find VSCode compatible extensions.

Install VSCode Extensions from Command-line

https://stackoverflow.com/questions/34286515/how-to-install-visual-studio-code-extensions-from-command-line/34339780#34339780

Install Code-Server Extensions from Command-line

If you install extension in Dockerfile using root, the extensions are installed …

Types of Joins of Spark DataFrames

Comments

  1. It is suggested that you always pass a list of columns to the parameter on even if there's only one column for joining.

  2. None in a pandas DataFrame is converted to NaN instead of null!

  3. Spark allows using following join types:

    • inner (default)
    • cross
    • outer
    • full, fullouter, full_outer
    • left, leftouter, left_outer
    • right, rightouter, right_outer
    • semi, leftsemi, left_semi
    • anti, leftanti, left_anti