Joel McCune
  • Home
  • About
  • Python
  • Whitewater
  • Geography Matters
  • F-150 Plan
Sign in Subscribe

Spark

A collection of 1 post
Copy PySpark Schemas to Clipboard
Python

Copy PySpark Schemas to Clipboard

Frequently, I have a need to both explicitly define input data schemas for processing using PySpark and simultaneously include the schema in Sphinx documentation. Usually I can get the schema for loading without too much difficulty by outputting df.schema in a Jupyter Notebook, and copy-paste into my loading method.
29 Jan 2024 1 min read
Page 1 of 1
Joel McCune © 2025
Powered by Ghost