Pandas to PySpark conversion — how ChatGPT saved my day!

Prosenjit Chakraborty
6 min readMar 28, 2023

I recently assisted a team in delivering an MVP to convert a portion of an existing business process from Python/Pandas to PySpark to run on cloud managed services. Unfortunately, I only had one day to convert a complex piece of functionality, and my PySpark coding skills were rusty. Halfway through, I realized that I had only a few hours left to deliver the converted code to the team. That’s…

--

--