IT Career Guides & Free Resources
Expert roadmaps, tutorials, salary guides and interview prep across Data Science, Generative AI, Python, Cloud & Analytics — written by GloryTecks trainers in Hyderabad.
All articles
PySpark Tutorial: DataFrames, Transformations and Actions
A practical PySpark DataFrame tutorial on three million real New York taxi trips: declaring schemas, filtering and deriving columns with when and otherwise, grouped aggregation that exposes a trap in tip data, a join and a window function for top zones per borough, the same logic in Spark SQL, and the actions.
AWS Glue Jobs: PySpark on Serverless Spark
A practical guide to AWS Glue Spark jobs: what a job is, how the script is structured, when to use a DynamicFrame and when a DataFrame, how job bookmarks avoid reprocessing, and how workers and DPUs set the bill. The transform is written as plain PySpark and run locally on 2.96 million rows, then wrapped for Glue.
PySpark vs Pandas: When to Use Which
When to use PySpark and when to use pandas: the same hourly revenue query written in both and checked to give identical answers on three million taxi trips, the eightfold memory cost of loading the data into pandas, eager versus lazy execution, Arrow and toPandas, pandas API on Spark, and a decision guide.
PySpark Interview Questions with Examples
PySpark interview questions test the API details that decide whether a job is correct and fast. Seven are answered on a real two-million-row electricity file that fights back: a placeholder that turns numbers into strings, dates without leading zeros that Spark 3 will not parse, and a UDF that drags rows into Python.