IT Career Guides & Free Resources
Expert roadmaps, tutorials, salary guides and interview prep across Data Science, Generative AI, Python, Cloud & Analytics — written by GloryTecks trainers in Hyderabad.
All articles
Partitioning and Clustering in BigQuery
Partitioning splits a BigQuery table into segments that a query can skip; clustering sorts the storage blocks inside them. This guide explains both, measures the effect with a model on 2.9 million real trip rows, shows why clustering column order matters, and lists the filters that quietly stop pruning.
Parquet and Partitioning for Cheaper Athena Queries
Athena bills by the bytes each query scans, so file format decides most of the bill. This guide measures a real 2,964,624-row taxi file as CSV, gzipped CSV and Parquet, shows how few bytes a two-column query needs in a columnar file, and gives the CTAS statement that converts a table, with the limits to know.
Partitioning Data in S3 for Athena Performance
A practical guide to partitioning S3 data for Athena: what a partition is, how to choose keys, and how partitions are registered. A real month of taxi trips is partitioned by day and by hour to show pruning, a filter that prunes nothing, stray partitions from bad timestamps, and the small-file cost of going too fine.
Data Partitioning Strategies in ADF Copy Activity
A large table copied through one query is limited by one connection. This guide explains the partition options of the Azure Data Factory Copy activity, how dynamic range bounds really work, how to choose a partition column, with skew measured on 2.9 million real rows, and how partitioning applies to files.
Partitioning and Bucketing in Spark Explained
“Partition” means three different things in Spark: in-memory partitions, directory partitions on disk, and buckets. What each one controls, which setting or method changes it, and how to choose partition and bucket columns without creating millions of small files.