IT Career Guides & Free Resources
Expert roadmaps, tutorials, salary guides and interview prep across Data Science, Generative AI, Python, Cloud & Analytics — written by GloryTecks trainers in Hyderabad.
All articles
ADF Data Flow Transformations: A Complete Reference
A reference to the transformations available in Azure Data Factory mapping data flows, grouped by task: shaping columns, filtering and marking rows, combining streams and handling nested data. Each has its SQL equivalent and the documented detail worth knowing, with row counts from a real example.
Handling Errors and Retries in ADF Pipelines
Error handling in Azure Data Factory has a trap: a pipeline can catch a failure, send an alert and still be reported as succeeded. This guide covers retry and timeout settings, the four conditional paths, the rule that decides a pipeline's status, modelled across four patterns, and the Fail activity.
Pipeline Dependencies and Scheduling in ADF
Scheduling in Azure Data Factory works at three levels: dependencies between activities, pipelines calling pipelines, and triggers. This guide covers the four dependency conditions, Execute Pipeline, the three trigger types and how they differ, schedule recurrence and time zones, and patterns for ordering work.
ADF Logging and Auditing for Compliance
An audit asks four things of a data pipeline: what ran, who changed it, what data moved and who had access. This guide maps each question to the record Azure Data Factory can produce, its retention, and the settings that must be on before the evidence exists, with a session log analysed as an example.
Building a Metadata Framework for ADF Pipelines
A control table and a ForEach copy many tables. A framework is what makes that safe to operate: configuration you can validate, a log of every load, stages that run in order, and reruns that resume instead of repeating. This guide designs each part for Azure Data Factory, with the restart logic shown working.
Connecting ADF to REST APIs and Web Sources
Azure Data Factory has four ways to talk to a web endpoint, and choosing the wrong one is the usual first mistake. This guide separates the REST connector, the HTTP connector, the Web activity and the Webhook activity, explains pagination rules with a working simulation, and lists the documented limits.