Writing on AI systems, data engineering, ETL design, architecture tradeoffs, and lessons from building production software.
One of the most exciting breakthroughs in large language models (LLMs) is the concept of Chain of Thought (CoT) reasoning. Instead of jumping directly from input to output, CoT ena...
Read Featured Article
As artificial intelligence continues to evolve, one of the most fascinating developments is the concept of agentic memory . Just like humans rely on different types of memory to th...
Read Article
In the fast-paced world of project management, the role of a Project Manager (PM) is pivotal. They are responsible not only for steering a project to success but also for building ...
Read Article
In our exploration of ETL best practices , we’ve covered strategies like incremental loading, data validation, and transformation. But when dealing with truly large datasets, one o...
Read Article
In our journey to build efficient and reliable ETL pipelines , one crucial step often overlooked is data validation and cleansing . No matter how well your data is extracted or loa...
Read Article
In our quest to maximize ETL efficiency , incremental loading plays a pivotal role. But what exactly is incremental loading, and why is it so important? Why are engineers ditching ...
Read Article
Effective ETL (Extract, Transform, Load) processes are crucial for robust data pipelines. Here are three best practices to maximize ETL efficiency: Incremental Loading: Instead of ...
Read Article
Pandas module is a well-liked open-source tool for handling and analyzing data. It offers effective tools for manipulating tabular data, such as the ability to read and write data ...
Read Article