AI agents

Teaching an AI Scraper from Human Corrections

Rishi Jain

AI AI Agents LLM Web Scraping

When an admin fixes a wrong value in an AI scraper's sample events, that edit can do more than fix one event. Here is how

Read the Post

AI Agents Artificial Intelligence Data Engineering Ethics And Responsible AI Generative AI Machine Learning OmbuLabs Culture Ruby On Rails Security And Privacy Software Development

Articles about Data Engineering

Explore how we build the data foundations that make AI and machine learning possible. Data engineering is about collecting, cleaning, and organizing raw information so it's reliable and ready for analysis. In this category, you'll find posts on pipelines, storage strategies, and best practices for making data usable at scale. Most come out of client projects where the data turned out to be messier than the model, so they stay practical: what breaks after a pipeline has run daily for a year, and how to tell a data problem from a model problem.

Data Engineering

Airflow on Google Kubernetes Engine, No Helm

Amanda Bizzinotto

Google Cloud Platform (GCP) can be a very good option for Airflow and, although it offers its own managed deployment of Airflow, Cloud Composer, managing

Data Engineering AIrflow Kubernetes