DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Pytest pt3 - Writing Cleaner Tests with Parametrization and Temporary Files
felipe_de_godoy profile

Pytest pt3 - Writing Cleaner Tests with Parametrization and Temporary Files

#dataengineering #python #testing #tutorial
Comments
4 min read
The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production
dcmerritt profile

The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production

#databricks #dataengineering #spark #career
Comments
6 min read
Building a Production Data Pipeline with Incremental Loading and dbt
bobby_ray_581732c715283b2 profile

Building a Production Data Pipeline with Incremental Loading and dbt

#dataengineering #python #dbt #airflow
Comments
3 min read
Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.
fagundesv profile

Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.

#ai #data #dataengineering #python
1
Comments
4 min read
Python batch를 Spark로 옮겼더니 802.675가 달라졌다
junhyun-dev profile

Python batch를 Spark로 옮겼더니 802.675가 달라졌다

#dataengineering #spark #apacheiceberg #airflow
Comments
3 min read
A CSV quality report should not echo the data it rejects
square12_82a85fc8609fdd1f profile

A CSV quality report should not echo the data it rejects

#python #dataengineering #privacy #tooling
Comments 1
2 min read
Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust
alexmercedcoder profile

Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

#agents #ai #dataengineering #llm
Comments
19 min read
Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory
wondadav profile

Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory

#ai #dataengineering #agents #llm
2
Comments 2
4 min read
Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)
vaibhav7387 profile

Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

#database #dataengineering #security #insurtech
Comments
4 min read
Model an Evidence Chain, Not a Bag of Citations
kun_shen_eedb57cc827955f5 profile

Model an Evidence Chain, Not a Bag of Citations

#ai #architecture #database #dataengineering
Comments
5 min read
Why AI Projects Fail Even with Great Models
akonagalla28 profile

Why AI Projects Fail Even with Great Models

#ai #machinelearning #dataengineering #softwareengineering
Comments
3 min read
Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)
vbc_risk_analytics profile

Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)

#architecture #dataengineering #python #softwareengineering
Comments
2 min read
World Cup Data Pipeline
banh profile

World Cup Data Pipeline

#showdev #database #dataengineering #postgres
Comments
5 min read
Real-Time vs Batch: Which Insurance Data Actually Needs to Be Live
vaibhav7387 profile

Real-Time vs Batch: Which Insurance Data Actually Needs to Be Live

#dataengineering #architecture #streaming #insurtech
Comments
3 min read
Why Your Insurance Chatbot Failed (And What AI Agents Do Differently)
vaibhav7387 profile

Why Your Insurance Chatbot Failed (And What AI Agents Do Differently)

#ai #insurtech #chatbot #dataengineering
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.