DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Storix: One Typed Python Filesystem API from Local Development to Cloud Storage
mghalix profile

Storix: One Typed Python Filesystem API from Local Development to Cloud Storage

#showdev #python #cloud #dataengineering
Comments
16 min read
RAG vs. Semantic Layer: Why AI Needs Deterministic Governance
harshit_colrows profile

RAG vs. Semantic Layer: Why AI Needs Deterministic Governance

#dataengineering #database #ai #datascience
Comments
2 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte #postgres #cdc #dataengineering
Comments
5 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte #dataengineering #elt #python
Comments
5 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte #dataengineering #pgvector #rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api #ai #datascience #dataengineering
Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)
ofirnakdai profile

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

#dataengineering #python #docker #architecture
Comments
2 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile

The Most Underused Prompt in Data Engineering

#ai #productivity #dataengineering #learning
Comments
4 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss #ai #dataengineering #programming
Comments
5 min read
Python Models: dbt and Interlace, Side by Side
5c4989ca297ed profile

Python Models: dbt and Interlace, Side by Side

#python #opensource #sql #dataengineering
Comments
4 min read
interlace.sh: The IR Is a sqlglot AST
5c4989ca297ed profile

interlace.sh: The IR Is a sqlglot AST

#sql #opensource #python #dataengineering
Comments
4 min read
Databricks Lakeflow Feature
digdata profile

Databricks Lakeflow Feature

#dataengineering #databricks #lakeflow
Comments
2 min read
Testing a data pipeline against the spreadsheets it replaced
olund profile

Testing a data pipeline against the spreadsheets it replaced

#dataengineering #testing #python #architecture
Comments
7 min read
Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.
fagundesv profile

Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.

#finops #datascience #dataengineering #ecommerce
Comments
3 min read
Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness
dipayan_das profile

Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness

#aws #opensource #dataengineering #ai
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.