Open Source
4 items tagged with Open Source
-
Keep a PySpark Test Flood Out of Your Agent's Context Window
7 min readA PySpark suite where one fixture breaks floods a coding agent with hundreds of lines of Spark stack traces. Here's the wrapper I built so my agent reads a ~70-line digest instead of 797 raw lines, plus what it doesn't do.
-
Quarantine Bad Rows in Lakeflow SDP Without Breaking Your Clean Table
10 min readA tested inverse-expectations quarantine pattern for Lakeflow SDP: route bad rows to their own dead-letter table while clean rows flow through, plus the NULL trap that silently breaks the split and the companion agent skill that adapts it to your data.
-
Two Guardrails for Letting LLM Agents Query Your Databricks Tables
6 min readHand `databricks experimental aitools tools query` to an LLM agent raw and two things go wrong: it can write, and JSON output bloats your context window. Here's the open-source wrapper I built to fix both.
-
Your Next DABs Project, Configured in Minutes
4 min readA reusable Declarative Automation Bundles (previously Databricks Asset Bundles, still DABs) template that generates multi-environment projects with medallion architecture, schema-per-user isolation, CI/CD pipelines, and parameterized configs. One command, your choices, a working bundle.