Show HN: Structured, GitHub App for Automated DBT PR Reviews https://ift.tt/zwmrkTU

Show HN: Structured, GitHub App for Automated DBT PR Reviews Scaling data teams today means dealing with the complexity of the modern data stack. While DBT has become a core tool for transforming raw data into structured, analytics-ready tables, most teams are using it in ways that lead to chaos: duplicated models, inconsistent metrics, and inefficient SQL that directly impacts cloud spend. The real issue isn’t with DBT itself—it’s in how it’s applied across teams. Here’s the typical setup: Finance defines a revenue model, Marketing calculates customer lifetime value, and Product defines churn. All in DBT, but all with slightly different logic, leading to metric fragmentation. This results in data drift, conflicting reports, and a ton of unnecessary engineering time spent reconciling definitions. Worse, engineers end up re-inventing the wheel by duplicating logic that already exists in other models. The inefficiencies don’t stop there: suboptimal SQL patterns (e.g., full-table scans, poor joins) creep into production and drive up cloud costs. We designed our GitHub App to automate the grunt work of DBT model management, focusing on three key areas: preventing redundant logic, maintaining the semantic layer, and optimizing SQL performance. --- (1) Stop Redundant Models: A lot of teams waste time rebuilding models that already exist. Engineers aren’t aware of what’s been built, so they duplicate work. Our app automatically reviews pull requests, flags redundant models, and suggests reusing existing logic. This keeps your key metrics like revenue or churn consistent across teams and prevents conflicting reports. (2) Maintain the Semantic Layer: DBT’s value is in creating a semantic layer—a consistent definition of business metrics. But as teams scale, maintaining this layer gets tricky. People unknowingly break it with small changes, leading to inconsistencies. Our app checks every new model for deviations from the semantic layer, flagging inconsistencies before they go live. This prevents those all-too-common situations where two departments are debating whose revenue number is right. By ensuring everyone’s using the same definitions, you avoid trust issues with the data. (3) SQL Performance = Real Costs: Bad SQL isn’t just a performance problem—it’s a cost problem. Inefficient joins, full-table scans, and poorly written SQL in your DBT models can blow up your cloud bill. Our app reviews SQL in pull requests, flags inefficiencies, and suggests optimizations. Example: An engineer submits a model that joins two large tables without filtering. Our app flags the full-table scan and suggests using indexed columns and adding WHERE filters. This reduces query cost and improves performance before the code hits production. --- Data engineers are already stretched thin with the demands of modern data pipelines. By automating model consistency checks, semantic layer enforcement, and SQL performance reviews, our GitHub App frees up your team to focus on higher-impact work rather than wasting cycles on repetitive tasks or fighting fires caused by bad data logic. The app is live—give it a try, and let us know how it’s improving your workflow. Also, keep an eye out for our upcoming DBT code generation features—we’re automating more of the heavy lifting soon. https://ift.tt/gJiR0VW September 27, 2024 at 02:58AM

Show HN: Is Fair Source Cool Yet? https://ift.tt/fXLv2bK

Show HN: Is Fair Source Cool Yet? https://fss.cool September 27, 2024 at 03:04AM

Show HN: 1Minute Break – VS Code extension for developer well-being https://ift.tt/4zfNYiT

Show HN: 1Minute Break – VS Code extension for developer well-being As a developer, I often found myself working for hours without breaks, leading to eye strain and back pain. I created 1Minute Break to solve this problem for myself and others. that reminds developers to take short, regular breaks. Features include: - Customizable break intervals - Interactive break reminders with suggested activities - Water intake tracking - Ergonomic exercise prompts It's designed to improve productivity and health without disrupting workflow. Feedback welcome! https://ift.tt/4Ec10FN... https://ift.tt/nuGicJD September 26, 2024 at 11:29PM

Show HN: FastIndex, an open-source search engine indexation tool https://ift.tt/gHDSnN0

Show HN: FastIndex, an open-source search engine indexation tool There's a lot of paid search engine indexation tools out there and I wanted to create my own. Been working as an engineer for over a decade now and my open-source contribution has always been something I wanted to do. Thus I decided to create FastIndex, an open-source search engine indexation alternative to paid solutions such as TagParrot, URLMonitor, Omega Indexer and many more. Source: https://ift.tt/PVsA18i Wiki: https://ift.tt/F63nGfg https://ift.tt/PVsA18i September 26, 2024 at 06:46AM

Show HN: A new, improved, and open-source clipboard history Chrome extension https://ift.tt/A0o1P4r

Show HN: A new, improved, and open-source clipboard history Chrome extension Hey all! I recently built a new, improved, and open-source chrome extension that allows you to access, track, and manage your clipboard's history! It's very useful for things like refactoring code, finding obscure commands, and backing up form data. Existing solutions are either closed-source, slow, riddled with ads, or all of the above. My goal is to make this extension the most trustworthy, performant, and easy to use version! Your feedback would be very much appreciated, thanks! Extension: https://ift.tt/DGR4ikH... Repo: https://ift.tt/5mhuv3f https://ift.tt/HRdQScm September 26, 2024 at 05:21AM

Show HN: Public Domain Torrent Site https://ift.tt/dQ9rKBu

Show HN: Public Domain Torrent Site I have been working on this site for 10 years. It is a BitTorrent Indexer that uses WebTorrent to make public domain educational media freely available on the Internet. https://propagate.info September 26, 2024 at 03:07AM

Show HN: Httpdbg – A tool to trace the HTTP requests sent by your Python code https://ift.tt/CbT49I1

Show HN: Httpdbg – A tool to trace the HTTP requests sent by your Python code Hi, I created httpdbg, a tool for Python developers to easily debug HTTP(S) client requests in Python programs. I developed it because I needed a tool that could help me trace the HTTP requests sent by my tests back to the corresponding methods in our API client. The goal of this tool is to simplify the debugging process, so I designed it to be as simple as possible. It requires no external dependencies, no setup, no superuser privileges, and no code modifications. I'm sharing it with you today because I use it regularly, and it seems like others have found it useful too—so it might be helpful for you as well. Hope you will like it. cle Source: https://ift.tt/pw7JsFd Documentation: https://ift.tt/bmP1AeH A blog post on a use case: https://ift.tt/Ad5F36u... https://ift.tt/pw7JsFd September 26, 2024 at 12:48AM