Dev.to
Deeper into Dataform 3: Auditing Dataform
It's important to monitor Dataform - jobs executed by Dataform can be the primary source of BigQuery costs in a modern data platform. Forgetting to incrementalise a table, using a table instead of a view in the wrong place or performing complex window functions on a large table can all incur large costs and long run times. Using the WorkflowInvocationAction for each job we can extract its BigQuery Job ID, then extract key metadata for each BigQuery job by querying INFORMATION_SCHEMA.JOBS_BY_PROJECT , before writing the output back to BigQuery so that it can be analysed (maybe even by transforming it in Dataform). from google.cloud import dataform_v1 from google.cloud import bigquery from datetime import datetime # ------------------------------------------------------------ # CONFIG # ------------------------------------------------------------ PROJECT_ID = " my-project " REGION = " europe-west2 " REPOSITORY_ID = " analytics " WORKFLOW_INVOCATION_ID = " 123456789 " BQ_REGION = " region-europe-west2 " OUTPUT_TABLE = " my-project.raw_dataform_monitoring.raw_dataform_bigquery_metrics " # ------------------------------------------------------------ # CLIENTS # ------------------------------------------------------------ dataform = dataform_v1 . DataformClient () bq = bigquery . Client ( project = PROJECT_ID ) repository = dataform . repository_path ( PROJECT_ID , REGION , REPOSITORY_ID ) invocation_name = f " { repository } /workflowInvocations/ { WORKFLOW_INVOCATION_ID } " # ------------------------------------------------------------ # 1. GET WORKFLOW INVOCATION ACTIONS → EXTRACT JOB IDS # ------------------------------------------------------------ job_ids = set () actions = dataform . list_workflow_invocation_actions ( parent = invocation_name ) for action in actions : # only BigQuery actions contain job metadata if hasattr ( action , " bigquery_action " ) and action . bigquery_action : if action . bigquery_action . job_id : job_ids . add ( action . bigquery_action
Ben Watson
2026-06-06 20:20
👁 13
查看原文 →
HackerNews
Meta Keeps Delaying the Release of Its New AI Model to Developers
mekpro
2026-06-06 20:15
👁 4
查看原文 →
Dev.to
Identity Federation Explained: Understanding SSO, OAuth, OIDC, and SAML
Have you ever clicked "Sign in with Google" instead of creating a new account for a website? If so,...
Rijul Rajesh
2026-06-06 20:14
👁 4
查看原文 →
Reddit r/webdev
A pure client-side regex tokenizer to safely feed error logs to LLMs
Spent the weekend building a local tokenizer to stop leaking DB passwords and API keys to ChatGPT, literally can't stop testing edge cases. Written in pure TypeScript. Uses greedy reverse anchoring to mask credentials locally in the browser. Provided the core sanitizer logic here: https://github.com/abests/ghost-sanitizer-js submitted by /u/zero_backend_bro [link] [留言]
/u/zero_backend_bro
2026-06-06 20:13
👁 5
查看原文 →
Reddit r/webdev
[Showoff Saturday] I built a completely ad-free Tier List Maker.
Hi everyone, I’ve always felt frustrated by how many ads are crammed into most tier list websites. That’s why I created a brand new site with absolutely no ads. I also made sure it's highly mobile-optimized and offers multiple downloading options for your tier lists! I'm always looking to improve, so please feel free to share any feedback or features you'd like to see added. ps. As a thank you for checking it out early, if you create 1 tier list template now, I will upgrade you to a lifetime Premium account. Even if ads are introduced later down the road, your account will remain completely ad-free. submitted by /u/Mountain-Shoe-6070 [link] [留言]
/u/Mountain-Shoe-6070
2026-06-06 20:02
👁 5
查看原文 →
Hacker News RSS
Mbodi AI (YC P25) Is Hiring Founding Machine Learning Engineer (Robotics)
Article URL: https://www.ycombinator.com/companies/mbodi-ai/jobs/WYAcNkX-founding-machine-learning-engineer Comments URL: https://news.ycombinator.com/item?id=48424103 Points: 0 # Comments: 0
chitianhao
2026-06-06 20:00
👁 4
查看原文 →
The Verge AI
Here comes new Siri again
Apple has been on its back foot, AI-wise, for the past few years. But in a strange way, playing from behind might not be such a bad move. At WWDC on Monday, Apple appears to be getting ready to reintroduce us to the new Siri. Again. As a reminder, we met the new Siri in […]
Allison Johnson
2026-06-06 20:00
👁 10
查看原文 →
Reddit r/artificial
how to make the "mimic"
if youve been on the internet long enought you probably know vommitedthoughts a person that created the mimic irl and he can talk to it and it replies very human like, so ive been wanting to make my own chatbot like that called kira but idk how my last experience with python chatbots failed since it was SO dumb and it started talking to itself so how do i make my own chatbot that i can constimize its personality ?? submitted by /u/i_am_X-Kira [link] [留言]
/u/i_am_X-Kira
2026-06-06 19:55
👁 6
查看原文 →
HackerNews
AI Can't Care
mooreds
2026-06-06 19:46
👁 4
查看原文 →
Hugging Face Blog
Persona Atlas: Mapping How Famous Minds Think
2026-06-06 19:42
👁 4
查看原文 →
Product Hunt
Stride
The AI workspace that plans, designs and ships with you. Discussion | Link
2026-06-06 19:14
👁 4
查看原文 →
Reddit r/webdev
I made a type-safe RPC + event streaming library over WebSockets
I was working with websockets and wanted some lightweight solution which was easy to work with and I never liked working with plain websockets and as an experiment I started building a typesafe solution and which is how I came up with @frsty/wsrpc . You can define procedures on the server (like trpc) , get typed send and on on the client. No codegen, no event codes objects to share between client and server, 0 runtime dependencies. Handlers are generator functions, yield events, return the RPC response: https://preview.redd.it/0igrus569n5h1.png?width=3680&format=png&auto=webp&s=880c6b2fd90a04866058bc91d703995c14482b07 All the event codes, returns and callback functions are typesafe. Works with zod, valibot, arktype, anything that implements Standard Schema. framework-agnostic. Still early so would appreciate some feedback. For detailed example see github.com/frstycodes/wsrpc submitted by /u/frstyyy [link] [留言]
/u/frstyyy
2026-06-06 19:10
👁 5
查看原文 →
Wired
The Best 3-in-1 Apple Charging Stations After Testing Top Models
I tried all the top models to find the best 3-in-1 Apple charging stations, pads, and more. Keep your iPhone, Apple Watch, and AirPods topped up with these WIRED-tested docking systems.
Simon Hill
2026-06-06 19:00
👁 11
查看原文 →
Reddit r/artificial
Learn Agentic AI with quick, easy to run hands on labs, visual canvases and notebooks for free!
If you’re a full-stack engineer or technical architect willing to learn production-grade enterprise agents, you need architecture, security, and type-safe systems. That’s why we built AgentSwarms.fyi —the ultimate hands-on educational platform for teaching agentic AI and multi-agent workflows. 🚀 The Core AgentSwarms Ecosystem: Real-World Architectures: Skip the generic hello-world loops. Learn production-grade systems like human-in-the-loop validation, automated multi-platform content multiplexers, and secure code-sandbox environments. Deterministic Cloud Guardrails: Deep dives into multi-cloud token economics, dynamic cost-optimized routing, and model evaluation metrics. Grassroots Engineering Focus: No corporate marketing fluff. Just raw, practical code patterns designed to bridge the gap between fragile prototypes and stable cloud deployments. 💣 The New Drop: 60+ Browser-Native TypeScript Notebooks We just completely re-engineered our learning workspace. We’ve added 60+ fully interactive TypeScript Notebooks running 100% natively in your browser. No pip install dependency hell, no local Docker setup, and zero environment friction. Read the architecture, tweak the system prompts or Zod schemas, hit play, and watch the streaming terminal execute live across the five absolute best frameworks in the ecosystem: 🟢 LangChain.js (Fundamentals & Middleware Guardrails) 🔀 LangGraph.js (Cyclic Graphs & Stateful Orchestration) 💾 LlamaIndex.ts (Sentence-Window Retrieval & RAG Triad Evals) ⚡ Vercel AI SDK (Streaming UI Integration) 🤖 OpenAI Agents SDK (Lightweight, low-boilerplate loops) Stop passively scrolling through video courses. Open a canvas, break the graph nodes, and start compiling real multi-agent swarms. 👉 Dive in for free: agentswarms.fyi/learn submitted by /u/Outside-Risk-8912 [link] [留言]
/u/Outside-Risk-8912
2026-06-06 18:39
👁 6
查看原文 →
Wired
2 Best Bluetooth Trackers of 2026, Plus Honorable Mentions
These are the best Bluetooth, Wi-Fi, GPS, and cellular gadgets to ensure you never lose anything ever again.
Boutayna Chokrane
2026-06-06 18:38
👁 10
查看原文 →
Reddit r/webdev
After fighting instagram's non existent APIs for months, I'm currently building a github-related app. And I must say these rate limits are absolutely LOVELY
I was working with being tortured by Instagram API for a client project. Eventually I delivered something that barely worked with duct tapes and prayers. Never again I'll take on any instagram/meta related project. And after that horrible experience github's rate limits, API coverage and documentation, everything about it felt like a breath of fresh air. Whereas instagram was like; "I'll give you one API call per sometimes and you better cache it" I thought I'd add some pictures from the app I'm working on since it's showoff saturday. Though there's still a lot I need to work on and I'm not sure if I'll even finish it. I just found a way to build desktop apps in python using html/css and I'm going nuts with it lol Edit : If I ever finish this app, it'll be free and open source. Basically you generate an API key, put it into the app and it lets you view, filter, and update your issues. Can also click on repo name or issue title to view in your default browser. I recently downloaded github desktop and it didn't have this feature, so I thought I'd do it myself and learn more python in the meantime. I have a few more ideas for it but I'm trying not to scope creep myself submitted by /u/mekmookbro [link] [留言]
/u/mekmookbro
2026-06-06 18:34
👁 7
查看原文 →
Wired
Crypto-Funded Chinese Peptide Labs Are Booming
Plus: Hackers use Meta’s AI bots to hack Instagram accounts, Anthropic helps NSA hackers, a decades-long GPS satellite mystery may have been solved, and more.
Andy Greenberg, Dell Cameron, Dhruv Mehrotra, Maddy Varner
2026-06-06 18:30
👁 11
查看原文 →
Reddit r/webdev
I open-sourced a tool that reads code diffs and tests affected UI flows automatically
I've been working on an open-source project called Canary. It reads your code diffs, understands which UI flows are likely affected, and lets Claude Code tests those flows in a real browser. Under the hood, Canary ships with a QuickJS WASM sandbox that exposes the full Playwright API, allowing Claude to perform long-running browser workflows such as authentication, onboarding flows, form submissions, and navigation across complex applications. Each run captures: Screen recordings Playwright traces HAR files Network requests Console logs Screenshots Unlike most agent runs, every Canary session also generates a reusable Playwright script that can be cleaned up and replayed locally or in CI with zero inference cost. Canary UI submitted by /u/wixenheimer [link] [留言]
/u/wixenheimer
2026-06-06 18:02
👁 7
查看原文 →
Reddit r/webdev
I’ve created a tech stack builder app
You pick a tool on the canvas, and in real-time you get suggestions on what you can add next, how your tools pair together, or what can be missing. There are also recommended tech stacks available for different project types. Web apps are one of the primary types, but the tooling also covers data projects, automation and so on. In total there are over 150 tools present. Everything in the app is rule-based, there’s no AI there yet whatsoever. I do plan to add an AI chat later, but it will be built on the same deterministic engine. It’s a beta for now. The builder and the tools catalogue are fully functional, user accounts are also planned for later. But this core part will stay free to use without accounts. Paid plans, if introduced, would cover extras like AI features. For my own tech stack, it’s Vue.js for frontend, FastAPI for the backend and PostgreSQL for the database. https://tekyous.dev submitted by /u/sartek1 [link] [留言]
/u/sartek1
2026-06-06 18:01
👁 7
查看原文 →
Wired
How to Share a Link to a Particular Phrase
Modern browsers let you share a link that jumps straight to whatever text you wish to highlight. Here’s how the feature works.
Justin Pot
2026-06-06 18:00
👁 11
查看原文 →