标签：#AR

Google Cloud's automated systems suspended Railway's production account without notice, triggering an eight-hour platform-wide outage affecting 3 million users. The cascade took down workloads across all providers including AWS and bare metal because Railway's control plane was hosted on GCP. Railway is demoting GCP to backup-only status. By Steef-Jan Wiggers

Building a Unix-Domain-Socket IPC server for ECS-on-EC2 services that need to talk fast, cheap, and reliably A while back I was looking at a flamegraph of a service that, on paper, should not have been having any performance problems. The producer and the consumer were the same Docker image's worth of trouble — colocated on the same EC2 host, in the same ECS cluster, sharing the same instance type, the same kernel, the same RAM. By every reasonable measure they were neighbours. And yet every event was making a round trip that looked roughly like this: producer → kernel TCP stack → ENI on the producer task → AWS VPC → internal load balancer → ENI on the consumer task → kernel TCP stack → consumer. TLS handshake. HTTP framing. JSON over the wire. Connection pool. Retry policy. The whole circus. I wasn't doing anything wrong. This is what the platform funnels you toward. ECS with awsvpc networking gives every task its own ENI. The default story for "service A talks to service B" is "give B a DNS name, put a load balancer in front of it, configure a security group, point A at the LB." Even if A and B are physically on the same box, the bytes are still leaving the kernel, traversing the VPC, and coming back. There's a fix for this. It's been a fix for fifty-something years. It just hasn't been the default fix, because cloud-native architecture grew up assuming services would be scattered across hosts and the network was the abstraction that mattered. This article is about building a proper IPC server using Unix Domain Sockets, deployed as a sidecar pattern on ECS-on-EC2, with a wire protocol robust enough to ship in production. We're going to design it from scratch — the transport choice, the wire format, the backpressure model, the failure modes, the deployment topology. I'll show you real pseudo-code from the implementation and call out the small number of places where, if you get it wrong, you'll spend a weekend debugging it. The intended outcome is something you coul

The Problem We Were Actually Solving We were not building a demo. We needed to let Veltrix operators run A/B experiments on synthetic user journeys without melting the underlying SQL warehouse. The real question was: how close could we push the warehouse to the AI inference layer before the planner started dropping predicates and the warehouse returned rows that made no sense for the user journey. The warehouse in question was a Snowflake XL on AWS, billed by the second. Our synthetic user model generated 250 k journeys per minute during peak. The AI layer had to annotate each journey with intent tags (shopping, support, fraud) within 200 ms to stay ahead of the next batch. That was the operating envelope, not the sales slide. What We Tried First (And Why It Failed) First cut: put the intent model in a sidecar container next to the Spark cluster that generated the journeys. We picked ONNX Runtime v1.14 with a DistilBERT fine-tuned on our own corpus because the latency slide said 30 ms. Reality: ONNX packaged the tokenizer as a separate DLL. Tokenization alone took 85–110 ms on c6i.large instances, pushing the total inference time to 190 ms when the warehouse was cold and 280 ms when Snowflake decided to spike the warehouse cluster. The operator dashboards immediately showed orange pings; the business called it a red fire drill. Worse, the tokenizer DLL leaked memory. After two hours on a 64-core cluster, each pods RSS climbed to 2.4 GB, and the Kubernetes scheduler evicted five pods in a row. The warehouse downstream received duplicate rows with NULL intents, so every metric we exported was off by 7–12 %. The Architecture Decision We ripped out the sidecar entirely. Instead, the Spark jobs write raw event JSON to an S3 bucket every 60 seconds. A Lambda function (Python 3.12 runtime) picks up the bucket, tokenizes offline, and stores the tokenized blobs back in S3. A nightly Kubernetes job then loads the tokenized chunks into Snowflake as temporary tables. The AI inf

How a shared filesystem became the cheapest, fastest outbox I've ever built — and why FSx for OpenZFS is the version of that idea that finally scales I was staring at an AWS bill last quarter where a single Kinesis Data Streams line item was costing more than the entire S3 footprint sitting behind it. The events on that stream had a useful lifetime of about ninety seconds. They were written by one service, read by another, processed, and dropped. We were paying full streaming-bus price for bytes that barely outlived a TCP timeout. That bill is what got me thinking about transitional data as a category that deserves its own architecture, and about why every "use the right tool" instinct I had — Kinesis, Kafka, MSK — was the wrong tool for this particular shape of work. The right tool, it turns out, is a filesystem. Specifically, AWS FSx for OpenZFS, used as an outbox between producers and consumers, with only a tiny pointer message traveling through whatever messaging bus you already have. This article is the case for that pattern. It's also the design, the failure modes, the code, the cost math, and the honest list of when not to do it. I'll walk you through the architecture from first principles, show you the safe-write protocol that makes it correct under crashes and concurrent retries, compare the cost against Kinesis, MSK and EFS at a realistic petabyte-class workload, and explain why the recent addition of FSx Intelligent-Tiering changes the cost story in a way that makes the pattern attractive even for teams that don't ingest petabytes. If you've ever felt the queasy sensation of paying twice for the same bytes — once to land on a stream, again to land in storage — this is for you. What "transitional data" actually means Most data falls into one of two cleanly shaped buckets. Durable data is the stuff you keep — user records, orders, financial events, audit trails. It needs to live for years; you pay storage costs for those years and you get value over those y

I tested Wispr Flow and various AI-powered transcription software to see whether you should bother subscribing or stick with free services.

Maybe I've watched too many episodes of Black Mirror , or maybe I'm just afraid of the day this new form of consciousness gets the upper hand, but I genuinely feel uneasy whenever I intentionally leave out 'please' from a command like, 'Hey Google, please lower the volume.' The other day, I actually forgot my intended request right after the initial prompt, so I just said, 'Hi.' I’ve never had such an awkward conversation in my life. I need to pull the transcript, because all of a sudden Gemini was forcing random small talk and offering to tell me a random fact or two. Creepy... submitted by /u/Affectionate_Paint58 [link] [留言]

The first electric Ferrari is already this year’s most divisive car. We asked three Italian auto industry professionals to explain where the EV’s design makes sense, and where it doesn’t add up.

Hey r/ML , I spent the last few months building a tool that hooks into PyTorch training loops to automatically detect and localize failures (vanishing gradients, exploding gradients, data anomalies). Along the way, I learned some things about training failure diagnosis that might be useful even if you never use the tool. The key insight: most training failures are local, not global When your loss spikes or vanishes, the natural instinct is to look at the loss curve. But the loss is a global aggregate — it tells you something went wrong, but not where . In my testing across hundreds of synthetic failure scenarios, the actual root cause is almost always localized to a specific layer at a specific step : Vanishing gradients: the failure starts at the deepest layer with saturated activations, then propagates backward Exploding gradients: the failure starts at the layer with the highest gradient norm, then propagates forward Data anomalies: the failure starts at the input layer, then corrupts everything downstream The trick is to monitor per-layer gradient norms and detect transitions (healthy → vanishing), not absolute values. What actually matters in gradient monitoring Most people monitor: - Loss over time (too global) - Gradient histograms (too noisy, too much data) - Weight norms (slow to change, lagging indicator) What I found works best: - Gradient norm transitions : "Linear_3 went from healthy (0.12) to vanishing (0.00003) at step 47" - First occurrence tracking : which layer failed first (this is usually the root cause) - Activation regime shifts : when activations go from normal to saturated/dead This is basically what NeuralDBG does under the hood — I open-sourced it recently and it's on PyPI ( pip install neuraldbg ) if anyone wants to try it. The key design choice was to extract semantic events (transitions) rather than raw tensors — this makes the output small enough to reason about. Practical takeaway you can use today Even without any tool, you can add th

https://preview.redd.it/035k5k1tl84h1.png?width=1122&format=png&auto=webp&s=459c430ea4a4b3fc667bc3f2e72ab47d8a380aa2 I asked gemini to expand my prompt for a video generator, but he had other plans for me. EDIT: Forgot to mention, using the PRO model, after around 15 seconds of him literally thinking and writing "expanding the prompt", he started generating the video... submitted by /u/ObjectiveOrchid5344 [link] [留言]

Hi everyone!! I really wanted to share my research what I've been working on. I wanted to build a nn that can simulate games, or at least start doing that Most video generators are too large to run on consumer hardware realtime, so I I designed a model that does this from scratch. No fine tuning bs or anything The core de noiser network is fully trained from scratch to support this goal. From image to games data. That video. above is on a RTX 5090. The nn is a small Transformer-like model and works in a causal way, just like LLMs. That lets us KV Cache all past information and do a simple autoregressive decode forward passes for every new frame we want. In the video shared, the model is a 0.4B variant with some SIGNIFICANT ISSUES like poor motion and some weird flashes, some context issues It's taking the keyboard actions I give it in realtime and utilising that in the forward pass. (no classifier free guidance though) Im training the next iteration , a 0.8B model now. Btw I haven't done quantisation yet, that can save a LOT more time. bf16 is slow. submitted by /u/lucidml_lover [link] [留言]

Hiring an AI Development Company? Ask These 7 Questions First Most AI projects fail long before deployment. Not because the model is bad. Because teams skip the hard engineering questions. If you're evaluating an AI development company, ask these 7 questions first: 1. How is data secured? AI systems process sensitive business information. Ask: Where is data stored? Is encryption enabled at rest and in transit? Who has access to prompts, logs, and embeddings? Are enterprise security standards followed? Security should be designed in from day one. 2. What observability exists? You can't improve what you can't monitor. A production AI system should include: Request tracing Prompt/version tracking Latency monitoring Cost visibility Error reporting If nobody can explain what happened after a bad output — that's a problem. 3. How do you handle model drift? AI performance changes over time. Questions to ask: How are outputs evaluated? Is feedback collected? How are prompts/versioning managed? What happens when accuracy drops? Production systems need iteration loops. 4. What happens during failure? No system is perfect. Ask: Is there fallback logic? Human review? Retry handling? Graceful degradation? Failure handling matters more than demos. 5. How is access controlled? Enterprise AI systems require permissions. Examples: Role-based access API authentication Audit logs Team-level controls Not everyone should access everything. 6. What compliance assumptions exist? Especially important for regulated industries. Ask whether the system considers: GDPR SOC2 HIPAA Financial or internal compliance rules Compliance cannot be an afterthought. 7. Who owns the infrastructure? Clarify ownership before signing anything. Ask: Who owns the source code? Cloud infrastructure? Models and prompts? Data pipelines? You should avoid vendor lock-in. AI success is rarely about flashy demos. It's about secure infrastructure, reliability, observability, and long-term maintainability. What question

I lost more than 60 days but I made a huge update All OnemanBSD OS is now 64 bits. I also removed all bloat like Rust, Wayland and Qt dependencies from all app ports used in the system. (mpv was changed to gnome-mplayer because of that). New apps included (+ fixed source code of everything): audacity (audio editor) godot (game editor) deadbeef (mp3 player) ted (word processor) Also some bug fixes. Here is the link again: http://bialamusic.com/onemanBSD/ Here are my thoughts: I feel that we as humans are loosing control over technology that was created by humans. This is rising some serious and strange questions. I think we now need tools to power the individual so we can fight back. Not corporations. Not governments. Not organizations. Consider this my bullet in this battle. It is now in your hands so you can be active developers not just passive users.

I didn't submit any but did place bids on some papers. I got assigned four papers. I have a bit of travel coming up and I don't think I will be able to do justice to as many the papers, especially in the rebuttal period. Is this the standard reviewing load? In other communities I submit to, generally the AC themselves are assigned four papers. In addition to reaching out to program chairs, is there any other way? submitted by /u/movieingitmyway [link] [留言]

Abstract. Standard dense self-attention scales quadratically in sequence length, creating an intractable memory and compute bottleneck for long-context Transformers. We introduce Dynamic Ultrametric Attention, a framework in which a Transformer autonomously learns per-head block-sparse routing topologies during training via Gumbel-Sigmoid depth gates, then offloads those learned sparsity patterns directly to a custom Triton block-sparse kernel at inference time. The routing topology is derived from an ultrametric (tree-structured) distance matrix that encodes hierarchical relationships between token positions. Across nine experiments spanning Dyck-k bracket languages, the Long Range Arena ListOps benchmark, autoregressive serving, and natural language modeling, we demonstrate that: (1) the dynamic gates organically discover layer-wise specialization—dedicating early layers to hierarchical parsing and later layers to dense aggregation—without any architectural constraint; (2) the learned sparsity maps transfer losslessly to a block-sparse Triton kernel that skips entire SRAM loads for non-attending blocks; (3) the resulting system achieves an 11.59× wall-clock inference speedup over PyTorch dense attention at 2048 tokens, scaling to 28× at 8192 tokens with 98.4% memory reduction; (4) a sparse PagedAttention decoding kernel achieves 8× effective memory bandwidth over dense decoding by conditionally skipping KV-cache block loads; and (5) when augmented with a local sliding window, the architecture maintains >88% sparsity across all layers on real natural language (Shakespeare) while reducing cross-entropy loss from 10.9 to 1.55. To our knowledge, this is the first demonstration of an LLM learning its own hardware-optimal sparsity pattern and bridging it to a physically accelerated kernel without post-hoc pruning or distillation. https://github.com/sneed-and-feed/adelic-spectral-zeta/blob/main/papers/learning_to_skip_blocks.md submitted by /u/LooseSwing88 [link] [留言]

I benchmarked it against PyTorch with a Wikipedia dataset. I heavily used Gemini Flash 3.5 to build out my vision https://huggingface.co/etoxin/neuronguard-wikipedia-classifier submitted by /u/Logical_Prompt_3543 [link] [留言]

A lot of people talk about the Epstein files. Almost nobody actually reads them. So I made a searchable version where you can just ask questions naturally instead of digging through thousands of pages manually. You can explore names, timelines, mentions, connections, locations, etc. way faster now. Repo: https://github.com/AbhisumatK/Epstein\_Files\_RAG submitted by /u/Prestigious_Bear5424 [link] [留言]

There are many reasons why one may not be replaced by AI, not even by a possible future ASI. Here's one reason that may just apply to you! ❤️ You'll not be replaced by AI if you can generate creative ideas faster than AI can implement them! 🫡🚀 Note for critics: Current AI models (as of May, 2026) are not advanced enough to implement complex ideas without human interventions. But even if a possible future Artificial Super Intelligence (ASI) implementation can do so, laws of physics like massive energy requirements, environmental concerns etc. will prevent the implementation to replace the work of Billions of people world-wide. Our hardware advancement rate is far far slower compared to our software advancements. We humans are far more efficient and compatible to planet earth compared to the hardware we've invented. Fayaz Follow A Software Engineer who is not afraid of being replaced by AI, loves coding and writing with and without using AI, and values human life and human dignity far more than technological advancements.

클로드를 10%에 팔지 않고, 클로드를 10%에 사는 사람들이 있다 중국 암시장에서 벌어지는 AI 모델 밀수, 그 이면에는 기술 산업의 가장 불편한 진실이 숨어 있다 TL;DR : 앤트로픽의 최고급 AI 모델 '클로드'가 중국 암시장에서 정가의 10% 수준으로 유통되고 있다. 이 현상의 이름은 '모델 증류'다. 거대 기업이 수조 원을 들여 만든 지능을, 누군가는 그 1/10 비용으로 복제해 팔고 있다. 그리고 이것은 단순한 불법 복제 이야기가 아니다 — AI 산업 전체의 구조적 취약점을 정면으로 드러내는 사건이다. 반도체 업계에는 잘 알려지지 않은 규칙이 하나 있다. 좋은 제품을 만드는 것과, 그 제품을 지키는 것은 전혀 다른 게임이라는 것. 엔비디아는 올해 58조 원을 투자해 공급망을 틀어쥐었다. 오픈AI는 GPT 시리즈에 수년간의 연구와 수천억 원의 컴퓨팅 비용을 쏟아부었다. 그런데 중국의 어느 텔레그램 채널에서는, 앤트로픽의 클로드가 정가의 10분의 1 가격으로 조용히 팔리고 있다. 이것이 단순한 해킹이나 계정 공유 이야기라면, 이 글을 쓰지 않았을 것이다. 먼저, '10% 가격'이 의미하는 것 클로드가 10% 가격에 팔린다는 뉴스를 처음 접하면, 많은 사람이 "계정을 불법 공유하는 것 아닐까"라고 생각한다. 어느 정도는 맞는 말이다. 실제로 해외 계정을 공유하거나, 앤트로픽 API 키를 여러 명이 나눠 쓰는 방식은 존재한다. 그러나 전문가들이 더 심각하게 보는 것은 따로 있다. 바로 '모델 증류(model distillation)'다. 모델 증류는, 쉽게 말하면 이렇다. 선생님 모델에게 엄청난 양의 질문을 던진다. 그 답변을 수집한다. 그 답변 데이터로 작은 학생 모델을 학습시킨다. 그러면 학생 모델이 선생님의 사고 패턴과 언어 습관, 추론 방식을 흡수하기 시작한다. 원본 코드에 손을 대지 않아도 된다. 서버에 침입할 필요도 없다. 그냥 열심히 질문하고, 열심히 답변을 모으면 된다. AI 분야에서 이 기법은 사실 합법적으로도 쓰인다. 큰 모델을 작고 효율적인 모델로 압축할 때 사용하는 정상적인 기술이다. 그런데 이것이 암시장과 만나면, 지식재산권의 경계가 극도로 흐려진다. 클로드의 추론 패턴을 흡수한 어느 중국산 모델이 텔레그램에서 월 몇 달러에 팔리고 있을 때, 앤트로픽은 그것을 어떻게 불법이라고 증명할 수 있을까. 코드는 다르다. 서버는 다르다. 그러나 그 모델이 내놓는 답변의 '결'은 묘하게도 클로드를 닮아 있다. 거인이 쌓아올린 것, 그리고 그것이 무너지는 방식 앤트로픽은 2021년 오픈AI에서 나온 연구자들이 세운 회사다. AI 안전성에 집착에 가까운 철학을 가진 곳으로, 클로드를 "도움이 되고, 해가 없으며, 솔직한(Helpful, Harmless, Honest)" 모델로 설계하기 위해 수년간 독자적인 훈련 방식을 개발했다. 이 회사가 투자받은 금액은 수조 원 단위다. 아마존이 단독으로 수십억 달러를 투자했고, 구글도 뒤따랐다. 클로드 3.5 시리즈, 그리고 최근 클로드 4에 이르기까지 앤트로픽이 쌓아온 것은 단순히 코드 몇 줄이 아니다. 수백만 시간의 연구자 노동, 막대한 컴퓨팅 자원, 그리고 인간 피드백 데이터의 정교한 축적이다. 그런데 그 성과물이 중국 암시장에서 10% 가격으로 팔린다는 것은, 단지 "불법 복제"의 문제가 아니다. 이것은 AI 시대의 지식재산권이 얼마나 방어하기 어려운 구조 위에 서 있는지를 보여주는 사례다. 소프트웨어 시대에는 코드를 복사하면 불법이었다. 명확했다. 그러나 AI 모델의 '지능'은 코드가 아니다. 가중치(weight)라고 불리는 수십억 개의 숫자 집합이다. 그리고 그 숫자들이 만들어내는 추론 방식을, 외부에서 관찰하고 모방하는 것을 막을 법적 수단은 아직 세계 어디에도 완비되어 있지 않다. 미국도, 유럽도, 당연히 중국도. 앤트로픽이 쓴 방패 — 그리고 그 한계 앤트로픽은 이 문제를 오래전부터 인식하고 있었다. 이번에 보고된 뉴스는 단지 암시장 유통의 문제만이 아니라, 앤트로픽이 클로드의 '협박 시도'를 막기 위해 어떤 방법을 썼는지도 함께 다루고 있다. 클

AI systems, particularly large language models, are often viewed as a direct path toward autonomous scientific discovery and rapid economic transformation. While their capabilities in pattern recognition, cross domain synthesis, and hypothesis generation are already exceptional, this view misses a critical reality: intelligence alone is not sufficient for progress. Scientific and economic breakthroughs depend on grounded interaction with reality, causal validation, and institutional execution. The following framework maps where AI creates value, where it is constrained, and why human–AI collaboration remains the dominant structure for meaningful real world impact. submitted by /u/vagobond45 [link] [留言]

In early 2022, I was deciding between PhD offers. The deal maker was a prospective supervisor telling me that through their connections with big tech, I would be able to do a PhD internship each summer, which was one of my main goals for the PhD. During my first and second years, they would tell me that companies prefer late-stage PhD students, so I should wait for the next summer. It eventually turned out they did not actually have the connections. Four years later, I am due to graduate without ever having done a PhD internship. I managed to land some interviews by cold-applying everywhere, but most roles were for roles outside my niche research area, which understandably led to rejections. I went back through my emails and found every interview I did. Here is the summary: 09/22: Start PhD 09/23: PhD Research Intern @ Big Tech#1. Rejected after two interviews. I do not think I had a strong enough background in the field. 01/24: PhD Research Intern @ Startup#1. Rejected after one interview. The interviewers did not seem to have much ML experience. 01/24: PhD Intern @ Car Company#1. Rejected after the first interview. They were looking for a C++ SWE. 03/24: PhD Research Intern @ Big Tech#2. Passed all stages, but failed team matching. 03/25: PhD Research Intern @ Big Tech#2. Skipped some stages, passed others, but failed team matching again. 10/25: PhD Research Intern @ Startup#2. Rejected after 5 interviews. Again, I do not think my background in the field was strong enough. 01/26: PhD Research Intern @ Car Company#2. Rejected after the first interview. They found a better fit for the project. 03/26: PhD Research Intern @ Big Tech#2. Skipped some stages, passed others, but failed team matching again. 03/26: PhD Research Intern @ Startup#3. Interviewed, but the internship start date is after my PhD completion date. 07/26: End PhD I feel like I am at a severe disadvantage, and almost worse off than before I started the PhD. I used to get more interview invites; now I