AI 资讯
LLM Fine-Tuning Guide: Full Fine-Tuning, LoRA, Learning Rate, and VRAM
From data preparation and tokenizer selection to pretraining, LoRA, RLHF, evaluation, and production monitoring, this guide covers the major stages involved in training an AI model. Training an artificial intelligence model is not simply a matter of loading a dataset onto a GPU and running a few commands. A successful model requires a measurable objective, legally usable and carefully cleaned data, an architecture suited to the problem, controlled optimization, independent evaluation, and continuous monitoring after deployment. In large language model development, a mistake in any one of these stages can waste millions of training examples and a significant amount of compute. This guide explains the model development process primarily through the training of large language models. However, fundamental concepts such as dataset splitting, loss functions, overfitting, and evaluation also apply to computer vision, speech, and predictive models. The goal is not to provide a single fixed recipe. Instead, it is to explain which training approach is appropriate for which problem and to clarify the cost difference between training a model from scratch and adapting an existing model. In Brief: How Is an AI Model Trained? First, the target task and success criteria are defined. Data is collected, reviewed for licensing and privacy, cleaned, and divided into training, validation, and test sets. The model generates predictions from the input data. The difference between the prediction and the correct target is measured using a loss function. Backpropagation calculates how each parameter contributed to the error, and an optimization algorithm updates the parameters. This process is repeated under controlled conditions until the model achieves acceptable results in independent tests and safety evaluations. What Does Training a Model Actually Mean? A neural network initially contains a large number of numerical parameters. During training, the model generates a prediction for a giv
AI 资讯
Ask HN: Has anyone built "HN front page, with all AI stories filtrered out"?
They just annoy me and provide very little value. The non-AI gems in between however are very much still worth reading. Has anybody built that already?
AI 资讯
Beyond login: encrypting data with passkeys and WebAuthn PRF
Originally published at daniel-yang.com . I've been using passkeys for a while now, and at some point I noticed an extension in the WebAuthn spec that almost nobody talks about: PRF. It lets a website ask your authenticator to evaluate a pseudo-random function during login. Deterministic output, 32 bytes, keyed to that specific credential, never leaves your browser. That's an encryption key. Sitting inside the same ceremony everyone already uses for login. So I built pknotes to see how far the idea goes: an end-to-end encrypted notes app with no master password anywhere. Your passkey unlocks your notes in the literal, cryptographic sense. This post is the architecture writeup. There's a live demo if you'd rather poke it first (notes wiped daily). One ceremony, two jobs A normal passkey login proves who you are and nothing else. With the PRF extension, the same ceremony does double duty: The server verifies the WebAuthn assertion. That's login. The client reads the PRF output from the same response and derives a key from it. That's decryption. The server never sees the PRF bytes. They're returned to client-side JavaScript only, after user verification (Face ID, Touch ID, PIN), and only for the requesting origin. Requesting it looks like this: const credential = await navigator . credentials . get ({ publicKey : { challenge , userVerification : ' required ' , extensions : { prf : { eval : { first : new TextEncoder (). encode ( ' pknotes/prf-eval/v1 ' ) } }, }, }, }); const prfOutput = credential . getClientExtensionResults (). prf . results . first ; // 32 bytes, deterministic for this credential + this input, never sent anywhere The key hierarchy Raw PRF output shouldn't encrypt data directly, and you also want to be able to add and remove devices without re-encrypting everything. So there's a small hierarchy: Passkey PRF output │ HKDF-SHA256 ▼ KEK (key-encryption key, exists only in browser memory) │ unwraps ▼ Master key (random AES-256, generated once at signup) │
AI 资讯
Coca-Cola suspended production at its Fairlife dairy after a ransomware attack
Coca Cola said dairy production at its Fairlife unit will "remain suspended" in the United States following a hack.
AI 资讯
Skyportal SRE – an open-source AI infrastructure engineer
AI 资讯
BYO NOS: Building a maintainable, SRE-friendly switch
AI 资讯
Salad Chains Are Seeing Foot Traffic Drop Over Cyclosporiasis Fears
Foot traffic to leafy green chains is falling, data shows. Still, a few brave souls who spoke to WIRED were determined to get their fix. “I honestly didn’t even think about” the risk of explosive diarrhea, one says.
开发者
Scaling to 1M concurrent sandboxes in seconds
AI 资讯
T-Mobile bungled forced plan migration, canceling some users' free lines
T-Mobile to restore free lines lost during plan migration, but price hikes remain.
AI 资讯
It's official: EU will force Google to share search data and open up AI on Android
Google says these changes could endanger user privacy and security.
AI 资讯
Do Face Masks Help With Wildfire Smoke? Yes, But More Is Needed
As wildfire smoke threatens air quality and safety for millions, here’s your playbook to keep your family safe from the damaging effects of smoke.
开发者
Mathematics of Data Science
开发者
Ferrari Creates a Fake Manual Transmission
开源项目
IMAX CEO: We haven't made new IMAX projectors in 50 years
AI 资讯
xAI can’t deny Grok makes CSAM anymore. So it’s suing users.
Elon Musk's xAI files first lawsuit against Grok user accused of making child sex images.
AI 资讯
GPT-5.6 Sol Pro solves open problem in convex optimization
AI 资讯
Timeline Scan – AI fixes the dates on your scanned photos
开发者
Helium escaping from atmosphere of nearby rocky exoplanet in a habitable zone
AI 资讯
Show HN: Libretto PR agents – Automatically fix failing playwright scripts
Libretto PR agents is a free TypeScript library for maintaining Playwright browser automations. Add one line of code to your existing Playwright scripts and it lets an agent automatically open GitHub PRs fixing the script when it fails. A few months ago we released Libretto, a CLI + coding-agent skill for building deterministic browser automations. The idea was that for many browser workflows, especially repetitive business workflows, you don’t need an AI agent making decisions at runtime. You w
AI 资讯
LM Studio Bionic: the AI agent for open models