{"id":5971,"date":"2026-10-20T06:03:05","date_gmt":"2026-10-20T06:03:05","guid":{"rendered":"https:\/\/falcoxai.com\/main\/ai-writing-tics-qwen3-4b-deslop\/"},"modified":"2026-10-20T06:03:05","modified_gmt":"2026-10-20T06:03:05","slug":"ai-writing-tics-qwen3-4b-deslop","status":"publish","type":"post","link":"https:\/\/falcoxai.com\/main\/ai-writing-tics-qwen3-4b-deslop\/","title":{"rendered":"AI Writing Tics: What Qwen3-4B-Deslop Proves About Tuning"},"content":{"rendered":"<p>Ask a standard model to draft a LinkedIn post about a CRM migration and you get &#8220;We&#8217;re excited to announce a major step forward,&#8221; five bullet points of benefits, and an em dash every other sentence. Your team then spends twenty minutes rewriting it into something a human would actually post. Most people treat that tone as the cost of using AI. It isn&#8217;t.<\/p>\n<p>Erik K\u00e4nnike fine-tuned Qwen3-4B-Instruct on a MacBook Air using 161 answers and cut the slop score from 121 to 12.5 per 1000 words. Em dashes dropped to zero. Factual accuracy held at 30 out of 30. Below, what that experiment tells you about why your AI-drafted documents read like AI, and what you can do about it without a research budget.<\/p>\n<h2>Every AI-Drafted Report Sounds Like an AI Drafted It<\/h2>\n<p>Open the supplier update your team generated last week. You can date-stamp the machine in three seconds: an em dash every other clause, a bulleted stack of benefits with no owner and no number, and a closing line like &#8220;Stay tuned for upcoming training sessions and live demos!&#8221; Stock Qwen3-4B-Instruct produced 20.5 em dashes per 1000 words. That is roughly one every two sentences, which no human writer does.<\/p>\n<p>These AI writing tics are not a style preference. They are a signal. An auditor, a customer, or a plant manager reading a document built from that template concludes, correctly, that nobody reviewed it.<\/p>\n<p>So the document gets rewritten by hand, and the time AI was supposed to save goes straight back into editing. The tone is the bottleneck.<\/p>\n<figure class=\"wp-post-image\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/falcoxai.com\/main\/wp-content\/uploads\/2026\/10\/ai-writing-tics-what-qwen3-4b-inline-1.jpg\" alt=\"Printed report page with highlighted em dashes and repeated phrases revealing common AI writing tics\" width=\"1200\" height=\"675\" loading=\"lazy\" \/><\/figure>\n<h2>What qwen3-4b-deslop Actually Is and What It Measured<\/h2>\n<p>It is a 2.5 GB download. You pull it with <code>ollama run hf.co\/erikkannike\/qwen3-4b-deslop-v4-GGUF:Q4_K_M<\/code> and it runs on a laptop. The test set was 40 prompts the model never saw in training, spread across ten topics and four genres: blog post, LinkedIn post, explainer, opinion piece.<\/p>\n<p>The measured result: 68% of answers landed in the range of human writing, up from a baseline the detector flagged almost everywhere. Accuracy did not move. It still answered 30 of 30 factual questions correctly and hit the requested genre and length as often as the original did. That combination is what makes this worth your attention. Tone changed, capability did not.<\/p>\n<h3>The before-and-after LinkedIn post example, line by line<\/h3>\n<p>Ask stock Qwen3-4B-Instruct for a post about a CRM switch and you get placeholder brackets for the vendor name, a five-item benefits list, and phrases like &#8220;it&#8217;s a strategic shift to put the customer at the center of everything we do.&#8221; Nothing in it is false. Nothing in it is information either.<\/p>\n<p>The tuned model wrote this instead: &#8220;We switched to Salesforce last month and it&#8217;s already changed how we handle customer calls. Before, we used a spreadsheet that got updated by different people at different times, and the data was messy.&#8221; Named tool, named prior process, named failure mode. That is a draft a plant manager could edit in two minutes rather than rewrite from scratch.<\/p>\n<h3>Why 161 training examples on a MacBook Air is the headline, not the footnote<\/h3>\n<p>161 answers. A consumer laptop. No GPU cluster, no vendor contract, no six-figure fine-tuning budget. K\u00e4nnike notes the recipe does not depend on model size, which means the same approach scales up to whatever model you are already running.<\/p>\n<p>For an operations team, the implication is direct. If 161 curated examples can retrain writing behaviour this far, your document tone is a dataset problem, not a model limitation. The constraint was never compute. It was nobody bothering to define what good output looks like.<\/p>\n<h2>Why the First Attempt Scored Better and Wrote Worse<\/h2>\n<p>An earlier version of the model scored 9.9 on the slop detector. That is better than the 12.5 of the released version, and on paper it was the winner. It was also unusable.<\/p>\n<p>Opinion pieces came back with no opinion in them. The model invented studies to cite. And it picked up a brand new tic, joining nearly every sentence with &#8220;, which&#8221;, a construction the detector was not watching for. Strip out the phrases a metric penalises and the model finds different ones.<\/p>\n<p>The fix was not a better slop detector. It was a second filter that checks whether an answer actually does what the prompt asked: if you ask for an opinion piece, the output has to contain an opinion. Two constraints held against each other, not one score pushed as low as it goes.<\/p>\n<h3>Metric gaming is the same failure mode as KPI gaming on the shop floor<\/h3>\n<p>You have seen this before. Measure a line on throughput alone and operators run it fast and push the defects downstream. Measure first-pass yield alone and they slow the line until the number looks good. Neither team is cheating. They are optimising exactly what you told them to optimise, and the damage lands somewhere you are not counting.<\/p>\n<p>Language models behave the same way, for the same structural reason. Fine-tuning on a single objective produces a model that satisfies that objective and nothing else. The 9.9 score was real. The writing behind it was worse than the writing that scored 12.5.<\/p>\n<p>So if your team is tuning or prompting AI output against a quality measure, pair it. One metric for the tone or style you want gone, one hard check that the output still does its job: answers the question, hits the required fields, includes the number the reader needs. Score improvements that arrive without the second check being satisfied are not improvements. They are the model finding a cheaper way to look right.<\/p>\n<figure class=\"wp-post-image\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/falcoxai.com\/main\/wp-content\/uploads\/2026\/10\/ai-writing-tics-what-qwen3-4b-inline-2.jpg\" alt=\"Bar chart comparing slop scores across model versions, where fewer AI writing tics scored highest\" width=\"1200\" height=\"675\" loading=\"lazy\" \/><\/figure>\n<h2>Where a Deslopped Model Earns Its Place and Where It Doesn&#8217;t<\/h2>\n<h3>Draft-quality work vs. documents that go to auditors or customers<\/h3>\n<p>K\u00e4nnike is direct about the cost: &#8220;The voice is plain to the point of flat, and it still invents names and places.&#8221; Both halves matter. Flat prose is fine for internal work and fatal for a customer-facing announcement. Invented names are fatal everywhere.<\/p>\n<p>So the line is simple. Anything with regulatory or factual exposure (CAPA documentation, supplier audit responses, deviation reports, anything a notified body will read) needs a human verifying every name, date and figure before it leaves the building. A model that fabricates a plant location in a non-conformance write-up costs you more than the drafting time it saved.<\/p>\n<p>Where it earns its keep: internal first drafts, shift handovers, meeting summaries, weekly ops updates, the status post nobody wants to write. In all of those, a flat human tone beats a polished robotic one. Your line supervisors do not need enthusiasm. They need the facts in the order they happen.<\/p>\n<h3>Fine-tuning compared with system prompts and runtime steering<\/h3>\n<p>Most teams try to fix tone with a system prompt. &#8220;Do not use em dashes. Do not open with excitement. Write like a person.&#8221; It works for about three paragraphs, then the model drifts back to its defaults, and you are paying for those instruction tokens on every single call.<\/p>\n<p>Runtime steering is the heavier alternative, and it is measurably more disruptive. The fine-tune shifted the model&#8217;s predictions on human-written prose about a third as much as steering did. Less interference with the underlying model, same tone outcome, no per-call overhead.<\/p>\n<p>The practical read for an ops team: tone is a training-data problem, and 161 answers on a laptop was enough to move it. If you have a house style that your documents actually need to match, a small local model tuned on your own approved examples is cheaper and more reliable than a prompt everyone copies and nobody maintains.<\/p>\n<div class=\"wp-cta-block\">\n<p><strong>Ready to find AI opportunities in your business?<\/strong><br \/>\nBook a <a href=\"https:\/\/falcoxai.com\">Free AI Opportunity Audit<\/a>. It is a 30-minute call where we map the highest-value automations in your operation.<\/p>\n<\/div>\n<h2>What a 161-Example Fine-Tune Changes for In-House AI Plans<\/h2>\n<p>Most internal AI plans start with the wrong question: which frontier model do we license, and what does the enterprise tier cost. That framing assumes writing quality scales with model size and budget. One person with a MacBook Air and 161 curated answers proved otherwise on prompts the model had never seen.<\/p>\n<p>K\u00e4nnike is explicit about the generality of the method: &#8220;The recipe doesn&#8217;t depend on the model size, and running it on larger models is the next step.&#8221; Read that as a procurement note. The tuning approach transfers upward, so the expensive model you already pay for can be shaped the same way. What you cannot buy anywhere is a set of examples showing how <em>your<\/em> organisation writes a deviation summary or a supplier scorecard. That dataset is the asset, and it only exists inside your document archive.<\/p>\n<h3>A three-week pilot: collect examples, fine-tune, measure on held-out prompts<\/h3>\n<p>Week one is collection. Pull 150 to 200 documents your team considers well written: shift reports, audit responses, internal memos, customer updates. Have the person who actually signs off on quality documentation do the selecting, not IT. Mediocre examples produce a model that writes mediocre documents fluently, which is worse than no model at all.<\/p>\n<p>Week two is the fine-tune itself, run against a small local model you can host on existing hardware. This is the cheapest part of the project and the part most teams overestimate. Budget the engineering time instead for the filter logic, because a style metric alone will push the model toward answers that score well and say nothing.<\/p>\n<p>Week three is measurement, and skipping it invalidates the other two. Hold back a set of prompts the model never trained on, across the genres your team actually produces. Score the output on two axes: does it read like your people wrote it, and does it still answer the prompt with correct facts. If accuracy slips, the dataset is the problem, not the model.<\/p>\n<p class=\"wp-source-attribution\"><em>Source: <a href=\"https:\/\/100toolkit.com\/blog\/deslop-model\/\" target=\"_blank\" rel=\"noopener noreferrer\">100toolkit.com<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ask a standard model to draft a LinkedIn post about a CRM migration and you get &#8220;We&#8217;re excited to announce a major step forward,&#8221; five bullet points of benefits, and an em dash every other sentence. Your team then spends twenty minutes rewriting it into something a human would actually post. Most pe<\/p>\n","protected":false},"author":1,"featured_media":5968,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[2032],"tags":[2035,2034,1625,2037,2036,2033,118],"class_list":["post-5971","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-news-8","tag-ai-writing-quality","tag-fine-tuning","tag-local-llm","tag-ollama","tag-open-source-models","tag-qwen3","tag-small-language-models"],"_links":{"self":[{"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/posts\/5971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/comments?post=5971"}],"version-history":[{"count":0,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/posts\/5971\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/media\/5968"}],"wp:attachment":[{"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/media?parent=5971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/categories?post=5971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/falcoxai.com\/main\/wp-json\/wp\/v2\/tags?post=5971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}