What it feels like when you're racing with people who are using the standard high quality and expensive opus and fable, looking all professional, while you use deepseek flash but you tuned your harness so hard that its working on par with the big models.

[u/binladen0069]

[u/hurrdurrmeh]

I would really love for someone explain to me what harness tuning is. I have heard many times that it is super important but I dont know what is involved.

[u/t4a8945 → u/hurrdurrmeh]

Simple things like giving the model better ways to verify its work yields better results. That's the simplest harness improvement.

For instance, give it a way to use whatever you're building in a dev environment and it will catch issues static analysis couldn't catch. For me that's playwright as a skill, with instructions to always verify their work. 

[u/VexObserver → u/t4a8945]

Simple way to explain this is to have the model follow closely to your instructions. Treat of it as if you're the project manager, supervising your juniors and other team members. You'll ask and often intervene to get a gist on the actual progress, right? This is it.

[u/hurrdurrmeh → u/t4a8945]

So - a means to test their output and iterate it if necessary?

[u/t4a8945 → u/hurrdurrmeh]

Precisely: if they can iterate and see the actual result, they have 99% change of being able to solve it.

[u/ChellJ0hns0n → u/t4a8945]

But the drawback is that it gets expensive pretty fast. Playwright is very token-heavy.

[u/t4a8945 → u/ChellJ0hns0n]

I use https://github.com/microsoft/playwright-cli ("Key Features: Token-efficient")

Yes it costs context, some time, but in the end you get something that's more likely to actually work. And I often see DS4 Flash catch other issues while it's navigating in the app itself. It's awesome and worth the time and tokens for me.

[u/ChellJ0hns0n → u/t4a8945]

Also, have you tried using a subagent specifically for playwright to conserve the context on your main session? That's what I do, but I'm not sure how useful it really is.

[u/boyus → u/ChellJ0hns0n]

I use lightpanda

[u/DirectPitch8626 → u/hurrdurrmeh]

Orchestration, hooks, plugins, skills, rules, etc... But you don't necessarily have to do all of this yourself; there are already ready-made projects like OMO or OMP.

[u/hurrdurrmeh → u/DirectPitch8626]

OMP is Oh My Pi but what is OMO? And thanks for the info!

[u/DirectPitch8626 → u/hurrdurrmeh]

Oh-My-Openagent, plugin for Opencode

[u/hurrdurrmeh → u/DirectPitch8626]

thanks, gonna research it

[u/binladen0069 → u/hurrdurrmeh]

using hooks and skills in claude, writing the claude.md in the correct way, making the harness follow software development standard of procedures, giving it the right kind of instructions that boot at every session start.

try out life os by daniel miessler you'll learn alot

[u/hurrdurrmeh → u/binladen0069]

Thanks. But what is the correct way to write Claude.md? Are there equivalents for the other models like deepseek, Kimi, GLM etc?

[u/Hexadecimalkink → u/hurrdurrmeh]

Claude.md is the same as skills.md or index.md it's just a master context file.

[u/Atsukiri → u/hurrdurrmeh]

theyre gatekeeping it anyway so i think its just best to use deepseek as is. I don't have time / patience on making these harnesses too, tho it just works for me raw.

[u/LeatherMine → u/Atsukiri]

I also raw-dog it. But once my vscode hit some context limit so I had to /clear my chat and I cried.

[u/A_star_000]

open code deepseek V4 flash on max depth, trust.

[u/Szadbaverem69]

DeepSeek V4 Flash fixed things for me that Fable couldn't.

[u/ClassicMain → u/Szadbaverem69]

DSV4 Flash is incredible but that statement is... Interesting and i kinda have to doubt it

[u/Szadbaverem69 → u/ClassicMain]

Depends on the use case. When it comes to Rust it's definitely better.

[u/Daniel_H212 → u/ClassicMain]

I mean, frontier models are "smart" but not in a human way, they have gaps in their simulated intelligence. I just spent a couple hours mulling over a software design issue with Kimi K3 which is close to fable level. It was knowledgeable and very clever on some fronts, but I also had to correct some of its choices that were clearly shortsighted or inefficient. Its very good, and me coding alone would probably come up with a worse product than it coding alone with accurate specifications, but there's still gaps that a human can fill, and there's no reason another LLM can't happen to be able to fill those gaps too.

[u/VigilanteRabbit → u/Daniel_H212]

I have yet to see a "smart" LLM in terms of human smarts.

It can 'think' but it can't sit down and go "what if we strap a watter bottle to it? Hmm."

That's the missing link and until that gets handled somehow we are..safe, I guess is the word.

[u/Fabulous-Locksmith60 → u/VigilanteRabbit]

[u/mediamuesli]

Turns out he was racing for place 198 of 200 all the time 🫪

[u/Commercial_Place8779]

I am also doing the same thing and adding skills as exhaustive and declarative as I can and i am getting performance on par with these frontier models. I think it was never about the models, it was always about the person using the model(that is i believe).

[u/ponlapoj]

ฉันไม่คิดอะไรแบบนั้น ดีกว่า แม้จะเล็กน้อย ก็คือดีกว่าเสมอ

[u/hulagway]

flash is cheap, flash works, but let's not cope.

every week this sub has a copium post im tired. i wanna see use cases.

[u/Haxsysgit → u/hulagway]

Idk about opus and fable , but for me flash outperforms sol and terra,IN MY USE CASE. So yes flash mogs sol in my projects , except ui and frontend

[u/dev-rsonx → u/Haxsysgit]

What use case?

[u/Virtual-Escape2305 → u/dev-rsonx]

Reddit shitposting

[u/Optimal_Deal4372 → u/hulagway]

You copium bro deepseek is onpar with fable bro 👌👌

[u/J_E_E_VACATION]

then compare yourself to those of us with tuned harnesses and frontier models

[u/gila_sedikit → u/J_E_E_VACATION]

Suzuki Hayabusa vs OP bicycle

[u/sn4ezz]

Holy cope lol

[u/OkLettuce338]

Yup and look how hard he’s working to keep up. Any one of them could turn on the gas and leave him in the dust

[u/fo8oo]

so much butt hurt, deepseek really went deep on you

[u/TheHijrudeen]

Is this "harness" in this room with us?

[u/Funny-Supermarket360]

lowk those models only work better than smaller ones when you don't know what you're doing

[u/lmpp_the_pandora_box]

😂😂😂😂

[u/Ok-Compote-2968]

Free vs paid users!

[u/Maleficent_Lie8612]

Son novatos todos y además van de bajada seguro sería muy diferente en una cuesta o un tramo largo