LLMs can read, patch, and write executables byte by byte with no tools
LLMs can read and write executables byte by byte from a hex dump
Researchers gave a frontier model raw hex dumps of compiled programs and asked it to identify, patch, and even author ELF64 binaries from scratch — no assembler, disassembler, or compiler involved. It recovered a FreeBSD tool's hidden option list, spotted a real bug in its t-table from the bytes alone, and passed every hidden test on patched programs. Given a 4,608-byte malware sample, it identified the hardcoded server and URL that a sandbox later confirmed. Context size, not capability, is the current ceiling.
These tools are still essential for human analysts, but for an LLM they may turn out to be optional.
- pier25
I've suspected for years that AI companies have been using commercial software to train their models including games, audio plugings, DAWs, etc. It would not surprise me one bit if we find out they used torrented pirated apps like they did with books and music.
There's certainly eg open source audio dev material out there but not nearly as much as web dev. How else do you explain all the avalanche of vibe coded audio plugins and DAWs appearing this year?
- rossy
Like the weight space stuff, I think there's a small misdirection in how this is presented: Phrases like "write directly in machine code" seem to imply that ordinary LLMs intuitively understand machine code as just another language, like English or JavaScript, that they read from context and write directly as tokens, and that this intuitive understanding could mean increased efficiency or capabilities if you ask the LLM to just use the bytes rather than asking it to use the tools that human reverse engineers use.
If that's what you assumed, the DeepSeek reasoning trace shatters that illusion. It's just disassembling by hand like what a human reverse engineer would do if you (sadistically?) denied them a disassembler. Yeah, the human reverse engineer would need an excellent memory of the x86_64 instruction reference, but we already know LLMs can recall a breadth of information. What we don't know, that this article also provides no evidence for, is if there will be any benefit in using the LLM for this over objdump.
The article seems to intentionally conflate disassembly (computationally cheap) with decompilation (can be computationally expensive) to imply that there's some benefit to asking the LLM to work with machine code (seems impressive to the RE layman) rather than working in assembly (something you probably already assumed LLMs can do,) but the DeepSeek trace has a disassembly in it, and it's hard to imagine that inference will ever be cheaper or more reliable per-toke […]
- bita_nidir
I don't think it'll make sense for an LLM to program directly on the cpu opcode level due to the overhead.
But I hope you all realize that the programming language of the future is going to be for LLMs. It'll tightly optimized for LLMs and we'll get nice tools to understand them. They'll probably be great, with loads of fancy tooling.
- MomsAVoxell
Back in the day, thats how we got executables from one system to another, over ASCII-tuned serial lines. I had a colleague in the 80’s who could muscle-memory a “hx.c” which would produce the requisite hex listing given an input, and if that input was a hex listing, reproduce the binary. It was something like 12 lines of C code and it saved our asses so many times, he eventually made a DOS compatible equivalent that could be piped into DEBUG.com to produce the same results.
- mfuzzey
This can be useful in the reverse engineer / malware analysis case where there is existing machine code and no source but I don't think that AI "writing machine code directly rather than high level languages" makes sense. Code generation by LLMs is a non deterministic process so it makes far more sense to generate higher level compilable source code once and then compile it with a deterministic compiler for each target rather than generate machine code non deterministically several times seperately for each target.
- orbital-decay
Yeah sure, people have experimented with giving them binaries since the first instruction-tuned models. They do it poorly though, compilers and decompilers are still necessary.
- jrmg
This has been true for some time now. I can't remember details, but about a year ago, I was debugging some boot issues on an AVR microcontroller, and just pasting the HEX of the bootloader (that I didn't have access to the source of) into Claude's web interface got me the answers I needed.
- plastic3169
It feels like image models which create images and video by bitbanging pure pixels. This is almost never the way people would approach the task of creating images barring pixel graphics. It also means that using image models is inconvinient. I always likened it to having programming AI that would go from prompt to binary. I thought we don’t program like that because programmers understand the problem area better and like to go through source code.