Before anyone gets grossed out, I'm talking about the third lesson into JIT 101. The first two being :-
- You do not talk about JITs
- Read lesson #1, again
The history aside, the lesson is about a simple feature of a CPU called cache. It is something that isn't even supposed to exist, if you are a programmer. Most people relegate cache to the realms of hardware and therefore never think about a cache while writing their code (which is bad cause it really matters for the last mile). Too many people think link-lists are always better than arrays - even when they are writing code for megahertz cpus (cache optimisations are a totally different book altogether).
Cache is a very important feature of CPU for a JIT programmer, a step below the instruction set and word-size. When you write any data to memory, you are writing to cache and ditto when you read. Most programmers only deal with data reads and writes. Life is not so simple for JIT folks, we write code into memory - a problem usually faced only by the OS loader, otherwise. But ever since the concept of self-modifying code died out, very few CPU designers ever design their instruction sets to accomodate the likes of us. So all we get to work with are a set of instructions to write data to memory via cache (exception being AMD64 which has a few Non Temporal instructions).
So what exactly is the problem if the code written stays on cache ?. For a novice, it'll look as if keeping it in cache will be faster. Is is, if all CPUs used a single cache for both data and instructions. CPUs like PowerPC, ARM, Sparc and IA64 have seperate caches for data and instruction set. It is interesting to note that i386 used a single cache for both and intel is forced to keep backward compatibility with a weird cache system (idiotic thunderbox!!). But AMD64 has it's own quirks which are great if you a performance enthusiast (boy, do I love AMD). Keeping them seperate makes it easier - as the instruction cache is read-only and therefore doesn't need any flush circuitry or checks for write-backs when invalidating. But on the other hand, RISC needed more instructions to feed it's pipeline per clock than CISC does (which might spend a lot of pipeline in operand fetch). All in all, intel screwed up - and IA64 bombed heavily (so did Pentium 4, if you look at how it compares to Pentium-3 archs like Pentium-M for insn per clock performance). Let's not beat that dead horse up here.
So all the binary code that you wrote to memory right now went to a data cache and is held there. When you actually try to execute these, they are pulled from the given address via the instruction cache from main memory. Now do you see the problem ?. But as I said before, OS loaders have the very same problem - so every CPU does have a workaround. It is called a cache flush. Write out your data and then flush the data you wrote back to memory.
Here's how you do it - for PPC (copied from pnet engine).
while(count > 0)
{
/* Flush the data cache (coherence) */
__asm__ __volatile__ ("dcbf 0,%0" :: "r"(p));
/* Invalidate the cache lines in the instruction cache */
__asm__ __volatile__ ("icbi 0,%0" :: "r"(p));
p += cache_line_size;
count -= cache_line_size;
}
__asm__ __volatile__ ("sync");
__asm__ __volatile__ ("isync");
Of course, it is a costly operation. The sync is a memory ordering instruction (isync is for the instruction pipeline). The cache-line size is the size of the single block read in a single cache read (read: multiples of 8, till it starts working).
The irritating part of the above lesson is that the moment you run unflushed code in gdb, the code works. So if you JIT works inside gdb and SIGILLs outside, make sure you have flushed. I debugged the above code over an ssh-tunnel from office via sshd on port 443, through two squid HTTPS proxies , over which I ssh-ed into a DMZ (metadistribution.org) and into the PPC dev box (sweden, thanks to pvdabeel from Gentoo) - with a latency of over 500ms. And I liked it !!.
--
Real programmers leave *it* up
Episode XXV of the 70's show. So Eric and friends decide to watch a movie. But we weren't to know that when the episode starts. Now, this is how it starts :- Point place, Eric Forman's basement. The galaxy backdrop, the words "The 70's show" appears and disappears into the background. Then the killer !!
After seeing a lot of 70's show over the years (it was shown a lot on Star World's evening comedies), I had an idea about how the episode would proceed. The entire series has hammered the fact into my head that Red (Eric's dad) is the villian - who believes in taking down Eric whenever he steps over the imaginary line of discipline (kids, these days !!). So I imagined that he would be Darth Vader in some way, allowing them to use the obligatory "I am your father" cliche. But as you'll see I was totally wrong.
They threw in a new disposable character - David, the son of the factory manager. A long blond haired hunk, who used to be an asthma cripple in school - and Eric had once kicked his ass on the school playground. In short, he hits on Donna - but in the wrong way. The poetry loving sensitive guy angle to a girl who does write verse, otherwise known as We're just Friends. Oh, and then there's the dream.
Yes, that's right. Eric has a Star Wars (tm) dream. Looking from left to right -
- Eric - Luke
- Red (Eric's dad) - Obiwan
- Steven - Han Solo
- Donna - Princess Leia
- David - Darth Vader
- Kelso - Chewbacca
Anyway, Eric gets all mad and challenges David to fight with him. Donna gets angry and claims that David and me are just friends and David says No. After Donna exits, David says that "Anyway, it wouldn't have worked. We're moving as soon as dad finishes closing the plant". Eric again gets angry and punches David in his face. David stading there breathing through a broken nose (*swish* ... *hizzz* respirator noises) and then the deep voice from behind the hand. I almost died laughing.
The show has it's unique moments of brilliance - like the Career Day episode. When Steven visits his mother (Edna - the lunch lady) at the cafeteria.
Edna: Steven, why don't you start by slicing these Steven: No, I'm here strictly as an observer. I'll be like a fly on the wall (*looks around*) - one of the many.
A good way to pass time - but doesn't compare to the good stuff like Simpsons or Coupling. Maybe it was because that Seventies were over long before I was born :)