I haven’t sunk much time at it, but I’m not aware of any training data focusing on code only. There’s nothing preventing me from running with general purpose data, but I imagine I’d have a snappier response with a smaller, focused dataset, without losing accuracy.

I am curious about trying an application specific AI. Like just for coding, for instance. I assume the memory requirements would be much lower.

Dude runs Solaris and OpenBSD, programming in Lisp is just an expansion of his quirkiness.