Low-level coding dataset

Disclaimer: this is a repost from something I put in LocalLLaMA, but with some tweaks for the r/cpp crowd - the version over there is more ML focused, this is more code focused

Hi all,

I've recently been thinking about putting together a community sourced coding dataset for finetuning models, with a heavy focus on cpp and systems programming.

My goal is to eventually have a model (say a finetune of Qwen3.6-27b) that is good at stuff like memory ownership, thread safety, optimization concepts, etc. Right now I feel like the coding knowledge of most locally runnable models is restricted to high-level langs like py and js.

Right now I'm thinking a jsonl file with categories like this:

\- generation: basic prompt/code output
\- optimization: heres slow/bloated code, make it better
\- debugging: im getting this error pls fix
\- organization: code review, interface design, restructuring, tradeoff decisions
\- tool_calling: exercises involving tool use and interpreting results

Does anyone have any ideas for things I'm missing? Curious to see what the people over here think about this kind of thing. Are there any knowledge gaps you guys feel current models have that we can maybe try to improve with this?

Thanks in advance for all the help!

https://redd.it/1tk9dgh
@r_cpp