ROCmFPX is an experimental llama.cpp fork for AMD hardware with ROCmFP3, FP4, FP6, and FP8 model-weight quants. The part worth reading is the operator caution around agent presets, K cache quality, and smoke tests for JSON, tool calls, coding, coherency, and streaming.
discussion (0)