May I ask what makes you think that your drawing is still in mm after changing the unit? The unit of your drawing is almost irrelevant for QCAD in construction mode. QCAD simply works with 'units', whatever a unit is. The drawing unit only plays a role when printing to scale.
The formatting of dimension labels is controlled from the drawing preferences (edit - drawing preferences - dimensions).