The process in which relatively unspecialized cells acquire specialized structural and/or functional features that characterize the mesenchymal cells of bone as it progresses from its formation to the mature state. [ GOC:hjd GOC:TermGenie http://www.ncbi.nlm.nih.gov/pubmed/21571217 ]