There are two main reasons:
1. That would be admittance that yet another War on Noun was pathetic failure. Many politicians would not stomach it.
2. Private prisons lobby will do everything to maintain source of income - preserving criminalisation of weed.
In fact, private prisons in USA are complete perversion of "free market". In conjunction with legalized corruption called "lobbying" it creates current situation.
Private prison lobby can't be counted out - they donated to help pass California's three strikes laws and know that legal marijuana will mean less "customers" since so many in the states are jailed for possession.
That said, I think the biggest blockage is more cultural than anything to do with "lobbies" - its the shadow of the 60s,70s and the Drug War 80s that leaves many citizens feeling since they don't smoke it, and it's probably "bad" (why else would it be illegal?) that it should remain prohibited.
And while polls show this is changing, significant and politically powerful minorities of most western Nations (ie, the Blue Hair vote) continue to respond to this as a culture war issue.
Here in Canada we have no huge private prison industry (a fledgling one only) and it is a key plank of our governing party seeking reelection to keep it illegal (all other parties support decriminalization or legalization in their platforms) . This is pure culture war stuff, not the product of lobbying but the connection of a wedge issue to what I believe is an honestly held prohibitionist mindset in our sitting PM and among most of his MPs
As with teh gayz, will take a die off of our oldest generation before this goes away - and that's already been happening - but probably needs to continue a few years more before we have legal weed in all states and in Canada.
Even once it is legalized there will still be politically significant sections of the polity gnashing their teeth at this scary new development - and politicians will court them - though I expect this will eventually become the dying position of the fringe right wing.