Treason, probably. Probably a few other things.
I would have previously said any criminal act committed while in office, but Clinton's impeachment for perjury sets a precedent that criminal acts are not necessarily proof of unfitness.
But I make a distinction between fitness and desirability. I'm sure at least half the country was convinced that Trump was unfit for office before he ever got elected. In a very important way, that's what elections are for. A person must meet exactly two objective criteria for eligibility: Age and citizenship. The rest is all consensus-based determinations, which vary from case to case. By definition, anyone who wins an election is fit for office.
---
By the 25th Amendment, unfitness for office consists of being unable to communicate clearly in writing (though Congress is free to establish additional or superseding criteria).