As Philosaur and Greg noted, for an orbiting object gravity is a centripetal force (centripetal=towards the center). Any other centripetal force, if there were one, would add to it, not balance it. What one usually says is that motion in a circle (or ellipse) involves acceleration since the velocity is changing; therefore there must be an unbalanced force, and that's gravity.
However there is a way to think of the orbit as the result of two canceling forces. If you go to a rotating reference frame, e.g. one that rotates with the orbiting object, then there are so-called "fictitious forces" (a name I object to, incidentally). One such force is centrifugal (=away from the center). An object at rest in the rotating frame is orbiting, and the centrifugal force cancels the gravitational attraction, which allows it to remain at rest.