Those things don't require quantities of power sufficient to create the things being explored, discovered, experienced, and/or enjoyed out of pure energy.
I'm seriously wondering about diminishing returns here. Having enough energy to heat or cool my living space to around 23 degrees C is very nice. Being able to cool it to 1 Kelvin or heat it to a million degrees wouldn't improve it any farther. In a Dyson Swarm civilization either I'd control enough matter, energy, and processing to have my own personal continent-sized Disneyland; or I'd be one of an absurdly huge population. Would either of those things benefit me very much compared to my current life? If maximizing the population is the imperative, then we'd just be scaling up scarcity; if not, then what's the swarm for?
Zooming around the galaxy visiting habitable alien planets sounds like fun if we could use Star Wars hyperdrives, but the laws of physics don't appear to give us those. Instead the type II civ, if they avoid scarcity, could have elaborate personal/family living spaces, with travel from place to place within a swarm (a large stationary swarm or a smaller in-transit swarm), from one artificial environment to another. It's the suburbs, scaled up, in spaaaaaaace!