The carb body is very soft alloy and doesn't take a lot of abuse or wear. The plastic sleeve is probably designed for two purposes
1. To prevent metal to metal contact on the manifold and wear on the carb body. The plastic should be the sacrificial part but often it has become hard and the manifold actually wears resulting in both needing replaced.
2. To provide the seal between the carb body and the manifold. The slits in each shouldn't be aligned, so that when they clamp tightens down they don't draw air.
I did mine recently, because mine was worn and the carb was rotating on the manifold causing the throttle cable to effectively shortening the cable and causing high revving issues. Getting the old one out isn't the hard part, as others have said you can break it up in situ and on some carbs if you take the slide out and look down the bore you can see a small rebate that will allow you to get a small narrow punch on the back of the sleeve and gently knock it out. You have to have accepted that you're not getting it out in one piece.
While I had it out I ran a hacksaw blade down the slots in the body as they were quite compressed.
To get it back in I had to warm the carb body and soften the new bush in hot water and then, using the jaws of my workmate gently wind it in. The plastic bush distorted quite a bit before eventually popping in straight just after the point where I thought I'd wrecked it
