How to Attack Buildings in Empire Total War

Taking Buildings during Empire Total War battles is really a fairly brutal and simple task, but can be dangerous and cause you high casualties.
There are really only two options:
1. Bombardment: Use artillery to destroy buildings at long-range. At some point the building will catch fire and the enemy troops inside will have to get out. You can then deal with them in the most appropriate way.
2. Frontal Assault: If you don't have artillery on hand, or if you really need to take a building quickly. then assault by decent infantry is the best option. This will mean high casualties and probably requires at least a 2:1 advantage to succeed.
What you really don't want to do is try to shoot it out with muskets. You will find that you cause few casualties to the enemy and no damage to the building.