You have not given much detail about what you want to accomplish with the 1841 and the 4ESW for MPLS. If you want them to function as the CE router in an MPLS environment then certainly you can do this with these devices. If you want to do something more complex (such as actually switching tagged frames) you need to give us more specifics of what you want to accomplish.
HTH
Rick
HTH
Rick