As far as we understood your desire it is rather not possible to obtain (maybe with adding additional supports...)
Take a look at attached screen shot. This is an example of wall subjected to act only in Y / Z directions (supports blocking X in all nodes defined). So for such simple model you get "axial" wall deformation.
BTW: do not you think you should use Membrane diapgragm rather then Rigid?
Of course it is your choice, just my remark.