Alma 32:3

therefore they were not permitted to enter into their synagogues to worship God, being esteemed as filthiness; therefore they were poor; yea, they were esteemed by their brethren as dross; therefore they were poor as to things of the world; and also they were poor in heart.

They were not allowed to go into the churches to worship God. Other people thought they were dirty. They were poor. Their own brothers thought they were worthless. They were poor in the things of the world. They were also poor in heart.

They weren’t allowed to enter and worship God. They were treated like dirt. Their own people looked down on them as worthless. They were poor in material things, and they were also poor in spirit.