The idea that sadness, even from sin, is disgraceful and damaging is discussed in Tanya, ch. 27-29.

When there is no poor person present, place coins in the pushkah. The mikvah should be used for טבילת עזרא and in general for added kedusha. Say Tehillim every day after davening. https://www.torahrecordings.com/rebbe/igroskodesh/011/009/3576