If you can sew a button on, you can just take a strip of felt, sew a button on one side, then fix (either a safety pin or just a staple or anything) one ear elastic to the other side. This would be no more trouble to get on and off than over the ears. Or, just suffer the ear elastics.
I ran a cord through all my masks that goes behind my neck and up over my head because I cannot tolerate the ear elastics. I have this setup:
mask
and yeah, total PITA with hats and scarf, but oh well.