I find the concept of downvoting very toxic and discouraging. It can potentially prevent people to express different views, something a discussion and our personal development is thriving on. It can be well seen on Reddit and even on Lemmy, where people with different views get sometimes heavily downvoted. It is something I consider to be close to “cancel culture” - a majority decides not to like your opinion, so it tries to silence you by voting you “out”. I would really love to see that Lemmy removes this feature and just allows to upvote - so you can upvote a comment or not, but you cannot downvote a comment.
In my opinion, you’re doing a great job by not enabling downvotes. Every user can see how many votes their comment has, which should be enough for them to gauge how well their comment is received. 👍
I haven’t been on Stack Overflow for a long time (around 15 years ago). Back then, I was mostly focused on statistics and programming in R. It’s true that rude responses were rare, especially in the sense that the OP should have known the answer beforehand or could have researched it themselves before asking. But yes, I never saw personal attacks.