DroneAcharya
BANNED
- Joined
- Sep 5, 2012
- Messages
- 226
- Reaction score
- 0
Hello Admin. ,
It seems that there is an extremely poor and naive implementation of word-filtering currently in the system. Wouldn't you rather filter words converting them (say) into lowercase than simple exact-word matching from the list of stop/filter words ? This is one of the ways to effectively weed out incorrectly used words. Another way is to use something like edit-distance measures with a high threshold. Just a suggestion to improve your system.
It seems that there is an extremely poor and naive implementation of word-filtering currently in the system. Wouldn't you rather filter words converting them (say) into lowercase than simple exact-word matching from the list of stop/filter words ? This is one of the ways to effectively weed out incorrectly used words. Another way is to use something like edit-distance measures with a high threshold. Just a suggestion to improve your system.
