For the data processing I do time to time it is quite often really useful to have a 'normalize' function. Such a function converts unicode character to their ASCII 'equivalent' character or string. This is useful as a lot of older systems do not support unicode and to match strings I have to convert the unicode ones to the older ASCII equivalent. The function I use to do this is a simple lookup in a large lookup table, like this:
(defun normalize (string)
(check-type string string)
(format nil "~{~A~}"
(loop :for el :across string
:collect (aref +unicode-lookup-table+
(char-code el)))))I think such a function could be really useful in a unicode library. Is this something that fits this library and how would you feel about a pull request to add this functionality?
For the data processing I do time to time it is quite often really useful to have a 'normalize' function. Such a function converts unicode character to their ASCII 'equivalent' character or string. This is useful as a lot of older systems do not support unicode and to match strings I have to convert the unicode ones to the older ASCII equivalent. The function I use to do this is a simple lookup in a large lookup table, like this:
I think such a function could be really useful in a unicode library. Is this something that fits this library and how would you feel about a pull request to add this functionality?