Unicode is intended to be a universal character set for describing all the characters required for written text incorporating all writing systems, technical symbols and punctuation.

learn more… | top users | synonyms

3
votes
2answers
69 views

Create nice url with diactrics removal

Please review my class. It uses iconv() (it's probably not the best solution however I haven't found any better alternative to change unknown characters). ...
11
votes
3answers
962 views

Customised Java UTF-16

I have implemented customized encoding mechanism for javaUTF16. Does this implementation support all the characters? ...
3
votes
2answers
292 views

Custom encoding for BinaryReader

I have a file that seems to mix encoding in it. It seems like a Unicode encoded file, but the character length string is encoded like a UTF8 or similar. Here is an example: ...
6
votes
4answers
1k views

Function to convert ISO-8859-1 to UTF-8

I wrote this function last year to convert between the two encodings and just found it. It takes a text buffer and its size, then converts to UTF-8 if there's enough space. What should be changed to ...
5
votes
1answer
2k views

Getting data correctly from <span> tag with beautifulsoup and regex

I am scraping an online shop page, trying to get the price mentioned in that page. In the following block the price is mentioned: ...
1
vote
2answers
177 views

node.js library for extracting words from a text

I'm looking for feedback on my library for extracting words from a text: https://npmjs.org/package/uwords The extracted word is defined as sequence of Unicode characters from Lu, Ll, Lt, Lm, Lo ...
6
votes
1answer
153 views

dir=“auto” JavaScript shim for IE

Reason for script: dir="auto" is an attribute value from the HTML 5 spec with current poor support in IE and Opera browsers ...
4
votes
2answers
167 views

isRTL.coffee - A JavaScript Library to determine if a text is of Right To Left direction

I just wrote this tiny library called isRTL.coffee to determine the direction of the text. Is there any better way of doing this? original code: ...
1
vote
1answer
212 views

Ruby code to identify 2-byte characters

I just wrote this fuzzy snippet to identify any 2-byte character in my data file which assumes only 1-byte characters (ANSI). Please review and suggest me any better solution! ...
3
votes
4answers
177 views

String parsing with multiple delimeters

My data is in this format: 龍舟 龙舟 [long2 zhou1] /dragon boat/imperial boat/\n And I want to return: ...
3
votes
1answer
459 views

Unicode parsing in PHP

Firstly, apologies if this is not the correct type of question for here, I had it on the stackoverflow but it was closed with a suggestion I post here. I’m in the process of converting from Latin 15 ...
3
votes
1answer
649 views

Simplify regular expression? (Converting Unicode fractions to TeX)

Background I'm converting Unicode text to TeX for typesetting. In the input, I'm allowing simple fractions like ½ and ⅔ using single Unicode characters and complex fractions like ¹²³/₄₅₆ using ...