Unicode is intended to be a universal character set for describing all the characters required for written text incorporating all writing systems, technical symbols and punctuation.

learn more… | top users | synonyms

4
votes
1answer
53 views

Dealing with messy JSON API and UTF-8 encoding problems

I am using an API that returns a JSON object that has "encoded_polyline" fields that tend to result in errors like this one: ...
2
votes
1answer
50 views

Removing accents from certain characters

I have a method that I am using to remove accents from certain characters. The problem is the massive slew of characters I am expected to work with. I have to, basically, remove accents from all Latin ...
7
votes
1answer
70 views

Korean Romanization to Hangeul library

After a little work, I've finally ironed this out... Though could I get someone to go over this and see if there is a better way to present this library within the code, before I publish it? Premise: ...
2
votes
1answer
67 views
4
votes
3answers
80 views

Listing all the chars in a given UnicodeBlock

I want to visually inspect all the characters that Java thinks are in any given UnicodeBlock. The following method, as far as I can tell, does the task. But, it sure feels like awful design. ...
7
votes
1answer
85 views

Serialization: Escape Input String

In Json strings characters can be escaped with \\. Here is an iterator that can read such strings and convert the escaped characters to UTF-8 ...
4
votes
1answer
54 views

Data-checking class supporting letters

I'm starting to learn OOP with PHP, and all I've learned so far is just by searching and reading. So I have this need to check input data for certain things like min of chars, max of chars, spaced or ...
10
votes
3answers
382 views

Mutable String Class

Here is a String class that I've made for fun in my spare time, for myself. I have a few concerns about it, and am considering going immutable or a mix of the two ...
4
votes
1answer
63 views

Copy directories while changing Unicode filenames to ASCII

I created a short Perl 6 script copyfnameascii.pl to copy a file hierarchy I have, applying an URL Decoding to the names of folders and removing non-ASCII ...
3
votes
2answers
89 views

Create nice url with diactrics removal

Please review my class. It uses iconv() (it's probably not the best solution however I haven't found any better alternative to change unknown characters). ...
11
votes
3answers
1k views

Customised Java UTF-16

I have implemented customized encoding mechanism for javaUTF16. Does this implementation support all the characters? ...
3
votes
2answers
1k views

Custom encoding for BinaryReader

I have a file that seems to mix encoding in it. It seems like a Unicode encoded file, but the character length string is encoded like a UTF8 or similar. Here is an example: ...
6
votes
4answers
2k views

Function to convert ISO-8859-1 to UTF-8

I wrote this function last year to convert between the two encodings and just found it. It takes a text buffer and its size, then converts to UTF-8 if there's enough space. What should be changed to ...
6
votes
1answer
6k views

Getting data correctly from <span> tag with beautifulsoup and regex

I am scraping an online shop page, trying to get the price mentioned in that page. In the following block the price is mentioned: ...
1
vote
2answers
263 views

node.js library for extracting words from a text

I'm looking for feedback on my library for extracting words from a text: https://npmjs.org/package/uwords The extracted word is defined as sequence of Unicode characters from Lu, Ll, Lt, Lm, Lo ...
6
votes
1answer
221 views

dir=“auto” JavaScript shim for IE

Reason for script: dir="auto" is an attribute value from the HTML 5 spec with current poor support in IE and Opera browsers ...
5
votes
2answers
264 views

isRTL.coffee - A JavaScript Library to determine if a text is of Right To Left direction

I just wrote this tiny library called isRTL.coffee to determine the direction of the text. Is there any better way of doing this? original code: ...
1
vote
1answer
331 views

Ruby code to identify 2-byte characters

I just wrote this fuzzy snippet to identify any 2-byte character in my data file which assumes only 1-byte characters (ANSI). Please review and suggest me any better solution! ...
3
votes
4answers
188 views

String parsing with multiple delimeters

My data is in this format: 龍舟 龙舟 [long2 zhou1] /dragon boat/imperial boat/\n And I want to return: ...
3
votes
1answer
520 views

Unicode parsing in PHP

Firstly, apologies if this is not the correct type of question for here, I had it on the stackoverflow but it was closed with a suggestion I post here. I’m in the process of converting from Latin 15 ...
3
votes
1answer
801 views

Simplify regular expression? (Converting Unicode fractions to TeX)

Background I'm converting Unicode text to TeX for typesetting. In the input, I'm allowing simple fractions like ½ and ⅔ using single Unicode characters and complex fractions like ¹²³/₄₅₆ using ...