Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 279033

Use this tag for code that parses its input, or that is source for a parser generator such as yacc or lex.

6 votes
2 answers
537 views

Natural language text fast tokenizer

It gets the argument as the reference to the pointer to the place where from it should start parsing and updates this pointer, moving to the position past the read lexem. …
Damir Tenishev's user avatar
3 votes
1 answer
112 views

Natural language text fast tokenizer (Rev.2)

This is the second iteration of the Natural language text fast tokenizer code review. Special thanks goes to G. Sliepen and Toby Speight who conducted the first review. Functional specification Implem …
Damir Tenishev's user avatar
5 votes
2 answers
523 views

Natural language text fast tokenizer (Rev.3)

This is the third iteration of the Natural language text fast tokenizer code review. Special thanks goes to G. Sliepen, Toby Speight and uli who conducted previous reviews and to Matthieu M. and Adria …
Damir Tenishev's user avatar
3 votes
1 answer
80 views

Natural language text fast tokenizer (Rev.4)

Consider out of scope paired quotes and other lexical parsing level issues. Performance is critical, since the amount of data is huge. The function should be thread-safe. …
Damir Tenishev's user avatar
4 votes
1 answer
164 views

Natural language text fast tokenizer (Rev.5)

Consider out of scope paired quotes and other lexical parsing level issues. Performance is critical, since the amount of data is huge. The function should be thread-safe. …
Damir Tenishev's user avatar
3 votes
1 answer
117 views

Multithreaded natural language text parser (Rev.3)

This is the third iteration of the Multithreaded natural language text parser code review. Special thanks goes to G. Sliepen who conducted the first two reviews. Before reading this post, please read …
Damir Tenishev's user avatar
2 votes
1 answer
115 views

Multithreaded natural language text parser

Could you please conduct code review for the code below and suggest some improvements? Functional specification Implement a multithreading parser based on existing natural language tokenizer. Parser …
Damir Tenishev's user avatar
2 votes
1 answer
73 views

Multithreaded natural language text parser (Rev.2)

compiled_text.data.append_range(result.get()); } return compiled_text; } Final thoughts The main problem this approach is that in case I use Concurrency::concurrent_unordered_map during parsing
Damir Tenishev's user avatar