Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 75307

Lexical analysis is the process of converting a sequence of characters into a sequence of tokens.

7 votes

Efficient C Tokenizer/Lexer in C++

Careful with <cctype> functions - these accept positive int values, and only one negative value: EOF. Passing char to std::isalpha() results in Undefined Behaviour because it may be sign-extended in …
Toby Speight's user avatar
  • 81.7k
3 votes

Lexical Analyzer In C++

The header file contains definitions of functions. That's a bad idea, because it means that every translation unit that includes it will then contain those definitions, causing conflict when you try …
Toby Speight's user avatar
  • 81.7k
2 votes

Mustache lexer class

A Makefile review Your object files should not each depend on all the headers. You'll find that doing so will not be a problem now, but will waste a lot of your time as your project grows. Instead, …
Toby Speight's user avatar
  • 81.7k
4 votes

Parsing a C++ function declaration with Perl 6 grammar

I'd expect to see many more tests of any program that addresses a problem as gnarly as parsing a C++ declaration. Choosing a couple I've recently had cause to write (on Stack Overflow), I would immed …
Toby Speight's user avatar
  • 81.7k
3 votes
Accepted

Tokenizer Class for handling .csv files in c++17

Firstly, thanks for providing the test program. That always makes code easier to review. Unfortunately, when I tried it, I found a null pointer dereference here: std::string s = *std::get_if<s …
Toby Speight's user avatar
  • 81.7k