Questions tagged [parsing]
Use this tag for code that parses its input, or that is source for a parser generator such as yacc or lex.
1,316
questions
0
votes
1
answer
52
views
Parsing shortcodes out of a string
I wrote this shortcode parsing and it runs in \$O(N^2)\$. Is there a way to better optimize this?
...
- 151
1
vote
2
answers
53
views
Creating a dictionary from a word document using docx
I have a word document that contains alphabetical bullet points along with the key: value that I am trying to input into a dictionary using docx.
Example:
...
- 11
7
votes
2
answers
699
views
Read a large CSV order book
I am trying to read entries of my CSV file into an entries vector whose data type is object OrderBookEntry, which is an object that stores the tokenized variables ...
7
votes
1
answer
123
views
Chess position representation with FEN parser
I'm developing a UCI chess engine and as part of my engine I need a position representation that stores the position of every piece on the board and all the information about the game, like castling ...
- 108
3
votes
1
answer
85
views
Generating indent and dedent tokens for python-style indenting code
I found lexy, a C++ template-based parser combinator, that helps a lot to build a language parser.
The problem is that lexy can only deal with context free grammar, and python indentation is not ...
- 293
0
votes
1
answer
49
views
Checking several strings against a n-depth list of lists and returning one if its values
The data structure I am working with is a list of lists that is created by parsing a file.
The depth of the list can vary. The list can have n Strings before its child-value begins.
My current example ...
- 161
2
votes
0
answers
44
views
Pillow plugin adding support for the QOI image format
Pillow is a popular library for handling images in Python. My code adds support for the QOI image format to Pillow.
Aside from loading and saving QOI images, my goal was to write a streaming decoder ...
- 1,865
1
vote
1
answer
52
views
State machine for parsing GitHub URL formats
A while ago, I wrote a small Rust crate for parsing & generating URLs for GitHub repositories in various formats (HTTPS, SSH, git://, etc.), with the parsing done using regular expressions with ...
- 268
1
vote
0
answers
88
views
Top-down parser for arithmetic expressions
Here is a JS parser for a simple language we use at work.
For now it can only parse arithmetic expressions.
I would like to make sure I am on the right track before starting with the other constructs, ...
- 11
1
vote
2
answers
69
views
Parse list of UserPrincipal objects into custom class
I'm wondering how I could optimize this method that takes in a list of UserPrincipal objects, filters them by Regex and inserts the new class instance into a list. It takes 4 to 5 seconds for an input ...
- 11
1
vote
0
answers
42
views
Parsing log files for scan date, IP address, ports, etc. to create JSON
I wrote this code that uses the nom library to parse some values from a log file and then output data in JSON format.
I had to use a lot of variables for the cases when the parses found nothing, ...
- 11
3
votes
5
answers
277
views
Struct that parses full name into first name, middle name, last name and suffix
The struct below parses full name into first name, middle name, last name and suffix.
Perhaps Builder pattern is more appropriate here? I remember there was a principle referring to the number of ...
- 631
3
votes
1
answer
83
views
PHP Laravel Check if given date is a week or a regular day
I have a problem. In my project the user can copy a menu for a specific day or for a specific week. The value that will be sent to the back-end will be something like:
...
- 133
8
votes
1
answer
287
views
Mathematical expression evaluator (C++)
I'm new to C++ and I decided to experiment with the language, by writing a mathematical expression evaluator, using the Shunting-Yard algorithm. A design choice that may stand out as weird is the fact ...
- 81
2
votes
2
answers
108
views
Parse a text file, and map to an out-of-scope POJO
I need to parse a file, with a standard formatting:
...
- 123
3
votes
1
answer
240
views
Processing lines of a file with various space-separated fields of strings, hex addresses, and integer addresses
I have a plain text file which contains lines with fields below:
...
- 181
1
vote
1
answer
64
views
Parsing an XML tree of categories
I have parse function which is parsing tree of categories. I've written it in simplest way possible and now struggling with refactoring it.
Every nested loop is doing the same stuff but appending ...
- 21
2
votes
1
answer
54
views
Iterate over a process' maps file
The following logic provides iteration over /proc/<PID>/maps for a Linux process. What I'm primarily (though not solely) interested in for this review is ...
- 257
1
vote
1
answer
73
views
Parsing: Сollecting data from a book site
A task:
Сollect data from the site in the following format:
book; user; book_rating; comment_rating; publication_date; comment
For one book at once several pages of ...
- 57
2
votes
1
answer
46
views
Improvement for parsing LTL grammer
I'm new here. I wrote the following code to parse the linear temporal logic(LTL) formula and evaluate it with respect to a trace. But I'm totally not happy with my code because I think the complexity ...
2
votes
1
answer
27
views
parsing source code to generate documentation of an open source program (StreetComplete, an OpenStreetMap editor) - 1180 lines of Kotlin script
All help welcomed!
I posted a big chunk of code here - but feel free to review only a small section. I will use answers to improve this deployed open source software.
About the code
This code works. ...
3
votes
2
answers
1k
views
Password Validation Class
I created a class designed to validate passwords based on user defined criteria. Each PasswordValidator object objects a minimum and maximum password length, a character blacklist, as well as ...
- 55
2
votes
2
answers
110
views
Python function that parses a long string as key-value pairs for logging
I noticed I tend to use many if-conditions in my code, and I know there is a way to simplify this with one-liners.
The function is iterating through configuration dictionaries so that I can log ...
- 23
0
votes
0
answers
23
views
2
votes
1
answer
105
views
Commented Parser Combinators in Lisp-style C
I've attempted to remedy the issues outlined in the answer to my previous question. I've added several hundred blank lines to better illustrate the grouping of functions and generally make things look ...
- 1,998
2
votes
1
answer
126
views
Parser Combinators in C redux
A few more rewrites down the line from my previous question, this is the C version 11 based on the PostScript prototype version 12. The PostScript version is shorter, but it's some crazy ass ...
- 1,998
3
votes
2
answers
84
views
Parse a document and returning uniqueness and total number occurrences
I am parsing a document and returning
(1) uniqueness, and
(2) total number occurrence.
I believe my code can still be subjected to review. I would like a review of my code as I have even made it too ...
- 149
0
votes
1
answer
69
views
Function to perform a logical NOT in a string
I am using "tinyexpr", a cute library that can solve mathematical formulas in a string and I extended it such that it does logical operations with two operands as well.
However I wasn't sure ...
- 1,538
1
vote
2
answers
92
views
Parse string using character value for Unicode characters
I added the getCValue method to reduce the cyclomatic complexity, but the cyclomatic complexity still persists. How can I reduce it? Can I change this code using ...
- 11
2
votes
1
answer
101
views
Text splitter using Regular Expressions in Python
I have been provided a text splitter class that will take a text input and use re.sub to make replacements when matches are found and also splits sentences up and stores them in a list.
I had an idea ...
- 23
5
votes
0
answers
57
views
Menu Parser in C
This is a simple program that parses a menu specification and creates a menu tree.
Why?
I want to create a menu application, where the user can select an entry in the menu, and either a submenu can ...
- 151
0
votes
0
answers
36
views
I am building a container of differently typed variables with names for easy parsing and usage in Rust
I am new to Rust and trying to learn more about it. I want to have some kind of container that can store parameters (variables, values, constants) of varying types together with a name. This container ...
- 101
1
vote
2
answers
190
views
Reading 12-bit words from 32-bit stream
I have a device (ADC) that stores its samples in a 32-bit buffer and each sample is a 12-bit word :
I needed an algorithm to read those samples to a container (say ...
- 771
2
votes
2
answers
94
views
Regex and pandas to read forecast sky condition string
DataFrame methods to parse the sky condition from a terminal aerodrome forecast.
A line in a taf can report zero-eight cloud layers. Cloud layers are required in predominate lines, and optional in ...
- 608
8
votes
2
answers
802
views
Markup Language Parser in C++
I'm new to C++ and decided to write a parser for a markup language. I chose org-mode because it seemed relatively straightforward.
parsertest.cpp
...
- 83
4
votes
1
answer
141
views
Python script for zlib decompression
I'm looking for feedback/improvement on code that I wrote. It's a function that scans a file for zlib headers and returns the header, offset, and decompressed data. In main, below the function, I use ...
- 41
4
votes
1
answer
139
views
Parsing an IP routing report with half a million lines into a PANDAS dataframe
I have a file that has around 440K lines of data. I need to read these data and find the actual "table" in the text file. Part of the text file looks like this.
...
- 141
3
votes
1
answer
124
views
Fetch CSV file into PANDAS and send report of Spotify statistics
I'm relatively new and self taught in Python. I've written this code which gets a CSV file from a website, plays around with the data then creates an email with information gleaned.
I know this is too ...
- 33
3
votes
1
answer
111
views
Processing a binary file with buffer length tags
I am trying to process a very large binary file using MappedByteBuffer from java.nio package.
This is how the data looks like in the file:
...
- 33
6
votes
0
answers
281
views
Parsing indented text into a tree structure in C#
My goal is to take an input stream (text file), and then parse it into a tree node based on each line's indentation.
My rules are
Lines can be indented using either tabs or spaces, but the file must ...
- 161
4
votes
1
answer
373
views
Haskell: implementing Read for a custom dynamic value type
I'm using Haskell to interpret a dynamically-typed language. I have a sum type called Value which can represent some basic objects:
...
- 143
3
votes
1
answer
58
views
Quickly read numeric input
Do you have any criticisms or corrections or improvements?
I need to read only numbers(and this numbers could be from 0 to 1000000)
...
- 33
1
vote
2
answers
88
views
Function to read a file until next token
I've got this function which reads an entry until the next starting Token determined through a function, as the nature of the token is flexible.
Usage:
...
- 449
9
votes
1
answer
1k
views
Python script to analyse Apache log files
I am fairly new to Python programming language. Most of python programmers have heard the philosophy behind the python programming language. The code should be easy to read, easy to understand, simple,...
- 101
2
votes
2
answers
105
views
Parse a string with titles and subitems to an object
I want to parse a string to an array of object with following those rules:
parse line by line
if line starts with "*" this is a title
if line starts with "\s**" this is a ...
- 175
4
votes
1
answer
79
views
Awk program for extracting unique values from a k1=v1,k2=v2,... list
A single string consisting of comma-separated pairs in the format <key>=<value>, like
...
- 43
1
vote
0
answers
71
views
Gemtext parser in JavaScript
Gemtext is a lightweight markup language designed to serve content over the Gemini protocol.
You can learn more about the language here: A quick introduction to "gemtext" markup, or the ...
- 1,865
4
votes
0
answers
38
views
formatting flattened string into JSON-like object in C++, part 2
I have reworked the code from my previous (linked) post.
For reference:
I have a string which contains JSON-like object flattened (stringify()ed).
I need to JSON-...
- 779
3
votes
0
answers
87
views
Mini Scheme interpreter
Right now, I'm working on an interpreter for a subset of the Scheme programming language. It supports lambdas, let/let*/letrec, procedures, combinations, ...
2
votes
1
answer
92
views
formatting flattened string into JSON-like object in C++
I have a string which contains JSON-like object flattened (stringify()ed).
I need to JSON-ify it back. It's a custom format, so I wrote function to JSON-ify the ...
- 779