2
\$\begingroup\$

I have an application which log file has most lines start with a time/date, followed by a debugging level and the actual log message. Often I want to watch the output live and colors make it a lot better readable. This is what I use at the moment for piping the logs:

while read line; do
echo "$line" |
sed -e "s,^.* DEBUG,$(tput setaf 2)&$(tput sgr0)," \
    -e "s,^.* INFO,$(tput setaf 2)&$(tput sgr0)," \
    -e "s,^.* WARN,$(tput setaf 3)&$(tput sgr0)," \
    -e "s,^.* ERROR,$(tput setaf 1)&$(tput sgr0)," \
    -e "s,^.* SEVERE,$(tput setaf 1)$(tput bold)&$(tput sgr0),"
done

The call on the command line looks like this:

tail -fn 200 /path/server.log | ./logparser

This all works as expected but when many lines are printed at once the parser lags behind. I think this is because I run sed once for every single line. Is there a better solution?

\$\endgroup\$
9
  • 2
    \$\begingroup\$ You're wasting time having the shell read input and repeat it to sed. Why are you doing that? sed would just read from standard input anyway? The logparser script could just be one line or you could put the commands in an input file and throw away the logparser script. \$\endgroup\$
    – itsbruce
    Commented Mar 17, 2015 at 11:16
  • \$\begingroup\$ tail -fn 200 /path/server.log | sed -f /path/to/sedcommands \$\endgroup\$
    – itsbruce
    Commented Mar 17, 2015 at 11:18
  • \$\begingroup\$ How would I use tput in a sed script? I really prefer tput over the arcane obscure escape key notation for terminal colors. \$\endgroup\$
    – Hugo G
    Commented Mar 17, 2015 at 11:25
  • 1
    \$\begingroup\$ @itsbruce feel free to post a real answer and you'll get some points :-) \$\endgroup\$
    – Hugo G
    Commented Mar 17, 2015 at 11:30
  • 1
    \$\begingroup\$ Oh, well, I would but I wasn't so much reviewing your shell script as talking unix admin basics. When you have it working the way you want, post your own answer and say what worked for you. Perfectly acceptable StackExchange behaviour. \$\endgroup\$
    – itsbruce
    Commented Mar 17, 2015 at 11:32

1 Answer 1

Reset to default
1
\$\begingroup\$

Thanks to itsbruce this runs much faster:

sed -e "s,^.* DEBUG,$(tput setaf 2)&$(tput sgr0)," \
    -e "s,^.* INFO,$(tput setaf 2)&$(tput sgr0)," \
    -e "s,^.* WARN,$(tput setaf 3)&$(tput sgr0)," \
    -e "s,^.* ERROR,$(tput setaf 1)&$(tput sgr0)," \
    -e "s,^.* SEVERE,$(tput setaf 1)$(tput bold)&$(tput sgr0),"

Note: first two and the last line are removed.

Since sed takes the STDIN, this basically starts one sed instance for whole stream in contrast to one per line.

\$\endgroup\$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.