You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on May 27, 2025. It is now read-only.
david-jennings edited this page Sep 19, 2016
·
8 revisions
utilities
io-bandwidth: pass stdin to stdout and echo bandwidth to stderr
io-cat: concatenate or merge to stdout multiple input streams: tcp, pipes, files, etc
io-line: a line based stream tool to make reading lines from pipes non-destructive
io-ls: a quick parser for /proc/net/tcp; much faster than lsof, which may be very slow; linux only
io-publish: publish an input stream to multiple streams: tcp, pipes, files, etc
io-tee: fork data stream from stdin to an arbitrary pipeline with the deterministic termination
udp-client: a trivial udp receiver, since netcat and socat don't seem to handle udp very well; deprecated, use io-cat
zero-cat: a simple wrapper for a few widely used zmq stream patterns
io-line
First annotate the stream with line sizes using io-line length. Then use the io-line tool to get individual lines from the pipe. Tools like head will read the pipe using a buffer and will take more characters from the pipe then required. Other tools like bash read will take one character at a time and so can be quite slow.
processor | io-line length | { io-line get ; echo @ ; io-line get ; }
The io-line length and get combination has proven to be 10 times faster in one particular test with single lines that contained the encoded content of an otherwise wise quite large CSV file.