Show HN: Pyp – Easily, magically, run Python at the shell (opens in new tab)

Thanks for sharing! I hadn't seen Mario before. The async support is super nifty! From a quick look, it looks like pyp might be a little quicker for some use cases since it doesn't need subcommands, but I'll definitely be updating https://github.com/hauntsaninja/pyp#related-projects

+1 for mario.

It even has addons which enables extras like:

https://mario-addons.readthedocs.io/en/latest/cli_reference....

xonsh is great! I'm a fan of your cousin's work :-) I mentioned it in https://github.com/hauntsaninja/pyp#related-projects for if you want even more Python in your shell.

Cool! It's mentioned in pyp's README:

"xonsh is a shell whose language is a superset of Python; this is more ambitious and pretty different from pyp. pyp is easier to use for the one-liner piping use case, but if you need more Python in your shell, check out xonsh."

Thanks! Xonsh is my daily driver. With the vox plugin, don't even need virtualenv

It still seems odd to me. While these projects are nice, if the functionality is not supported in the core system, it is rarely worth the additional trouble (imho). Situation is similar to gitless - git's cli interface sucks, but it is available on every dev machine.

Was hoping to find a comment just like yours! Thanks!

I use Ruby from the cli frequently for stuff that exceeds an easy jq expression or if jq is not availabel but Ruby is (which happens a lot on RHEL systems when EPEL is not enabled, which is the case in a lot of banks) Ruby's awk -> perl -> ruby heritage endows it with a pretty good cli mode, but sometimes it's verbose. For example parsing json:

    curl https://something \
      | ruby -r json -e "puts JSON.parse(STDIN.read)['data']['ip']"

But obviously that's wordier than it needs. (To pre-empt the "just use jq!" people, I agree. For simple examples I would just use jq. This example here is just an example).

Awesome! Thanks!

Yup, that was the inspiration for this project and its name. See https://github.com/hauntsaninja/pyp#related-projects for more discussion. By no means is this a new idea, but I think this iteration has some convenient twists :-)

[sh.py]: https://amoffat.github.io/sh/

Thanks for checking pyp out!

Startup time hasn't been particularly perceptible in my use of it. Just ran a quick benchmark on my (old, not powerful) laptop:

  ~ λ hyperfine 'pyp x'
  Benchmark #1: pyp x
    Time (mean ± σ):      75.9 ms ±   1.2 ms    [User: 55.9 ms, System: 15.1 ms]
    Range (min … max):    74.5 ms …  79.0 ms    36 runs

Since there isn't any input, this should just measure startup and AST transformation time.

Thanks! This will make things a little easier for me as I move in to sysadminning and JS development.

Surprised it didnt exist already

There are a number of possible options! And remember you can always pipe pyp to pyp. Here are some ideas, in order of what came to mind, where the operation is incrementing.

  pyp 'lines[lines.index("start") + 1:]' | pyp 'lines[:lines.index("end")]' | pyp 'int(x) + 1'
  
  pyp 'start = lines.index("start"); end = lines.index("end", start); map(lambda x: int(x) + 1, lines[start + 1:end])'
  
  pyp 'dropwhile(lambda x: x != "start", lines)' | pyp 'lines[1:]' | pyp 'takewhile(lambda x: x != "end", lines)' | pyp 'int(x) + 1'
  
  pyp 'map(lambda x: int(x) + 1, takewhile(lambda x: x != "end", islice(dropwhile(lambda x: x != "start", lines), 1, None)))'
  
  pyp -b 'cond = False' 'if cond and x == "end": break' 'if cond: print(int(x) + 1)' 'if x == "start": cond = True'

Having moved from Perl to Python many years ago, this is one of those things that Perl has magic to handle, for example:

    perl -lne '$sum += $_ if /start:/ .. /end:/; END{print $sum}' file.txt

With the -n option, perl runs your code for every line in the input (stdin, or filenames). $_ holds the content of the line. And the .. operator is a stateful (!) operator that becomes true when its left part becomes true, until the right part becomes true.

So I write 95% of my code in Python, but for command line magic, it's hard to beat Perl.

Looks like there are no dependencies, so it should start pretty fast.

And sure enough, it's both easy and reasonably fast to run:

  $ time seq 1 10000 | awk '{a+=$0}END{print a}'
  50005000
  seq 1 10000  0.00s user 0.00s system 91% cpu 0.002 total
  awk '{a+=$0}END{print a}'  0.01s user 0.00s system 95% cpu 0.008 total
  $ time seq 1 10000 | python3 pyp.py 'sum(map(int, lines))'
  50005000
  seq 1 10000  0.00s user 0.00s system 80% cpu 0.002 total
  python3 pyp.py 'sum(map(int, lines))'  0.06s user 0.01s system 99% cpu 0.070 total

I wouldn't run it in a loop, but it's definitely a contender even in high-ish performance situations.