undefined | Better HN

0 pointsthesz6mo ago0 comments

I took a look at the Taelin's work [1].

[1] https://github.com/HigherOrderCO/HVM

From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted.

BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved. What were these 16K cores? What were these tasks?

0 comments

killerstorm6mo ago

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out.

Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

theszOP6mo ago

  > something better than anything else in this category

That is a strong statement.

[1] https://en.wikipedia.org/wiki/Id_(programming_language)

Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes.

In some of the tasks the amount of parallel execution discovered by Id90 would lead to overflow of content-addressable memory and Id90's runtime implemented throttling to reduce available parallelism to make things to be done at all.

Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not.

This is serious negligence of Taelin.

killerstorm6mo ago

I mean their code synthesis thing (i.e. "generate function code from input-output pairs") is better than anything from academia by many orders of magnitude. But it's not published yet.

I dunno why you choose to be so critical. Taelin isn't really selling his stuff, and his previous stuff was just an open source experiment. It's not an academic paper which claims something. And HVM1 is irrelevant now.

Their new stuff isn't about general performance but code synthesis

j / k navigate · click thread line to collapse

0 comments

killerstorm6mo ago

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out.

Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

theszOP6mo ago

  > something better than anything else in this category

That is a strong statement.

[1] https://en.wikipedia.org/wiki/Id_(programming_language)

Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes.

Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not.

This is serious negligence of Taelin.

killerstorm6mo ago

I mean their code synthesis thing (i.e. "generate function code from input-output pairs") is better than anything from academia by many orders of magnitude. But it's not published yet.

Their new stuff isn't about general performance but code synthesis

j / k navigate · click thread line to collapse