undefined | Better HN

0 pointsisaacimagine4y ago0 comments

Maybe a cross-language library that takes a binary weights file (with embedded model information) and exposes an interface similar to that of the web API? Or a local lightweight version of Nyckel that one can run on their own infrastructure (that exposes the same REST API)?

Just spitballing here; these two would be the most convinent for the use-cases I have in mind.

0 comments

saintarian4y ago

Agreed that they would be convenient. We are looking at both those options. There are devils in the details like seamlessly taking advantage of available hardware acceleration.

Would love to talk more about your use case so we prioritize the right things for model export. Drop me a line (george at nyckel dot com).

j / k navigate · click thread line to collapse

0 pointsisaacimagine4y ago0 comments

Just spitballing here; these two would be the most convinent for the use-cases I have in mind.

0 comments

saintarian4y ago

Agreed that they would be convenient. We are looking at both those options. There are devils in the details like seamlessly taking advantage of available hardware acceleration.

Would love to talk more about your use case so we prioritize the right things for model export. Drop me a line (george at nyckel dot com).

j / k navigate · click thread line to collapse