Show HN: Code Indexer Loop (opens in new tab)

(github.com)

28 pointsricklamers2y ago6 comments

This is a project I recently worked on at Definitive. We’re hoping to make it easier to semantically query (changing) source code files. We’d love to see people use it as a building block. If you have any suggestions please leave a comment or open a GitHub issue!

6 comments

funcDropShadow2y ago

Could anybody show some example queries and answers?

ricklamersOP2y ago

Queries on https://github.com/pypa/flit/tree/main/flit_core/flit_core (omitted tests/)

https://pastebin.com/qyzWm6YC

https://pastebin.com/DDnDKGxd

_boffin_2y ago

From the initial look, it looks like you're taking the work of SweepAI, a source-available repo, which gave(?) it to LlamaIndex(1) and then you're just providing a wrapper around the LlamaIndex that provides a way to do an Update statement.

1) https://docs.sweep.dev/blogs/chunking-improvements

ricklamersOP2y ago

Sweep is mentioned as attribution in multiple places a) https://github.com/definitive-io/code-indexer-loop#attributi... b) https://github.com/definitive-io/code-indexer-loop/blob/fd9d...

The difference is packaging it as a consumable PyPI package that can easily be used in a project (they even call out for separating this out into a stand alone project but that they lack the time to do so: https://docs.sweep.dev/blogs/chunking-2m-files#future- )

In addition, we expand and fix the implementation, for example it now supports limiting on token count instead of character count, and we fix some white space inconsistencies in parsing/chunk reconstruction.

_boffin_2y ago

Looking forward to diving further in and seeing how you handle white spaces issues as I’ve had massive issues with that already

1 more reply

j / k navigate · click thread line to collapse