I worked for a startup in the beginning, and we as a team were developing lots of adapters for large scale databases that needed lots of foundational work to be able to correlate those datasets into a graph database. We also developed lots of web scrapers for weird seemingly internal websites of companies that looked like they were not really public.
Think of it as database dump pages similar to how sqlmap works when it pipes/passes through the data with dozens of SQL injection requests on an input field.
Took us a while to realize our tech stack was being used by Palantir Gotham and other high level projects in the end.
Quit my job right after realizing I was working for the personification of the devil by any meaning of implication of the word.
Lavender, the codename of the IDF "AI" that is being used to mass target rocket strikes on guilty-until-proven-otherwise-by-association-only civilians in gaza is literally the system I worked on, and I desperately regret ever working for them through a defense contractor.
If anybody from Palantir reads this: It's possible to get out, if you need help, shelter, migration, or anything, contact me.