So perplexity can kind of weakly analyze the first few pages of small file size pdfs one at a time, but I’d love to have something that would allow me to upload several hundred research papers and textbooks that could then be analyzed for consensus and contradictions and give me more meaningful search results and summaries than keyword searching alone. Does anything like this exist in a fairly user friendly accessible format?

  • mozz
    link
    fedilink
    11 month ago

    Chroma is supposed to be able to import a ton of information into a vectorized format that lets you search through it in a way that’s semantically meaningful, so you (or your tool) can sort of pick out the stuff from a huge batch of source material that you need to pass to the LLM for any given query.

    I played around with it a little bit and I wasn’t able to determine if it was a real thing or just a weird AI hype thing, but people seem to take it seriously. I would bet that someone’s attempted to make a little system on top of it that lets you do stuff like what you’re wanting to do (since that’s what it’s made for), but IDK how well it would work… might be useful to search for stuff adjacent to Chroma or vector databases to see if there are tools like that, though.