Date: Wed, 28 May 2025 14:15:53 +0100
On Wed, May 28, 2025 at 1:39 PM Jonathan Wakely wrote:
>
> Although I think you can probably see why people are concerned when
> the thread topic says "AI that has processed all papers".
>
> That certainly sounds like an LLM that has been trained on all the
> papers, not one that retains no knowledge of them between queries. If
> that's not what you're talking about now, then it's a very misleading
> title.
I'm new to all this AI stuff. I'm not even entirely sure on the
difference between 'training' and 'learning' and 'retrieval-augmented
generation'.
What I can tell you is that my program works sort of like as follows:
auto handle = CreateHandleToArtificialIntelligenceModel();
for ( auto const &e : container_all_papers )
{
DeleteEverythingYouKnow( handle ):
LoadPaperIntoModel( handle );
bool const is_matching = AskQuestionAndGetBooleanAnswer("Does
this paper mention chocolate?");
if ( is_matching ) AddToSearchResults( e );
}
So the AI's memory gets wiped before every individual paper is loaded
in. Actually you can see the beginnings of that loop here:
https://github.com/healytpk/paperkernelcxx/blob/b5557109ccf4e617e046be4df0cfbaf48f84574b/main_program/GUI_Dialog_Main.cpp#L338
In the body of the loop, I invoke "NewContext" which wipes its memory,
and then I invoke 'LoadPaper'. I can't test that code properly yet
though coz I haven't got a proper graphics card. I should have a new
laptop in a month or so though and I'll get cracking on it then.
>
> Although I think you can probably see why people are concerned when
> the thread topic says "AI that has processed all papers".
>
> That certainly sounds like an LLM that has been trained on all the
> papers, not one that retains no knowledge of them between queries. If
> that's not what you're talking about now, then it's a very misleading
> title.
I'm new to all this AI stuff. I'm not even entirely sure on the
difference between 'training' and 'learning' and 'retrieval-augmented
generation'.
What I can tell you is that my program works sort of like as follows:
auto handle = CreateHandleToArtificialIntelligenceModel();
for ( auto const &e : container_all_papers )
{
DeleteEverythingYouKnow( handle ):
LoadPaperIntoModel( handle );
bool const is_matching = AskQuestionAndGetBooleanAnswer("Does
this paper mention chocolate?");
if ( is_matching ) AddToSearchResults( e );
}
So the AI's memory gets wiped before every individual paper is loaded
in. Actually you can see the beginnings of that loop here:
https://github.com/healytpk/paperkernelcxx/blob/b5557109ccf4e617e046be4df0cfbaf48f84574b/main_program/GUI_Dialog_Main.cpp#L338
In the body of the loop, I invoke "NewContext" which wipes its memory,
and then I invoke 'LoadPaper'. I can't test that code properly yet
though coz I haven't got a proper graphics card. I should have a new
laptop in a month or so though and I'll get cracking on it then.
Received on 2025-05-28 13:16:04