Five of us built this for our undergraduate thesis. The problem is easy to say out loud. Protein language models will happily tell you what a protein probably does, but they will not tell you why, and a biologist cannot act on an answer they are not allowed to check.
So we gave the model something to reason from. We took the 250,000 proteins in Prot2Text, clustered them down to 87,384 with MMseqs2 so nothing in the set was a near copy of anything else, then attached an evidence pack to every entry: Pfam domains, DeepLoc localisation, DeepTMHMM topology, SignalP peptides. GPT OSS 20B turned each pack into four short reasoning steps with a confidence score, and a validator quietly binned anything that cited evidence the protein did not actually have.
Training runs twice. First a projector we call MSPP 128 learns to squeeze a frozen ESM 2 into 128 tokens a language model can actually read. Then LLaMA 3.1 8B learns, through QLoRA on two T4 cards, to write the reasoning first and the answer second.
My favourite result is the least glamorous one. Reasoning before answering beat answering alone, 0.777 to 0.821 BERT F1 across sixteen matched variants. And one clear paragraph beat a tidy four step chain, which is not what any of us had bet on.
- Supervisor
- Dr. Farig Yousuf Sadeque
- Co-supervisor
- Dr. Swakkhar Shatabda
- Dataset
- 87,384 proteins
- Where
- BRAC University





