ZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 22 days agoRule2346757123926472142107lemmy.worldimagemessage-square12linkfedilinkarrow-up1216
arrow-up1216imageRule2346757123926472142107lemmy.worldZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 22 days agomessage-square12linkfedilink
minus-squareWirlocke@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·18 days agoLLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word. So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.
LLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word.
So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.